Look out, Photoshop: Apple just released a new image-editing AI model

Apple has been working with UC Santa Barbara researchers to develop an AI model capable of editing images based on your instructions, and the result is now available for anyone to try out as open-source software.

This new AI model uses multimodal large language models (aka MLLMs) to translate requests written in natural language (like “make the frame red”) into actionable instructions, then act on them to generate and modify images. The new MLLM-Guided Image Editing model (or MGIE for short) is open-source software available for download via GitHub, and it’s also available as a web demo on the Hugging Spaces platform that you can check out yourself.

That demo allows you to generate an image via text prompt or upload one yourself, then ask the model to make changes to it using natural language. The MGIE model then generates the edited image and presents it to you for further edits.

microsoft, look out, photoshop: apple just released a new image-editing ai model

These examples from the research paper outlining MGIE showcase how the AI image editing tool can make edits to an image and get progressively better over time. (Image credit: Apple/USCB)

This could be a big deal, not just because Apple’s involved, but because this new AI model could be a more capable and more effective tool than existing AI image editors.

That’s potentially huge because in Silicon Valley the race is on to build better photo and video editors using AI tools, with titans like Adobe putting generative AI into Photoshop and Meta confirming AI video and image editing are coming to Instagram and Facebook.

Apple has kept a relatively low profile in the AI arms race thus far, but the company is reportedly ramping up AI acquisitions and recruitment and it teased big AI plans ahead of the Vision Pro launch, so there’s a good chance you’ll hear more about AI out of Cupertino in 2024, particularly when it’s time to preview iOS 18 at this year’s Worldwide Developers Conference.

Outlook

Apple researchers and their UCSB colleagues teaming up to release this MGIE model under an open-source license is a significant step forward in AI research, but it’s yet unclear whether this advancement will impact Apple products in 2024.

I say that because the MGIE model appears to have been developed using DeepSpeed, a suite of libraries and tools released by Microsoft to help developers train and optimize AI models. DeepSpeed doesn’t play well with Apple silicon, so it seems unlikely the MGIE model as it exists now could run locally on Apple hardware.

But this research does hint at where Cupertino’s AI research is headed. Apple doesn’t publicly crow about AI the same way companies like Google and Microsoft do, but the MacBook maker has been quietly building technologies we now lump under the “AI” umbrella into its devices for years. The “Neural Engine” built into every slice of Apple silicon is optimized for AI work like blurring video or editing images, and Apple has been using it to help you auto-enhance your photos with one tap as early as the iPhone 11.

So while you won’t likely see Apple’s upgraded image-editing AI tool launching as a standalone app on the App Store anytime soon, I expect you will see the fruits of this research cropping up as upgrades to the built-in image editing tools of the best iPhones, the best iPads and the best MacBooks in the years ahead.

More from Tom’s Guide

    News Related

    OTHER NEWS

    Paul Hosford: Helen McEntee's future depends on the streets of Dublin remaining peaceful

    Paul Hosford: Helen McEntee’s future depends on the streets of Dublin remaining peaceful The issue of policing in Dublin has been thrown into sharp focus following the horrific stabbing of ... Read more »

    Five hospitalised following 'serious' two vehicle road traffic collision

    The collision occurred on Monday morning. (stock image) Five people have been hospitalised following a two vehicle road traffic collision on Monday. Gardaí are appealing for witnesses to the collision, ... Read more »

    Challenge: Try to find the hidden cat in a very old building

    Challenge: Try to find the hidden cat in a very old building (Photo: Reproduction/Reddit) Only people with advanced observation skills can identify the hidden cat in this very old building. ... Read more »

    Man arrested following suspected cocaine seizure in Galway worth €56,000

    A man has been arrested following a seizure of cocaine with a value of €56,000 in Galway on Sunday evening. Gardaí seized the drugs during a search at a residence ... Read more »

    Parkinson's Disease Warning Signs: What To Look Out For

    generic doctor image Overview A chronic and progressive movement disorder that initially causes tremor in one hand, stiffness or slowing of movement. Symptoms If you or someone you know is ... Read more »

    Man caught with over €1M worth of cocaine in van has jail time doubled in appeal

    A man who was caught with over €1 million in cocaine in a “sophisticated” operation where the drugs were hidden in a modified compartment in his van has had his ... Read more »

    Fine Gael TD Fergus O'Dowd announces he will stand down after the next General Election

    File image of Fine Gael TD Fergus O’Dowd. FINE GAEL TD Fergus O’Dowd has announced that he will stand down at the next General Election. O’Dowd started his political career ... Read more »
    Top List in the World