Apple’s New AI-powered Tool: Editing Through Text Prompts

 Apple’s new AI Image tool lets users edit pics by describing them.

Apple, known for its technology innovation, is making waves again with the introduction of a groundbreaking AI model named MLLM-Guided Image Editing (MGIE). Developed in collaboration with the University of California, Santa Barbara, this open-source AI model aims to revolutionize photo editing on iPhones. The technology, showcased in a recently published research paper, demonstrates the capabilities of MGIE in performing Photoshop-style modifications based on text prompts from users.

What is Apple’s Text-Guided Photo Editing Tool

Apple introduced the MLLM-Guided Image Editing (MGIE), a new text-guided photo editing tool developed in collaboration with the University of California, Santa Barbara. MGIE works on the concept of processing both text and images, allowing users to instruct the AI through text prompts for desired photo changes. This technology empowers users to make Photoshop-style edits, ranging from simple to complex tasks. With MGIE, Apple takes a notable step toward redefining the user experience.

How Does MGIE Work

MGIE operates on a user-friendly principle, allowing easy photo editing through text prompts. Users have to upload an image and provide brief instructions, directing the AI to make desired changes. For instance, instructing MGIE to “make the grass greener”, shows its ability to process both text and images. Even though it is in its developmental stage, MGIE has shown the potential to respond to various user commands. The easy process allows users to actively partake in the creative allows of their photos.

How to Use MGIE

Users just have to upload an image, providing clear and brief instructions through text prompts. Whether it is about adjusting colors, removing objects, or enhancing specific details, users have to guide MGIE. VentureBeat’s public demonstration revealed the need for detailed guidance, making the interaction intuitive. regardless of its ongoing development, exploring MGIE on platforms like Gradio will give users a hands-on experience.

Will MGIE be in Future iPhones

People are curious about whether will MGIE, be a part of future iPhones or the upcoming iOS 18. Apple CEO Tim Cook assured that AI tools coming later this year might also include MGIE. Drawing similarities with Google’s Magic Editor, MGIE could redefine photo editing, offering users an easy and interactive experience. The prospect of MGIE becoming a flagship feature in Apple’s upcoming devices adds an exciting dimension to the ever-evolving world of smartphones.

Conclusion

Apple’s progress in the generative AI field, and now with the introduction of MGIE, shows its commitment to staying at the forefront of technological advancements. While the model is a work in progress, its potential to reshape image editing on iPhones is clear. As Apple continues to invest in AI, the future promises more creative tools and features.

FAQs on Apple’s New AI-powered Tool

Can MGIE be accessed now, and how do users try the demo?

While there might be a queue for content generation, users can explore the AI model on platforms like Gradio.

Is MGIE’s integration into future iPhones confirmed?

While not confirmed, hints about AI tools coming to devices later in the year spark speculation that MGIE might be in future iPhones or iOS 18.