At WWDC 2024, Apple announced iOS 18, the upcoming operating system for iPhones that will introduce several new features and improve existing ones. The company also introduced Apple Intelligence, a new “personal intelligence system” that will work on iPhone, iPad and Mac. Apple says it is combining the “power of generative models with personal context” to improve the overall user experience.
The company says all data is processed locally and is capable of creating language and images and taking action across apps. iOS 18 also features built-in ‘Writing Tools’ that allow users to rewrite, proofread and summarise text in first-party
Apple also introduced Image Playbackground, an on-device image generator that lets you create images in three styles – Animation, Illustration and Sketch in seconds. It is available as a separate app as well as works in apps like Messages.
In the updated Photos app, users will be able to create stories by simply typing a description. The company says “Apple Intelligence” can also pick the best photos and videos based on your description and arrange them in a movie with its very own narrative. Similar to Magic Eraser, users will also be able to remove distracting objects using the new Clean Up tool.
Siri is also getting some really useful features. With iOS 18, users can engage in “natural, contextually relevant, and personal” conversations with users able to quickly switch between voice and text.
You can also do things like scheduling text messages and even perform complex tasks using what Apple calls “on-screen awareness.” The company shared an example where Siri can search through your photos to get your driving license, extract the license number and paste it into a web form. In any app, users ask can ask Siri to help draft a message and change its tone.
While some queries will be processed on the device itself, Apple says it will harness the power of Apple silicon-powered servers without storing user data. The company also announced a partnership with ChatGPT maker OpenAI, with Siri now able to perform simple tasks on the device itself while diverting complex ones to the cloud.