Apple is gearing up to introduce a plethora of AI features with iOS 18 under the internal codename “Project Greymatter”.
A new report sheds light on the advanced AI tools coming to Siri, Notes, and Photos, aiming to enhance user experience across its ecosystem.
One of the standout features is Greymatter Catch Up, previously detailed as “smart recaps”. This notification summary feature will provide users with summaries for missed notifications, web pages, notes, and documents.
Notably, users will be able to ask Siri for a recap of their recent notifications, streamlining information retrieval.
Siri, Apple’s digital assistant, is undergoing a significant transformation with the integration of Apple’s on-device Large Language Model (LLM) and a new smart response framework. This overhaul is expected to result in more cognitive and natural-sounding responses, with deeper integration of contacts, companies, calendar events, and locations.
Furthermore, Apple is reportedly working on cross-device media controls, allowing users to control media playback on devices like Apple TV directly from their Apple Watch.
Both Siri and the Notes app are set to benefit from built-in text summarization and audio-to-text transcription, enhancing productivity and accessibility.
In the Photos app, Apple is backing generative AI features across iOS 18, iPadOS 18, and macOS 15. The Clean Up feature will enable users to remove unwanted objects from their photos, akin to Google’s Magic Eraser. The more intriguing Generative Playground will allow for image generation and photo edits directly within the Photos app and through an app extension in iMessage.
The Notes app is also receiving significant updates, including in-app audio recordings, allowing users to add text, audio, and images in a single note. A major productivity addition is Math Notes, which supports mathematical notation, recognizes text in the form of mathematical equations, and provides solutions to problems.
With these enhancements, iOS 18 promises to bring substantial advancements to Apple’s ecosystem, leveraging AI to deliver a more intuitive and efficient user experience.
