Apple has significantly upgraded its Apple Intelligence system, introducing powerful new features across iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro.
Starting today, developers can tap directly into Apple’s on-device foundation model, unlocking private and intelligent app experiences that work offline.
These enhancements include Live Translation in Messages, FaceTime, and Phone, enabling real-time, on-device translations in multiple languages. Users can now chat or call across language barriers with immediate, private translations.
Creative tools like Genmoji and Image Playground now offer more customization, letting users mix emoji styles or generate images in new styles via ChatGPT—with full user control over shared data.
Apple’s visual intelligence has also expanded, allowing users to interact with content on their screens. They can highlight objects, extract event details, or ask ChatGPT for context—all without leaving the screen.
On Apple Watch, the new Workout Buddy feature leverages Apple Intelligence to offer real-time, voice-powered workout insights based on personalized fitness data.
A major update now gives developers direct access to Apple’s on-device foundation model using the new Foundation Models framework, with native Swift support. This lets apps use Apple’s AI for tasks like natural language search or personalized quizzes—entirely offline and without API costs.
Shortcuts now support intelligent actions, letting users summarize text, create images, or feed AI-generated results into complex workflows. Apple Wallet, Mail, Messages, and Reminders also see deeper Apple Intelligence integration, enhancing productivity and personalization.
Apple emphasized privacy as a core feature. Most processing happens on-device, while complex tasks use Private Cloud Compute, ensuring user data is never stored or shared.
Apple Intelligence is now available for testing to developers, with a public beta next month. It will roll out this fall to iPhone 15 Pro, iPhone 16 models, M1+ Macs, and supported iPads. Languages supported at launch include English, French, German, Italian, Japanese, Korean, Portuguese (Brazil), Spanish, and Chinese (Simplified), with more coming later this year.