Apple Intelligence Gets Even More Powerful With New Capabilities Across Apple Devices
Apple announced significant upgrades to Apple Intelligence, introducing new features across iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro. These enhancements bring private, fast, and offline intelligent experiences directly to users and developers alike.
Developers Can Now Access Apple’s On-Device Foundation Model
Apple is opening access to the on-device foundation model powering Apple Intelligence. Developers can integrate this model into their apps, enabling intelligent features that run locally on devices. This approach ensures user privacy, fast performance, and offline availability while eliminating cloud costs. Apps in education, outdoor activities, and more will benefit from this direct access through the new Foundation Models framework, which supports Swift with minimal coding.
Live Translation Breaks Language Barriers
Live Translation now integrates across Messages, FaceTime, and Phone to provide seamless communication in multiple languages. Messages translate automatically as users type, FaceTime shows translated live captions, and phone calls include real-time spoken translation. All processing occurs on-device, maintaining privacy and security.
Expanded Creativity With Genmoji & Image Playground
Genmoji and Image Playground receive updates that enhance creative expression. Users can combine emojis with text prompts to generate personalised avatars and images. New artistic styles, such as oil painting and vector art, powered by ChatGPT, expand creative options. All user data is handled with consent and privacy in mind.
Visual Intelligence Enhances Interaction With Screen Content
Visual intelligence now allows users to interact with content on their iPhone screen more effectively. Users can search for objects, find similar items online, or add events to their calendar automatically based on detected information. This feature integrates with apps like Google and Etsy and works by simple screen commands, improving productivity and discovery.
Workout Buddy Brings Personalised Fitness Coaching To Apple Watch
Workout Buddy uses Apple Intelligence to analyse workout data and provide real-time, motivational coaching via Apple Watch. It tracks heart rate, pace, distance, and fitness milestones, delivering insights through a generative voice model inspired by Fitness+ trainers. This feature supports various workout types and processes data securely on-device.
Shortcuts Get Smarter With Apple Intelligence Integration
Shortcuts now incorporate intelligent actions powered by Apple Intelligence. Users can automate tasks such as text summarisation and image generation within their shortcuts, maintaining data privacy by running locally or using Private Cloud Compute. This enhancement streamlines workflows and unlocks new automation possibilities.
Privacy At The Core Of Apple Intelligence
Apple Intelligence features prioritise user privacy by processing data primarily on-device. For more complex tasks requiring cloud resources, Private Cloud Compute ensures data is never stored or shared with Apple. Independent experts regularly verify these privacy measures.
Availability
These new Apple Intelligence features are available for developer testing immediately and will enter public beta next month. Supported devices include the latest iPhone, iPad, Mac models with M1 or later, Apple Watch Series 6 or newer, and Apple Vision Pro. Initial language support covers English, French, German, Italian, Portuguese (Brazil), Spanish, Japanese, Korean, and simplified Chinese, with additional languages coming by year-end.
For full details, visit apple.com/apple-intelligence.
