Apple Previews iOS 27 Auto-Generated Subtitles

Apple has offered a first look at iOS 27 by unveiling a set of accessibility features, including a new "Generated Subtitles" tool designed to caption any video automatically. The function utilizes on-device speech recognition to transcribe spoken audio for clips that lack captions, covering content across social media, the Photos app, and Messages [1]. This preview precedes the official unveiling of the operating system at the Worldwide Developers Conference scheduled for June 8 [2].

Key takeaways

• iOS 27 will feature "Generated Subtitles" to automatically create captions for videos that do not already have them [1].
• The tool uses on-device processing to generate subtitles privately on iPhone, iPad, Mac, Apple TV, and Vision Pro [1][2].
• At launch, the feature will only support English and will be restricted to users in the U.S. and Canada [1].
• Additional updates include natural language support for Voice Control and enhanced Visual Intelligence within the Magnifier app [2].

Automatic captioning for systemwide video

The new subtitle capability aims to address the inconsistency of caption availability across different platforms and personal video libraries. By leveraging Apple Intelligence, the system can display transcriptions for videos recorded on an iPhone or received from friends, with users able to customize the appearance of the text through the playback menu or Settings [1]. While the feature is currently limited to English in North America, reports suggest it may expand to other languages and territories over time [1]. The on-device nature of the processing ensures that the audio recognition is performed privately without sending data to external servers [1].

Broader accessibility upgrades arriving later this year

The announcement coincides with Global Accessibility Awareness Day and highlights several other AI-driven improvements coming to Apple's operating systems later this year [2]. Beyond subtitles, the Voice Control feature will evolve to understand natural language commands, allowing users to describe on-screen elements by color or content rather than specific names [2]. Additionally, the Magnifier and VoiceOver tools will receive upgrades to Visual Intelligence, providing more detailed descriptions of objects and text within the camera viewfinder [2]. Apple also teased new Vision Pro capabilities, such as eye-tracking support for controlling power wheelchairs and face gestures for system interactions [2].

Why it matters

The introduction of systemwide, automatic subtitle generation represents a significant step toward digital inclusivity, removing barriers for users who are deaf or hard of hearing while offering convenience for those watching content in sound-sensitive environments [1][2]. By integrating these capabilities directly into the OS, Apple is utilizing its on-device AI infrastructure to enhance user privacy and accessibility without relying on third-party solutions. The full scope of iOS 27, alongside updates for macOS and visionOS, is expected to be detailed further at the upcoming developer conference [2].