For example, instead of using exact predefined commands, users may be able to describe what they want in plain language—making device control more accessible for people with limited mobility or speech variations. The feature is designed to simplify hands‑free interaction across Apple’s platforms.
VoiceOver, Apple’s screen reader for blind and low‑vision users, is receiving significant upgrades through Apple Intelligence.
One new capability, sometimes referred to as Image Explorer, enables VoiceOver to provide richer descriptions of images and on‑screen content. The system can interpret photographs, documents, and interface elements and describe them in more detail.
In practical use, this could allow a user to point their device at a document or bill and hear detailed explanations of what the camera sees—potentially even asking follow‑up questions to clarify the content.
The Magnifier accessibility tool is also gaining AI‑powered enhancements.
Using Apple Intelligence, Magnifier can analyze the device’s camera feed and provide real‑time descriptions of objects, text, and surroundings, helping users better understand their environment.
This feature is particularly aimed at people with low vision, enabling them to explore spaces and physical objects more easily through spoken descriptions and camera‑based assistance.
Apple is also expanding AI capabilities into Accessibility Reader, another assistive feature designed to simplify and present content in a more readable format.
By combining Apple Intelligence with existing accessibility tools—including VoiceOver, Magnifier, and Voice Control—the company aims to create a more consistent experience across apps and devices.
Another major addition is automatically generated subtitles for video content that doesn’t already include captions.
Apple says these subtitles will be generated on device, meaning the processing happens locally rather than in the cloud. The feature is designed to work across the Apple ecosystem, including iPhone, iPad, Mac, Apple TV, and Vision Pro.
This capability could significantly improve accessibility for people with hearing impairments, especially when watching user‑generated or older videos that lack caption support.
Apple also announced a new accessibility feature for Apple Vision Pro: the ability to control compatible power wheelchairs using eye tracking.
Vision Pro already includes eye‑tracking controls for interacting with the headset’s interface. With this update, that technology can extend to mobility devices, enabling users to steer or control their wheelchair through eye movements while wearing the headset.
The feature aims to broaden accessibility for people with mobility impairments by connecting spatial computing with assistive hardware.
Apple revealed the updates on May 19, 2026, ahead of Global Accessibility Awareness Day, as an early preview of upcoming platform changes.
While the company has not confirmed exact release dates, it says the new accessibility features will arrive later in 2026, likely alongside the next generation of operating system updates across Apple devices.
Accessibility has long been a core focus for Apple’s platform design, and the latest updates show how AI is reshaping assistive technology.
By combining on‑device intelligence, computer vision, and natural‑language interaction, Apple is aiming to make devices more intuitive for users who rely on assistive tools every day. Features like real‑time scene descriptions, conversational voice control, and eye‑based mobility controls represent a shift toward systems that understand the world around the user—not just the screen.
If implemented as previewed, these updates could significantly expand how people with vision, hearing, or mobility challenges interact with Apple devices across the entire ecosystem.
Comments
0 comments