Google’s Guided Vision has launched in Gemini Live on compatible Android devices, giving users spoken descriptions of what their phone camera sees and verbal prompts to reframe a shot. Google built the feature with blind and low-vision users in mind, while also pitching it as help for everyday tasks such as reading small print.
With the camera shared in Gemini Live, users can ask what is nearby, locate an object, read text on a label or menu, and ask follow-up questions about what the phone sees. Google’s launch announcement says Guided Vision can also give spoken cues when the camera is too high, too close or pointed slightly off-centre. The Verge’s report notes that Google has ruled out using it for navigation and obstacle detection.
Google’s official Android page shows the camera interface with a request to find an item among spice jars:
What Guided Vision can do in Gemini Live
Guided Vision is designed for short, practical visual questions. Google’s examples include reading nutrition labels, appliance dials and printed menus in dim lighting, as well as finding a dropped earbud or locating an item in a crowded cupboard. Users can ask Gemini to describe colours, patterns and shapes, or to give an overview of a room or objects on a table.
The feature is conversational rather than a one-shot image caption. If the camera misses an object, Gemini can ask the user to pan, tilt or step back until it has a clearer view. A person can then ask a follow-up question, such as requesting a detail from an item already found. That reframing guidance is part of the interaction; the camera still has to be pointed at the relevant scene.
Google says it developed Guided Vision with Aira and members of the blind and low-vision community. The company says Aira’s Trusted Tester network included more than 1,000 people who tested everyday situations, while Aira specialists helped evaluate safety guardrails. Google also says the work used tens of thousands of hours of visual-interpretation data. Those are company-reported development details, not an independent accuracy test.
The use cases are not limited to people with visual impairments. Google also points to older adults, people with low literacy and anyone who needs help reading small text in poor lighting. Gemini Live has been expanding in other directions too: tbreak recently covered Google’s Gemini Live video avatars, an enterprise feature aimed at live conversational agents rather than camera-based accessibility.
How to turn on Guided Vision
In the Gemini app, open the profile menu, go to Settings and switch on “Use Guided Vision in Live”. Start a Gemini Live session and tap the camera-sharing control. Google’s Android Accessibility Help page lists the same steps and says the feature is rolling out gradually, so its absence from the menu does not necessarily mean a phone is incompatible.
Android also offers shortcuts under Settings > Accessibility > Vision assistance > Guided Vision. Users can launch it with the floating accessibility button, a two-finger swipe or both volume keys. With TalkBack enabled, a three-finger tap opens the TalkBack menu, where Guided Vision can be selected directly.
What Android users in the UAE should check
Google says Guided Vision is available on Android 9 and newer in regions and languages where Gemini Live is supported, and recommends updating both the Gemini app and Android system software. Google’s Gemini mobile-app availability list includes the United Arab Emirates, but that does not promise that every UAE account or device will receive Guided Vision at once. The separate accessibility help page says rollout is gradual, and Google has not published a UAE-specific schedule.
If it appears, the feature needs a live camera share to describe the scene. It can make mistakes and is not a medical device, mobility aid or white-cane replacement. Google says not to use it for navigation, safe-travel guidance or obstacle detection; the camera prompts are for framing what the user wants Gemini to inspect, not for guiding someone through a physical environment.
People deciding whether to share live video can also review Google’s Gemini Apps Privacy Hub. Google says Gemini Live videos and screenshares are not used to improve its services by default. If Keep Activity is on, however, shared content can be saved in Gemini Activity, and the setting can be changed from the account’s activity controls.
Does Guided Vision work on iPhone?
Google launched Guided Vision for compatible Android devices running Android 9 or newer. Google has not announced an iPhone version.
Does Guided Vision replace TalkBack?
No. TalkBack is Android’s screen reader, and Google offers Guided Vision as an option in the TalkBack menu. Guided Vision describes the physical scene seen by the camera; Google has not described it as a replacement for screen-reader functions.
Should I rely on Guided Vision to check medication instructions?
No. Guided Vision can read small text, but Google warns that it can make mistakes and is not a medical device. Use the original label and confirm anything affecting treatment with a qualified health professional.
What happens to Gemini Live video data?
Google says Gemini Live videos and screenshares are not used to improve its services by default. If Keep Activity is on, shared content can be saved in Gemini Activity; users can review or change that setting in Google’s Gemini Apps Privacy Hub.
Why might Guided Vision be missing from an Android 9+ phone?
Android 9 is only the minimum operating-system requirement. Google also requires a region and language where Gemini Live is supported, and says Guided Vision is rolling out gradually. Update the Gemini app and Android system software, then check again later if the setting is still absent.
