Gemini Live's camera just became much more useful for accessibility

For blind and low-vision users, pointing a phone camera at something is only useful if the phone can explain what it sees. Google has been building towards just that with Gemini Live for more than a year, first adding visual guidance that could highlight objects on-screen. And now the company is turning that idea into a more accessibility-focused tool called Guided Vision.

Guided Vision is rolling out today in Gemini Live on compatible Android phones. Once enabled, users can share their camera and hear real-time descriptions of what’s around them, ask follow-up questions, and get spoken instructions to adjust the camera. If Gemini needs a better view, for example, it can ask you to pan right, tilt down, or step back.

We previously spotted Google preparing a dedicated Guided Vision toggle and later an accessibility shortcut that could jump straight into the feature. Google then previewed the finished experience in September, but said it was “coming soon.” Today’s announcement marks the actual launch.

Guided Vision can help with everyday tasks such as reading tiny labels, identifying appliance controls, finding a dropped earbud, locating something in a crowded cupboard, matching clothing colors, or describing an unfamiliar room. It also supports conversations across multiple languages.

Google says it developed Guided Vision with accessibility service Aira, including more than 1,000 members of Aira’s Trusted Tester network. You can enable it from Gemini’s settings, Android’s Accessibility menu, or directly through TalkBack.

Guided Vision works on devices running Android 9 or newer in regions and languages where Gemini Live is supported. Like any other AI tool, Guided Vision can make mistakes, so don’t rely on it for navigation, obstacle detection, or as a replacement for a white cane or other mobility aid.