Gemini Live Guided Vision turns Android cameras into accessibility assistants

Google is adding Guided Vision to Gemini Live, allowing Android users to point a camera at objects or surroundings and receive spoken guidance about what the phone can see. The system can describe labels, menus and physical environments while instructing a user to move or reframe the camera when the relevant object is not clearly visible. The feature has particular value for blind and low-vision users and can integrate with TalkBack and Android accessibility shortcuts.

Google plans to support a much wider device range than just recent flagships, with availability extending back across older Android versions in supported Gemini markets. Guided Vision demonstrates one of the strongest practical cases for multimodal AI. Instead of generating novelty images or long conversational answers, the model acts as an interface between a user and the immediate physical environment.

Reliability matters enormously because accessibility tools need consistent behaviour, but real-time visual interpretation has the potential to turn the smartphone camera into something closer to an everyday assistive sensor.