Gemini Live Guided Vision expands camera-based assistance across Android

Google is expanding Gemini Live's Guided Vision, allowing users to point an Android phone camera at objects or surroundings and receive spoken assistance. The system can describe what it sees and tell users how to reposition the camera when the subject is not framed clearly enough. Accessibility is the most obvious use case, particularly for blind and low-vision users who may need help reading packaging, locating objects or understanding unfamiliar environments.

Google says Guided Vision can work on eligible devices running Android 9 or newer, meaning the feature is not restricted to the latest flagship hardware. That wide compatibility is significant because many AI tools remain limited to expensive new devices. Camera-based assistance also creates a higher reliability standard than ordinary chatbot responses. An incorrect trivia answer is frustrating; inaccurate information about someone's physical surroundings can create genuine risk.

Google's challenge is therefore to communicate uncertainty clearly when Gemini is not confident. If it works reliably, Guided Vision turns the smartphone camera into an interactive conversational sensor rather than merely a photography tool.