SceneScout: Towards AI Agent-driven Access to Street View Imagery for Blind Users
Not on the map. Why?
Abstract (arXiv)
People who are blind or have low vision (BLV) may hesitate to travel independently in unfamiliar environments due to uncertainty about the physical landscape. While most tools focus on in-situ navigation, those exploring pre-travel assistance typically provide only landmarks and turn-by-turn instructions, lacking detailed visual context. Street view imagery, which contains rich visual information and has the potential to reveal numerous environmental details, remains inaccessible to BLV people. In this work, we introduce SceneScout, a multimodal large language model (MLLM)-driven AI agent that enables accessible interactions with street view imagery. SceneScout supports two modes: (1) Route Preview, enabling users to familiarize themselves with visual details along a route, and (2) Virtual Exploration, enabling free movement within street view imagery. Our user study (N=10) demonstrates that SceneScout helps BLV users uncover visual information otherwise unavailable through existing means. A technical evaluation shows that most descriptions are accurate (72%) and describe stable visual elements (95%) even in older imagery, though occasional subtle and plausible errors make them difficult to verify without sight. We discuss future opportunities and challenges of using street view imagery to enhance navigation experiences.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). First posted on arXiv 12 Apr 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Exploring the Use of VLMs for Navigation Assistance for People with Blindness and Low Vision
- 2026UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City
- 2025mmWalk: Towards Multi-modal Multi-view Walking Assistance
- 2025GuideDog: A Real-World Egocentric Multimodal Dataset for Blind and Low-Vision Accessibility-Aware Guidance
- 2025Are Large Vision-Language Models Ready to Guide Blind and Low-Vision Individuals?
- 2025From Street View to Visual Network: Mapping the Visibility of Urban Landmarks with Vision-Language Models
- 2023A Multi-Modal Foundation Model to Assist People with Blindness and Low Vision in Environmental Interaction
- 2026Assisted Spatial Cognition Through Vision-Language Models