mlsanityData to 7 Oct 2026

Touvigation: Embodied Adaptive Object Acquisition for Blind and Low-Vision Users in Unfamiliar Indoor Environments

arXiv 2609.21828 ↗First posted 18 Sep 2026cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Blind and low-vision users often face challenges when locating and physically acquiring objects in unfamiliar indoor environments. Existing vision-language-model-based assistants can provide semantic descriptions but may introduce latency, hallucinations, and guidance that is poorly aligned with embodied action. We present Touvigation, a hands-free object acquisition system that combines vision-language understanding with persistent local spatial modeling to provide low-latency, body-relative guidance. Drawing on formative interviews with eight blind and low-vision participants, we design a multi-stage guidance framework that adapts spatial references as users transition from orienting, to walking, to reaching and tactile verification. We evaluated Touvigation with 12 blind and low-vision participants against a multimodal large-language-model assistant and unassisted search. Touvigation achieved 100% task success, compared with 58% for the multimodal assistant and 85% for unassisted search, while reducing completion time and cognitive workload. Our findings demonstrate how persistent spatial grounding and adaptive embodied guidance can improve object acquisition for blind and low-vision users.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 75 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

18 of 75 references.

References · 18

  1. 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 852
  2. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
  3. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 133
  4. 2024WorldScribe: Towards Context-Aware Live Visual Descriptionscited by 26
  5. 2024Investigating Use Cases of AI-Powered Scene Description Applications for Blind and Low Vision Peoplecited by 24
  6. 2020Vision Skills Needed to Answer Visual Questionscited by 17
  7. 2024Misfitting With AI: How Blind People Verify and Contest AI Errorscited by 15
  8. 2024Enhancing the Travel Experience for People with Visual Impairments through Multimodal Interaction: NaviGPT, A Real-Time AI-Driven Mobile Navigation Systemcited by 13
  9. 2025Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Modelscited by 13
  10. 2025Towards Understanding the Use of MLLM-Enabled Applications for Visual Interpretation by Blind and Low Vision Peoplecited by 11
  11. 2025WanderGuide: Indoor Map-less Robotic Guide for Exploration by Blind Peoplecited by 8
  12. 2023StreetNav: Leveraging Street Cameras to Support Precise Outdoor Navigation for Blind Pedestrianscited by 6
6 more
  1. 2026TouchScribe: Augmenting Non-Visual Hand-Object Interactions with Automated Live Visual Descriptionscited by 3
  2. 2026How Multimodal Large Language Models Support Access to Visual Information: A Diary Study With Blind and Low Vision Peoplecited by 3
  3. 2025NaviSense: A Multimodal Assistive Mobile application for Object Retrieval by Persons with Visual Impairmentcited by 2
  4. 2026Say It My Way: Exploring Control in Conversational Visual Question Answering with Blind Userscited by 2
  5. 2025DuoZone: A User-Centric, LLM-Guided Mixed-Initiative XR Window Management Systemcited by 1
  6. 2026Feelium: A Touchable Blimp Body for Aerial Telepresencecited by 1

Built on by

Not cited yet.