mlsanityData to 7 Oct 2026

Generating Contextually-Relevant Navigation Instructions for Blind and Low Vision People

arXiv 2407.08219 ↗First posted 11 Jul 2024cs.CL cs.HCcited by 7

Not on the map. Why?

Abstract (arXiv)

Navigating unfamiliar environments presents significant challenges for blind and low-vision (BLV) individuals. In this work, we construct a dataset of images and goals across different scenarios such as searching through kitchens or navigating outdoors. We then investigate how grounded instruction generation methods can provide contextually-relevant navigational guidance to users in these instances. Through a sighted user study, we demonstrate that large pretrained language models can produce correct and useful instructions perceived as beneficial for BLV users. We also conduct a survey and interview with 4 BLV users and observe useful insights on preferences for different instructions based on the scenario.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 8 of its 22 references that are in the map. First posted on arXiv 11 Jul 2024.

Builds on

8 of 22 references.

References · 8

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 852
  3. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  4. 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
  5. 2021Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Modelscited by 52
  6. 2022Context Matters for Image Descriptions for Accessibility: Challenges for Referenceless Evaluation Metricscited by 18
  7. 2019Deep Learning based Wearable Assistive System for Visually Impaired Peoplecited by 12
  8. 2024Towards Robotic Companions: Understanding Handler-Guide Dog Interactions for Informed Guide Dog Robot Designcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 3.

7 papers.

  1. 2024WalkVLM:Aid Visually Impaired People Walking by Vision Language Modelcited by 13
  2. 2025Less Redundancy: Boosting Practicality of Vision Language Model in Walking Assistantscited by 2
  3. 2025Multilingual Vision-Language Models, A Surveycited by 1
  4. 2026Exploring the Use of VLMs for Navigation Assistance for People with Blindness and Low Visioncited by 1
  5. 2026VIABLE: A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluationcited by 1
  6. 2025How Blind and Low-Vision Individuals Prefer Large Vision-Language Model-Generated Scene Descriptionscited by 0
  7. 2026Urban Risk-Aware Navigation via VQA-Based Event Maps for People with Low Visioncited by 0