mlsanityData to 14 Oct 2026

NavAble: A Large-Scale Dataset and Synthetic Data Generation Pipeline for Blind Navigation

arXiv 2610.19330 ↗First posted 14 Oct 2026cs.CV cs.ROcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data

Abstract (arXiv)

Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assistive navigation technologies that support safe, independent mobility for blind and low-vision (BLV) users. Yet these categories are underrepresented in existing large-scale vision datasets, and the few datasets that include them suffer from limited class coverage, inconsistent annotations, and poor diversity. We introduce NavAble, a large-scale dataset spanning 11 accessibility-critical object classes, combining 41K curated open-source images with 8K newly collected, densely annotated real-world images. To extend scale and diversity, we develop a synthetic data generation pipeline that renders high-fidelity 3D assets across 37 environments under diverse styles and viewpoints, yielding 452K frames with rich ground-truth annotations from 565 assets. The pipeline minimizes manual effort by combining automated web image crawling, VLM-based filtering, SAM 3D-based asset generation, and convenient camera trajectory configuration, enabling large-scale data generation at a diversity unattainable through manual collection. Experiments show that fine-tuning existing segmentation models on the NavAble Dataset achieves reliable accessibility-object segmentation (>80% mIoU on our held-out test set). We also demonstrate the effectiveness of synthetic data augmentation, which yields up to +3.5 mIoU over real-world-only fine-tuning. Beyond benchmark evaluation, validation on egocentric data from two mobility-assistive robots demonstrates improved perception reliability in real-world navigation scenarios. Together, NavAble establishes a scalable foundation for BLV navigation perception, directly addressing the data scarcity and embodiment gaps. The dataset and pipeline are publicly available at https://huggingface.co/datasets/NavAble/NeurIPS_2026_BLV.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 22 of its 42 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

22 of 42 references.

References · 22

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  4. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  5. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  8. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
  9. 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 300
  10. 2018Context Encoding for Semantic Segmentationcited by 290
  11. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  12. 2021Robotic Guide Dog: Leading a Human with Leash-Guided Hybrid Physical Interactioncited by 16
10 more
  1. 2025GuideDog: A Real-World Egocentric Multimodal Dataset for Blind and Low-Vision Accessibility-Aware Guidancecited by 10
  2. 2024Towards Robotic Companions: Understanding Handler-Guide Dog Interactions for Informed Guide Dog Robot Designcited by 9
  3. 2023StreetNav: Leveraging Street Cameras to Support Precise Outdoor Navigation for Blind Pedestrianscited by 7
  4. 2024Identifying Crucial Objects in Blind and Low-Vision Individuals' Navigationcited by 6
  5. 2025Space-Aware Instruction Tuning: Dataset and Benchmark for Guide Dog Robots Assisting the Visually Impairedcited by 6
  6. 2024A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigationcited by 5
  7. 2025GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelerscited by 4
  8. 2025Understanding Expectations for a Robotic Guide Dog for Visually Impaired Peoplecited by 3
  9. 2026GuideTWSI: A Diverse Tactile Walking Surface Indicator Dataset from Synthetic and Real-World Images for Blind and Low-Vision Navigationcited by 2
  10. 2025Human-Centered Development of Guide Dog Robots: Quiet and Stable Locomotion Controlcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025mmWalk: Towards Multi-modal Multi-view Walking Assistance
  2. 2025Towards Blind and Low-Vision Accessibility of Lightweight VLMs and Custom LLM-Evals
  3. 2026NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigation
  4. 2026VIABench: A Comprehensive Video Benchmark Collected from Blind Individuals for Visual Impairment Assistance
  5. 2025MM-Nav: Multi-View VLA Model for Robust Visual Navigation via Multi-Expert Learning
  6. 2025NaviSense: A Multimodal Assistive Mobile application for Object Retrieval by Persons with Visual Impairment
  7. 2025The Escalator Problem: Identifying Implicit Motion Blindness in AI for Accessibility
  8. 2026Assisted Spatial Cognition Through Vision-Language Models