NavAble: A Large-Scale Dataset and Synthetic Data Generation Pipeline for Blind Navigation
On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data
Abstract (arXiv)
Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assistive navigation technologies that support safe, independent mobility for blind and low-vision (BLV) users. Yet these categories are underrepresented in existing large-scale vision datasets, and the few datasets that include them suffer from limited class coverage, inconsistent annotations, and poor diversity. We introduce NavAble, a large-scale dataset spanning 11 accessibility-critical object classes, combining 41K curated open-source images with 8K newly collected, densely annotated real-world images. To extend scale and diversity, we develop a synthetic data generation pipeline that renders high-fidelity 3D assets across 37 environments under diverse styles and viewpoints, yielding 452K frames with rich ground-truth annotations from 565 assets. The pipeline minimizes manual effort by combining automated web image crawling, VLM-based filtering, SAM 3D-based asset generation, and convenient camera trajectory configuration, enabling large-scale data generation at a diversity unattainable through manual collection. Experiments show that fine-tuning existing segmentation models on the NavAble Dataset achieves reliable accessibility-object segmentation (>80% mIoU on our held-out test set). We also demonstrate the effectiveness of synthetic data augmentation, which yields up to +3.5 mIoU over real-world-only fine-tuning. Beyond benchmark evaluation, validation on egocentric data from two mobility-assistive robots demonstrates improved perception reliability in real-world navigation scenarios. Together, NavAble establishes a scalable foundation for BLV navigation perception, directly addressing the data scarcity and embodiment gaps. The dataset and pipeline are publicly available at https://huggingface.co/datasets/NavAble/NeurIPS_2026_BLV.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 22 of its 42 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
22 of 42 references.
References · 22
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
- 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 300
- 2018Context Encoding for Semantic Segmentationcited by 290
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2021Robotic Guide Dog: Leading a Human with Leash-Guided Hybrid Physical Interactioncited by 16
10 more
- 2025GuideDog: A Real-World Egocentric Multimodal Dataset for Blind and Low-Vision Accessibility-Aware Guidancecited by 10
- 2024Towards Robotic Companions: Understanding Handler-Guide Dog Interactions for Informed Guide Dog Robot Designcited by 9
- 2023StreetNav: Leveraging Street Cameras to Support Precise Outdoor Navigation for Blind Pedestrianscited by 7
- 2024Identifying Crucial Objects in Blind and Low-Vision Individuals' Navigationcited by 6
- 2025Space-Aware Instruction Tuning: Dataset and Benchmark for Guide Dog Robots Assisting the Visually Impairedcited by 6
- 2024A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigationcited by 5
- 2025GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelerscited by 4
- 2025Understanding Expectations for a Robotic Guide Dog for Visually Impaired Peoplecited by 3
- 2026GuideTWSI: A Diverse Tactile Walking Surface Indicator Dataset from Synthetic and Real-World Images for Blind and Low-Vision Navigationcited by 2
- 2025Human-Centered Development of Guide Dog Robots: Quiet and Stable Locomotion Controlcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025mmWalk: Towards Multi-modal Multi-view Walking Assistance
- 2025Towards Blind and Low-Vision Accessibility of Lightweight VLMs and Custom LLM-Evals
- 2026NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigation
- 2026VIABench: A Comprehensive Video Benchmark Collected from Blind Individuals for Visual Impairment Assistance
- 2025MM-Nav: Multi-View VLA Model for Robust Visual Navigation via Multi-Expert Learning
- 2025NaviSense: A Multimodal Assistive Mobile application for Object Retrieval by Persons with Visual Impairment
- 2025The Escalator Problem: Identifying Implicit Motion Blindness in AI for Accessibility
- 2026Assisted Spatial Cognition Through Vision-Language Models