mlsanityData to 7 Oct 2026

What Limits Vision-and-Language Navigation ?

arXiv 2605.13328 ↗First posted 13 May 2026cs.RO cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-and-Language Navigation (VLN) is a cornerstone of embodied intelligence. However, current agents often suffer from significant performance degradation when transitioning from simulation to real-world deployment, primarily due to perceptual instability (e.g., lighting variations and motion blur) and under-specified instructions. While existing methods attempt to bridge this gap by scaling up model size and training data, we argue that the bottleneck lies in the lack of robust spatial grounding and cross-domain priors. In this paper, we propose StereoNav, a robust Vision-Language-Action framework designed to enhance real-world navigation consistency. To address the inherent gap between synthetic training and physical execution, we introduce Target-Location Priors as a persistent bridge. These priors provide stable visual guidance that remains invariant across domains, effectively grounding the agent even when instructions are vague. Furthermore, to mitigate visual disturbances like motion blur and illumination shifts, StereoNav leverages stereo vision to construct a unified representation of semantics and geometry, enabling precise action prediction through enhanced depth awareness. Extensive experiments on R2R-CE and RxR-CE demonstrate that StereoNav achieves state-of-the-art egocentric RGB performance, with SR and SPL scores of 81.1% and 68.3%, and 67.5% and 52.0%, respectively, while using significantly fewer parameters and less training data than prior scaling-based approaches. More importantly, real-world robotic deployments confirm that StereoNav substantially improves navigation reliability in complex, unstructured environments. Project page: https://yunheng-wang.github.io/stereonav-public.github.io.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 57 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

51 of 57 references.

References · 51

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  5. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  6. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  7. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  8. 2025OpenAI GPT-5 System Cardcited by 910
  9. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  10. 2023Instruction Tuning with GPT-4cited by 676
  11. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  12. 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
38 more
  1. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  2. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
  3. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
  4. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  5. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
  6. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
  7. 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 116
  8. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
  9. 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
  10. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 80
  11. 2024Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Modelscited by 79
  12. 2025Embodied Navigation Foundation Modelcited by 65
  13. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
  14. 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMscited by 60
  15. 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigationcited by 56
  16. 2021RobustNav: Towards Benchmarking Robustness in Embodied Navigationcited by 52
  17. 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
  18. 2020Diagnosing the Environment Bias in Vision-and-Language Navigationcited by 41
  19. 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 41
  20. 2025CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Modelcited by 26
  21. 2025Rethinking the Embodied Gap in Vision-and-Language Navigation: A Holistic Study of Physical and Visual Disparitiescited by 24
  22. 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 23
  23. 2025Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigationcited by 21
  24. 2023A Survey on the Robustness of Computer Vision Models against Common Corruptionscited by 20
  25. 2025AstraNav-World: World Model for Foresight Control and Consistencycited by 17
  26. 2025DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigationcited by 15
  27. 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Predictioncited by 15
  28. 2020Multi-View Learning for Vision-and-Language Navigationcited by 11
  29. 2024Why Only Text: Empowering Vision-and-Language Navigation with Multi-modal Promptscited by 9
  30. 2026AgentVLN: Towards Agentic Vision-and-Language Navigationcited by 8
  31. 2025D3D-VLP: Dynamic 3D Vision-Language-Planning Model for Embodied Grounding and Navigationcited by 5
  32. 2026textscNaVIDA: Vision-Language Navigation with Inverse Dynamics Augmentationcited by 5
  33. 2025ETP-R1: Evolving Topological Planning with Reinforcement Fine-tuning for Vision-Language Navigation in Continuous Environmentscited by 4
  34. 2025CLASH: Collaborative Large-Small Hierarchical Framework for Continuous Vision-and-Language Navigationcited by 3
  35. 2026Let's Reward Step-by-Step: Step-Aware Contrastive Alignment for Vision-Language Navigation in Continuous Environmentscited by 3
  36. 2026DecoVLN: Decoupling Observation, Reasoning, and Correction for Vision-and-Language Navigationcited by 3
  37. 2026PROSPECT: Unified Streaming Vision-Language Navigation via Semantic--Spatial Fusion and Latent Predictive Representationcited by 2
  38. 2026P3Nav: End-to-End Perception, Prediction and Planning for Vision-and-Language Navigationcited by 2

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Navigation Framework Utilizing Vision-Language Models
  2. 2026Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigation
  3. 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
  4. 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation
  5. 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuning
  6. 2025VLNVerse: A Benchmark for Vision-Language Navigation with Versatile, Embodied, Realistic Simulation and Evaluation
  7. 2026GemNav: Discrete-Token Visual Robot Navigation using a Multimodal Large Language Model
  8. 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation