mlsanityData to 14 Oct 2026

StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation

arXiv 2610.05664 ↗First posted 5 Oct 2026cs.CV cs.ROcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Vision-and-Language Navigation (VLN) policies increasingly benefit from strong semantic priors provided by large vision-language models (VLMs). However, standard action supervision does not explicitly encourage intermediate representations to preserve scene geometry, relative orientation, or global episode progress. Incorporating depth estimators, explicit maps, point clouds, or geometry foundation models at inference can provide such structure but introduces additional computation, memory overhead, and architectural dependence during deployment. We introduce StageVLN, a training framework that shapes navigation representations through privileged spatial and trajectory guidance while preserving the original inference pathway. A frozen geometry foundation model provides multi-level spatial guidance to hierarchical navigator states, while relative-heading and expert-route progress objectives provide complementary trajectory-state supervision. All auxiliary components are used only during training and removed at deployment. On R2R-CE validation-unseen, StageVLN achieves 56.3% SR and 51.4% SPL with a 4B-parameter backbone, without an additional geometry encoder at inference. On RxR-CE, it achieves 54.3% SR without additional navigation training data or a geometry encoder at inference.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 40 of its 43 references that are in the map. First posted on arXiv 5 Oct 2026.

Builds on

40 of 43 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models4 Jun
  2. 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning28 Mar
  3. 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigation9 Dec
  4. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction26 May

Other references · 36

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  3. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  5. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  6. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  7. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  8. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  9. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
  10. 2015Unifying distillation and privileged informationcited by 233
  11. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
  12. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
24 more
  1. 2019Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Taskscited by 179
  2. 2019Self-Monitoring Navigation Agent via Auxiliary Progress Estimationcited by 176
  3. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
  4. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  5. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
  6. 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
  7. 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
  8. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  9. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
  10. 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
  11. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  12. 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
  13. 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
  14. 2025Embodied Navigation Foundation Modelcited by 72
  15. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
  16. 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
  17. 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
  18. 2023Learning Navigational Visual Representations with Semantic Map Supervisioncited by 43
  19. 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 39
  20. 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 34
  21. 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 22
  22. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 21
  23. 2025COSMO: Combination of Selective Memorization for Low-cost Vision-and-Language Navigationcited by 15
  24. 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AdaGeoVLN: Selective Geometry Across Representation Depth and Navigation Time for Vision-Language Navigation ↗
  2. 2026Robust Vision-Language Navigation with Awareness of Instruction-Execution Progress
  3. 2026What Limits Vision-and-Language Navigation ?
  4. 2026SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation
  5. 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior
  6. 2026FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigation
  7. 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
  8. 2026GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation