StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Vision-and-Language Navigation (VLN) policies increasingly benefit from strong semantic priors provided by large vision-language models (VLMs). However, standard action supervision does not explicitly encourage intermediate representations to preserve scene geometry, relative orientation, or global episode progress. Incorporating depth estimators, explicit maps, point clouds, or geometry foundation models at inference can provide such structure but introduces additional computation, memory overhead, and architectural dependence during deployment. We introduce StageVLN, a training framework that shapes navigation representations through privileged spatial and trajectory guidance while preserving the original inference pathway. A frozen geometry foundation model provides multi-level spatial guidance to hierarchical navigator states, while relative-heading and expert-route progress objectives provide complementary trajectory-state supervision. All auxiliary components are used only during training and removed at deployment. On R2R-CE validation-unseen, StageVLN achieves 56.3% SR and 51.4% SPL with a 4B-parameter backbone, without an additional geometry encoder at inference. On RxR-CE, it achieves 54.3% SR without additional navigation training data or a geometry encoder at inference.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 40 of its 43 references that are in the map. First posted on arXiv 5 Oct 2026.
Builds on
40 of 43 references.
Closest ancestors · 4
Same direction, newest first
- 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models4 Jun
- 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning28 Mar
- 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigation9 Dec
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction26 May
Other references · 36
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
- 2015Unifying distillation and privileged informationcited by 233
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
24 more
- 2019Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Taskscited by 179
- 2019Self-Monitoring Navigation Agent via Auxiliary Progress Estimationcited by 176
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
- 2025Embodied Navigation Foundation Modelcited by 72
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
- 2023Learning Navigational Visual Representations with Semantic Map Supervisioncited by 43
- 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 39
- 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 34
- 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 22
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 21
- 2025COSMO: Combination of Selective Memorization for Low-cost Vision-and-Language Navigationcited by 15
- 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AdaGeoVLN: Selective Geometry Across Representation Depth and Navigation Time for Vision-Language Navigation ↗
- 2026Robust Vision-Language Navigation with Awareness of Instruction-Execution Progress
- 2026What Limits Vision-and-Language Navigation ?
- 2026SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior
- 2026FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigation
- 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
- 2026GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation