GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidance
Not on the map. Why?
Abstract (arXiv)
Vision-and-language navigation (VLN) requires an agent to track progress through an extended instruction, identify landmarks relevant to its current objective, and understand the surrounding spatial structure to act. End-to-end navigation policies typically rely on action supervision to implicitly learn these capabilities. Without explicit guidance on the evidence underlying each decision, however, policies can overfit to correlations predictive of training actions rather than learn the task-relevant grounding and geometry needed for generalization. Our insight is to guide the representations that connect instructions to actions: identifying what remains to be done determines which visual evidence matters, while understanding the geometry around that evidence informs how to move. We introduce GuidedNav, a unified framework that explicitly shapes these representations through training-time guidance. Subtask and landmark guidance steer native pre-action attention toward the active instruction segment and relevant visual regions, grounding action prediction in the current objective. Spatial guidance aligns the policy's internal representations with geometric features that capture long-horizon context and local spatial structure. Together, these objectives strengthen navigation capabilities while avoiding the inference overhead of intermediate textual reasoning and online geometric encoding. We also introduce Guided-R2R and Guided-RxR, two annotation-enriched navigation datasets that support more interpretable VLN research. GuidedNav establishes state-of-the-art performance among the compared monocular RGB policies, improving success rates by 8.1% and 13.1% relative to the strongest prior results on R2R-CE and RxR-CE val-unseen, respectively, while achieving faster inference. Extensive experiments further demonstrate the effectiveness and real-world transferability of our approach.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 61 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
52 of 61 references.
References · 52
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2016Top-down Neural Attention by Excitation Backpropcited by 321
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
38 more
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
- 2016Single-Image Depth Perception in the Wildcited by 180
- 2019Self-Monitoring Navigation Agent via Auxiliary Progress Estimationcited by 176
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
- 2019Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Groundedcited by 128
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 122
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2019General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warpingcited by 105
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
- 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 79
- 2025Embodied Navigation Foundation Modelcited by 72
- 2020Sub-Instruction Aware Vision-and-Language Navigationcited by 66
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
- 2023Learning Navigational Visual Representations with Semantic Map Supervisioncited by 43
- 2023KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigationcited by 39
- 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 39
- 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 34
- 2023Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigationcited by 27
- 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 22
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 21
- 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 16
- 2025COSMO: Combination of Selective Memorization for Low-cost Vision-and-Language Navigationcited by 15
- 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigationcited by 12
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 10
- 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigationcited by 10
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.