mlsanityData to 14 Oct 2026

GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidance

arXiv 2610.13122 ↗First posted 9 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-and-language navigation (VLN) requires an agent to track progress through an extended instruction, identify landmarks relevant to its current objective, and understand the surrounding spatial structure to act. End-to-end navigation policies typically rely on action supervision to implicitly learn these capabilities. Without explicit guidance on the evidence underlying each decision, however, policies can overfit to correlations predictive of training actions rather than learn the task-relevant grounding and geometry needed for generalization. Our insight is to guide the representations that connect instructions to actions: identifying what remains to be done determines which visual evidence matters, while understanding the geometry around that evidence informs how to move. We introduce GuidedNav, a unified framework that explicitly shapes these representations through training-time guidance. Subtask and landmark guidance steer native pre-action attention toward the active instruction segment and relevant visual regions, grounding action prediction in the current objective. Spatial guidance aligns the policy's internal representations with geometric features that capture long-horizon context and local spatial structure. Together, these objectives strengthen navigation capabilities while avoiding the inference overhead of intermediate textual reasoning and online geometric encoding. We also introduce Guided-R2R and Guided-RxR, two annotation-enriched navigation datasets that support more interpretable VLN research. GuidedNav establishes state-of-the-art performance among the compared monocular RGB policies, improving success rates by 8.1% and 13.1% relative to the strongest prior results on R2R-CE and RxR-CE val-unseen, respectively, while achieving faster inference. Extensive experiments further demonstrate the effectiveness and real-world transferability of our approach.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 61 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

52 of 61 references.

References · 52

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  4. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  5. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  6. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  7. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
  8. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  9. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  10. 2016Top-down Neural Attention by Excitation Backpropcited by 321
  11. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
  12. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
38 more
  1. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  2. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
  3. 2016Single-Image Depth Perception in the Wildcited by 180
  4. 2019Self-Monitoring Navigation Agent via Auxiliary Progress Estimationcited by 176
  5. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
  6. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
  7. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  8. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
  9. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  10. 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
  11. 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
  12. 2019Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Groundedcited by 128
  13. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  14. 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 122
  15. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
  16. 2019General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warpingcited by 105
  17. 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
  18. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  19. 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
  20. 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
  21. 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 79
  22. 2025Embodied Navigation Foundation Modelcited by 72
  23. 2020Sub-Instruction Aware Vision-and-Language Navigationcited by 66
  24. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
  25. 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
  26. 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
  27. 2023Learning Navigational Visual Representations with Semantic Map Supervisioncited by 43
  28. 2023KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigationcited by 39
  29. 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 39
  30. 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 34
  31. 2023Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigationcited by 27
  32. 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 22
  33. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 21
  34. 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 16
  35. 2025COSMO: Combination of Selective Memorization for Low-cost Vision-and-Language Navigationcited by 15
  36. 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigationcited by 12
  37. 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 10
  38. 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigationcited by 10

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.