Seek Before You Move: Evidence Seeking for Progress Grounding in Vision-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Vision-Language Navigation (VLN) requires agents to continuously ground task progress from long-horizon instructions and partial egocentric observations. Existing VLM-based navigation agents typically reason only over available observations and may remain confident even when task-relevant evidence is missing. For example, an agent may confidently proceed forward and get lost even though the landmark indicating the next turn lies outside its current field of view. We term this failure mode Progress Myopia: the agent fails to recognize unreliable progress grounding and continues acting on insufficient evidence. To address it, we propose SeekVLN, an evidence-seeking framework that couples semantic progress reasoning with active acquisition of task-relevant observations. SeekVLN is trained in two stages: First, Future-guided Reverse Generation (FRG) uses future expert actions to augment offline expert trajectories with supplementary views and evidence annotations. Supervised fine-tuning on these trajectories establishes a prior for evidence seeking and progress reasoning without additional expert interaction. However, imitation alone does not reveal whether seeking improves subsequent navigation. We therefore introduce Counterfactual Contrastive Policy Optimization (C2PO) for reinforcement fine-tuning. By comparing each evidence-seeking branch with a counterfactual direct-navigation branch from the same state, C2PO uses a contrastive reward to assign credit to seeking decisions based on subsequent navigation benefit. Experiments on simulated benchmarks show that SeekVLN achieves state-of-the-art performance, improving success rate by 12.7% and 7.5% over the base model on R2R-CE and RxR-CE, respectively. Both simulated and real-world evaluations exhibit human-like evidence-seeking behaviors for more reliable progress grounding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 37 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
35 of 37 references.
References · 35
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
- 2019Self-Monitoring Navigation Agent via Auxiliary Progress Estimationcited by 176
23 more
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 122
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
- 2019The Regretful Agent: Heuristic-Aided Navigation through Progress Estimationcited by 105
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
- 2020Active Visual Information Gathering for Vision-Language Navigationcited by 55
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
- 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 39
- 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 38
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 36
- 2021Vision-Language Navigation: A Survey and Taxonomycited by 34
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 21
- 2024Vision-Language Navigation with Energy-Based Policycited by 19
- 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigationcited by 12
- 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigationcited by 7
- 2025ETP-R1: Evolving Topological Planning with Reinforcement Fine-tuning for Vision-Language Navigation in Continuous Environmentscited by 4
- 2025SeeNav-Agent: Enhancing Vision-Language Navigation with Visual Prompt and Step-Level Policy Optimizationcited by 3
- 2026Let's Reward Step-by-Step: Step-Aware Contrastive Alignment for Vision-Language Navigation in Continuous Environmentscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Routes to Steps: Separating Semantic Progress from Local Execution in Vision-and-Language Navigation
- 2026GroundingVLN: Reasoning and Acting with Grounding for Vision-Language Navigation
- 2026Robust Vision-Language Navigation with Awareness of Instruction-Execution Progress
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning
- 2026Foresight: Iterative Reasoning About Clues that Matter for Navigation
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigation
- 2025CompassNav: Steering From Path Imitation To Decision Understanding In Navigation