GroundingVLN: Reasoning and Acting with Grounding for Vision-Language Navigation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Although vision-language models (VLMs) possess strong visual understanding and reasoning capabilities, existing vision-and-language navigation (VLN) agents struggle to connect semantic reasoning with spatial execution. Two coupled gaps remain in this connection, as intermediate reasoning is not explicitly anchored to visual evidence and high-level decisions lack precise spatial goals to guide low-level motion. Cognitive science suggests that human navigation bridges these levels hierarchically by anchoring cognition to relevant landmarks and guiding locomotion toward spatial goals. Motivated by this principle, we propose GroundingVLN, which uses visual grounding as a shared interface between reasoning and action. GroundingVLN first reasons with grounding by anchoring task-relevant visual evidence to precise image locations throughout structured reasoning. It then acts through grounding by predicting a progress-aligned pixel goal that a geometric planner translates into primitive actions. To learn these capabilities, we construct GroundingCOTVLN-188K, a dataset of temporally aligned grounded reasoning traces, and introduce Grounded and Execution-Aware Reinforcement Learning (GEAR), which aligns grounded reasoning and spatial decisions with downstream execution. Experiments demonstrate that GroundingVLN achieves state-of-the-art performance (69.9% SR on R2R-CE and 75.1% SR on RxR-CE) with high sample efficiency, using just 0.9% as much training data as the strongest baseline. It also generalizes strongly across datasets, attaining 59.9% SR on RxR-CE when trained solely on R2R, a gain of 20.1% over the strongest baseline. Code and models will be released after review. Code is available at [https://github.com/Teacher-Tom/GroundingVLN](https://github.com/Teacher-Tom/GroundingVLN).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 52 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
12 of 52 references.
References · 12
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2019General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warpingcited by 105
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 25
- 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 13
- 2026MapDream: Task-Driven Map Learning for Vision-Language Navigationcited by 4
- 2026Thinking with Visual Groundingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Green for Go, Red for No: Visual Grounding via Semantic Segmentation for VLA Navigation Policies
- 2026Seek Before You Move: Evidence Seeking for Progress Grounding in Vision-Language Navigation
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
- 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigation
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning
- 2025Grounded Reinforcement Learning for Visual Reasoning
- 2026Grounding Isn't Knowing: Do VLMs Need Object Localization for Spatial Reasoning?
- 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigation