ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Existing vision-language navigation methods often couple a VLM with waypoint decoders to produce multi-step action plans, but they typically lack an explicit closed-loop mechanism for tracking semantic progress, diagnosing execution failures, and recovering from error accumulation in long-horizon navigation. To address this gap, we propose ReflectVLN, an agentic VLN framework that organizes decision-making through bidirectionally interactive intention and execution agents. The intention agent performs subtask decomposition and reflection, generating executable subtask descriptions as corrective plans. Conditioned on these descriptions, the execution agent grounds them into short-horizon actions under current observations while monitoring sub-goal progress and detecting off-track behavior. Crucially, ReflectVLN enables closed-loop bidirectional communication: the execution agent emits progress and deviation signals to trigger reflection and subtask updates on demand, and the intention agent returns structured guidance that reconditions subsequent actions for recovery. To encourage temporally coherent decisions with interpretable intermediate rationales, we introduce Action Chain-of-Thought (Action-CoT), a path-conditioned dual-query training scheme for action generation. Experiments on standard VLN benchmarks show that ReflectVLN improves success rates and path efficiency under a constrained data budget, with favorable training cost and fewer high-level intention calls at inference time, while providing interpretable intermediate decisions for analysis and collaboration. Code is available at: https://github.com/AIprogrammer/ReflectVLN
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 49 of its 53 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
49 of 53 references.
Closest ancestors · 1
Same direction, newest first
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigation8 Jul
Other references · 48
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
- 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 266
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
36 more
- 2023Large Language Model Guided Tree-of-Thoughtcited by 221
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 116
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
- 2022EnvEdit: Environment Editing for Vision-and-Language Navigationcited by 83
- 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 65
- 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigationcited by 62
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 36
- 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thoughtcited by 35
- 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 34
- 2024Diff-DAgger: Uncertainty Estimation with Diffusion Policy for Robotic Manipulationcited by 33
- 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 33
- 2025CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Modelcited by 27
- 2024FLAME: Learning to Navigate with Multimodal LLM in Urban Environmentscited by 19
- 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Predictioncited by 16
- 2025SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Modelscited by 9
- 2025UrbanNav: Learning Language-Guided Urban Navigation from Web-Scale Human Trajectoriescited by 6
- 2026DV-VLN: Dual Verification for Reliable LLM-Based Vision-and-Language Navigationcited by 3
- 2026Nipping the Drift in the Bud: Retrospective Rectification for Robust Vision-Language Navigationcited by 3
- 2026Bridging the Indoor-Outdoor Gap: Vision-Centric Instruction-Guided Embodied Navigation for the Last Meterscited by 3
- 2025Skill-Nav: Enhanced Navigation with Versatile Quadrupedal Locomotion via Waypoint Interfacecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigation
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigation
- 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
- 2026Seek Before You Move: Evidence Seeking for Progress Grounding in Vision-Language Navigation
- 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigation
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness