mlsanityData to 14 Oct 2026

ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning

arXiv 2607.12680 ↗First posted 14 Jul 2026cs.CVcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Existing vision-language navigation methods often couple a VLM with waypoint decoders to produce multi-step action plans, but they typically lack an explicit closed-loop mechanism for tracking semantic progress, diagnosing execution failures, and recovering from error accumulation in long-horizon navigation. To address this gap, we propose ReflectVLN, an agentic VLN framework that organizes decision-making through bidirectionally interactive intention and execution agents. The intention agent performs subtask decomposition and reflection, generating executable subtask descriptions as corrective plans. Conditioned on these descriptions, the execution agent grounds them into short-horizon actions under current observations while monitoring sub-goal progress and detecting off-track behavior. Crucially, ReflectVLN enables closed-loop bidirectional communication: the execution agent emits progress and deviation signals to trigger reflection and subtask updates on demand, and the intention agent returns structured guidance that reconditions subsequent actions for recovery. To encourage temporally coherent decisions with interpretable intermediate rationales, we introduce Action Chain-of-Thought (Action-CoT), a path-conditioned dual-query training scheme for action generation. Experiments on standard VLN benchmarks show that ReflectVLN improves success rates and path efficiency under a constrained data budget, with favorable training cost and fewer high-level intention calls at inference time, while providing interpretable intermediate decisions for analysis and collaboration. Code is available at: https://github.com/AIprogrammer/ReflectVLN

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 49 of its 53 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

49 of 53 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigation8 Jul

Other references · 48

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  6. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  7. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  8. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  9. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  10. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
  11. 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 266
  12. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
36 more
  1. 2023Large Language Model Guided Tree-of-Thoughtcited by 221
  2. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
  3. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  4. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  5. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
  6. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
  7. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
  8. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  9. 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
  10. 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
  11. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  12. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
  13. 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 116
  14. 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
  15. 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
  16. 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
  17. 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
  18. 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
  19. 2022EnvEdit: Environment Editing for Vision-and-Language Navigationcited by 83
  20. 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 65
  21. 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigationcited by 62
  22. 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
  23. 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 36
  24. 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thoughtcited by 35
  25. 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 34
  26. 2024Diff-DAgger: Uncertainty Estimation with Diffusion Policy for Robotic Manipulationcited by 33
  27. 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 33
  28. 2025CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Modelcited by 27
  29. 2024FLAME: Learning to Navigate with Multimodal LLM in Urban Environmentscited by 19
  30. 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Predictioncited by 16
  31. 2025SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Modelscited by 9
  32. 2025UrbanNav: Learning Language-Guided Urban Navigation from Web-Scale Human Trajectoriescited by 6
  33. 2026DV-VLN: Dual Verification for Reliable LLM-Based Vision-and-Language Navigationcited by 3
  34. 2026Nipping the Drift in the Bud: Retrospective Rectification for Robust Vision-Language Navigationcited by 3
  35. 2026Bridging the Indoor-Outdoor Gap: Vision-Centric Instruction-Guided Embodied Navigation for the Last Meterscited by 3
  36. 2025Skill-Nav: Enhanced Navigation with Versatile Quadrupedal Locomotion via Waypoint Interfacecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
  2. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
  3. 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigation
  4. 2026AgentVLN: Towards Agentic Vision-and-Language Navigation
  5. 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
  6. 2026Seek Before You Move: Evidence Seeking for Progress Grounding in Vision-Language Navigation
  7. 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigation
  8. 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness