mlsanityData to 7 Oct 2026

Stop Wandering: Efficient Vision-Language Navigation via Metacognitive Reasoning

arXiv 2604.02318 ↗First posted 2 Apr 2026cs.RO cs.CVcited by 3

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to inefficient behaviors such as local oscillation and redundant revisiting. We argue that this stems from a lack of metacognitive capabilities: the agent cannot monitor its exploration progress, diagnose strategy failures, or adapt accordingly. To address this, we propose MetaNav, a metacognitive navigation agent integrating spatial memory, history-aware planning, and reflective correction. Spatial memory builds a persistent 3D semantic map. History-aware planning penalizes revisiting to improve efficiency. Reflective correction detects stagnation and uses an LLM to generate corrective rules that guide future frontier selection. Experiments on GOAT-Bench, HM3D-OVON, and A-EQA show that MetaNav achieves state-of-the-art performance while reducing VLM queries by 20.7%, demonstrating that metacognitive reasoning significantly improves robustness and efficiency.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 33 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

27 of 33 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Mem2Ego: Empowering Vision-Language Models with Global-to-Ego Memory for Long-Horizon Embodied Navigation20 Feb
  2. 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigation20 Sep

Other references · 25

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2023Segment Anythingcited by 8,158
  5. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  6. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
  7. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  8. 2017Embodied Question Answeringcited by 335
  9. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
  10. 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 177
  11. 2024Chain of Thoughtlessness? An Analysis of CoT in Planningcited by 100
  12. 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
13 more
  1. 2024MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigationcited by 85
  2. 2023Octopus: Embodied Vision-Language Programmer from Environmental Feedbackcited by 73
  3. 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 66
  4. 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
  5. 2023SayNav: Grounding Large Language Models for Dynamic Planning to Navigation in New Environmentscited by 53
  6. 2025Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigationcited by 50
  7. 2023LangNav: Language as a Perceptual Representation for Navigationcited by 47
  8. 2024Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generationcited by 44
  9. 2024GraphEQA: Using 3D Semantic Scene Graphs for Real-time Embodied Question Answeringcited by 37
  10. 2025ApexNav: An Adaptive Exploration Strategy for Zero-Shot Object Navigation with Target-centric Semantic Fusioncited by 29
  11. 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 18
  12. 2025Enter the Mind Palace: Reasoning and Planning for Long-term Active Embodied Question Answeringcited by 12
  13. 2025AdaNav: Adaptive Reasoning with Uncertainty for Vision-Language Navigationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Navigation Framework Utilizing Vision-Language Models
  2. 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
  3. 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigation
  4. 2025MSNav: Zero-Shot Vision-and-Language Navigation with Dynamic Memory and LLM Spatial Reasoning
  5. 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
  6. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
  7. 2026AgentVLN: Towards Agentic Vision-and-Language Navigation
  8. 2025Run, Ruminate, and Regulate: A Dual-process Thinking System for Vision-and-Language Navigation