MSNav: Zero-Shot Vision-and-Language Navigation with Dynamic Memory and LLM Spatial Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Vision-and-Language Navigation (VLN) requires an agent to interpret natural language instructions and navigate complex environments. Current approaches often adopt a "black-box" paradigm, where a single Large Language Model (LLM) makes end-to-end decisions. However, it is plagued by critical vulnerabilities, including poor spatial reasoning, weak cross-modal grounding, and memory overload in long-horizon tasks. To systematically address these issues, we propose Memory Spatial Navigation(MSNav), a framework that fuses three modules into a synergistic architecture, which transforms fragile inference into a robust, integrated intelligence. MSNav integrates three modules: Memory Module, a dynamic map memory module that tackles memory overload through selective node pruning, enhancing long-range exploration; Spatial Module, a module for spatial reasoning and object relationship inference that improves endpoint recognition; and Decision Module, a module using LLM-based path planning to execute robust actions. Powering Spatial Module, we also introduce an Instruction-Object-Space (I-O-S) dataset and fine-tune the Qwen3-4B model into Qwen-Spatial (Qwen-Sp), which outperforms leading commercial LLMs in object list extraction, achieving higher F1 and NDCG scores on the I-O-S test set. Extensive experiments on the Room-to-Room (R2R) and REVERIE datasets demonstrate MSNav's state-of-the-art performance with significant improvements in Success Rate (SR) and Success weighted by Path Length (SPL).
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 51 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
17 of 51 references.
Closest ancestors · 3
Same direction, newest first
- 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models17 Jul
- 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoning12 Mar
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models26 May
Other references · 14
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024GPT-4o System Cardcited by 4,588
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
- 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
- 2021Airbert: In-domain Pretraining for Vision-and-Language Navigationcited by 130
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
- 2022Target-Driven Structured Transformer Planner for Vision-Language Navigationcited by 58
- 2022Learning from Unlabeled 3D Environments for Vision-and-Language Navigationcited by 50
2 more
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ProFocus: Proactive Perception and Focused Reasoning in Vision-and-Language Navigationcited by 4
- 2026Does Peer Observation Help? Vision-Sharing Collaboration for Vision-Language Navigationcited by 2
- 2026Global Commander and Local Operative: A Dual-Agent Framework for Scene Navigationcited by 0
- 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoningcited by 0
- 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoning31 May 2026
- 2026Does Peer Observation Help? Vision-Sharing Collaboration for Vision-Language Navigation21 Mar 2026
- 2026ProFocus: Proactive Perception and Focused Reasoning in Vision-and-Language Navigation1 Mar 2026
- 2026Global Commander and Local Operative: A Dual-Agent Framework for Scene Navigation21 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning
- 2024MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains
- 2025Mem4Nav: Boosting Vision-and-Language Navigation in Urban Environments with a Hierarchical Spatial-Cognition Long-Short Memory System
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigation
- 2025DyNaVLM: Zero-Shot Vision-Language Navigation System with Dynamic Viewpoints and Self-Refining Graph Memory
- 2026HiMemVLN: Enhancing Reliability of Open-Source Zero-Shot Vision-and-Language Navigation with Hierarchical Memory System
- 2026HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigation
- 2026RAGNav: A Retrieval-Augmented Topological Reasoning Framework for Multi-Goal Visual-Language Navigation