Spatial-VLN: Zero-Shot Vision-and-Language Navigation With Explicit Spatial Perception and Exploration
Not on the map. Why?
Abstract (arXiv)
Zero-shot Vision-and-Language Navigation (VLN) agents leveraging Large Language Models (LLMs) excel in generalization but suffer from insufficient spatial perception. Focusing on complex continuous environments, we categorize key perceptual bottlenecks into three spatial challenges: door interaction,multi-room navigation, and ambiguous instruction execution, where existing methods consistently suffer high failure rates. We present Spatial-VLN, a perception-guided exploration framework designed to overcome these challenges. The framework consists of two main modules. The Spatial Perception Enhancement (SPE) module integrates panoramic filtering with specialized door and region experts to produce spatially coherent, cross-view consistent perceptual representations. Building on this foundation, our Explored Multi-expert Reasoning (EMR) module uses parallel LLM experts to address waypoint-level semantics and region-level spatial transitions. When discrepancies arise between expert predictions, a query-and-explore mechanism is activated, prompting the agent to actively probe critical areas and resolve perceptual ambiguities. Experiments on VLN-CE demonstrate that Spatial VLN achieves state-of-the-art performance using only low-cost LLMs. Furthermore, to validate real-world applicability, we introduce a value-based waypoint sampling strategy that effectively bridges the Sim2Real gap. Extensive real-world evaluations confirm that our framework delivers superior generalization and robustness in complex environments. Our codes and videos are available at https://yueluhhxx.github.io/Spatial-VLN-web/.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 25 of its 28 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
25 of 28 references.
References · 25
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
- 2023Scaling Data Generation in Vision-and-Language Navigationcited by 117
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
13 more
- 2020Sim-to-Real Transfer for Vision-and-Language Navigationcited by 89
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMscited by 62
- 2021Neighbor-view Enhanced Model for Vision and Language Navigationcited by 50
- 2024Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environmentscited by 50
- 2025SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigationcited by 29
- 2021IPAPRec: A promising tool for learning high-performance mapless navigation skills with deep reinforcement learningcited by 10
- 2024Navigating Beyond Instructions: Vision-and-Language Navigation in Obstructed Environmentscited by 10
- 2021Rule-Based Reinforcement Learning for Efficient Robot Navigation with Space Reductioncited by 9
- 2025VLN-Zero: Rapid Exploration and Cache-Enabled Neurosymbolic Vision-Language Planning for Zero-Shot Transfer in Robot Navigationcited by 8
- 2024TDANet: Target-Directed Attention Network For Object-Goal Visual Navigation With Zero-Shot Abilitycited by 7
- 2025Boosting Zero-Shot VLN via Abstract Obstacle Map-Based Waypoint Prediction with TopoGraph-and-VisitInfo-Aware Promptingcited by 4
- 2023A Transferability Metric Using Scene Similarity and Local Map Observation for DRL Navigationcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026CoMaTrack: Competitive Multi-Agent Game-Theoretic Tracking with Vision-Language-Action Modelscited by 5
- 2026SpatialAnt: Autonomous Zero-Shot Robot Navigation via Active Scene Reconstruction and Visual Anticipationcited by 2
- 2026SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigationcited by 2
- 2026ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Modelscited by 2
- 2026GeoScaffold: Learning Compact Geometric Latents via Reconstruction for Efficient Vision-Language Navigationcited by 0
- 2026GeoScaffold: Learning Compact Geometric Latents via Reconstruction for Efficient Vision-Language Navigation2 Oct 2026
- 2026ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Models20 May 2026
- 2026SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation30 Apr 2026
- 2026SpatialAnt: Autonomous Zero-Shot Robot Navigation via Active Scene Reconstruction and Visual Anticipation27 Mar 2026
- 2026CoMaTrack: Competitive Multi-Agent Game-Theoretic Tracking with Vision-Language-Action Models24 Mar 2026