VLingNav: Embodied Navigation with Adaptive Reasoning and Visual-Assisted Linguistic Memory
On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA
Abstract (arXiv)
VLA models have shown promising potential in embodied navigation by unifying perception and planning while inheriting the strong generalization abilities of large VLMs. However, most existing VLA models rely on reactive mappings directly from observations to actions, lacking the explicit reasoning capabilities and persistent memory required for complex, long-horizon navigation tasks. To address these challenges, we propose VLingNav, a VLA model for embodied navigation grounded in linguistic-driven cognition. First, inspired by the dual-process theory of human cognition, we introduce an adaptive chain-of-thought mechanism, which dynamically triggers explicit reasoning only when necessary, enabling the agent to fluidly switch between fast, intuitive execution and slow, deliberate planning. Second, to handle long-horizon spatial dependencies, we develop a visual-assisted linguistic memory module that constructs a persistent, cross-modal semantic memory, enabling the agent to recall past observations to prevent repetitive exploration and infer movement trends for dynamic environments. For the training recipe, we construct Nav-AdaCoT-2.9M, the largest embodied navigation dataset with reasoning annotations to date, enriched with adaptive CoT annotations that induce a reasoning paradigm capable of adjusting both when to think and what to think about. Moreover, we incorporate an online expert-guided reinforcement learning stage, enabling the model to surpass pure imitation learning and to acquire more robust, self-explored navigation behaviors. Extensive experiments demonstrate that VLingNav achieves state-of-the-art performance across a wide range of embodied navigation benchmarks. Notably, VLingNav transfers to real-world robotic platforms in a zero-shot manner, executing various navigation tasks and demonstrating strong cross-domain and cross-task generalization.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 78 of its 90 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
78 of 90 references.
Closest ancestors · 5
Same direction, newest first
- 2025TrackVLA++: Unleashing Reasoning and Memory Capabilities in VLA Models for Embodied Visual Tracking8 Oct
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulation26 Aug
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
Other references · 73
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
38 more
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2022Token Merging: Your ViT But Fastercited by 1,021
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 715
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2024Chain-of-Thought Reasoning Without Promptingcited by 210
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
- 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 183
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 151
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
- 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 119
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
- 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 109
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 102
- 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 98
- 2025ReinFlow: Fine-tuning Flow Matching Policy with Online Reinforcement Learningcited by 97
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
- 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 89
- 2023GOAT: GO to Any Thingcited by 89
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
- 2022Offline Visual Representation Learning for Embodied Navigationcited by 75
- 2025Embodied Navigation Foundation Modelcited by 72
- 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 70
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026BagelVLA: Enhancing Long-Horizon Manipulation via Interleaved Vision-Language-Action Generationcited by 30
- 2026CoMaTrack: Competitive Multi-Agent Game-Theoretic Tracking with Vision-Language-Action Modelscited by 5
- 2026GroundControl: Anticipating Navigation Failures in Vision-Language Agents via Trajectory-Consistent Uncertainty Estimatescited by 2
- 2026MemoGuard: An Adaptive Runtime for Guarding Against Memory Traps in Communication-Limited Robot Navigationcited by 2
- 2026Think Like a Pilot: Fine-Grained Long-Horizon UAV Navigationcited by 1
- 2026Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigationcited by 1
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigationcited by 1
- 2026Hierarchical 3D Scene Graph Construction and Belief-based Planning for Semantic Navigationcited by 0
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generationcited by 0
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behaviorcited by 0
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior21 Sep 2026
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation31 Aug 2026
- 2026Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigation18 Aug 2026
- 2026MemoGuard: An Adaptive Runtime for Guarding Against Memory Traps in Communication-Limited Robot Navigation17 Jul 2026
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation12 Jul 2026
- 2026Hierarchical 3D Scene Graph Construction and Belief-based Planning for Semantic Navigation30 Jun 2026
- 2026GroundControl: Anticipating Navigation Failures in Vision-Language Agents via Trajectory-Consistent Uncertainty Estimates18 Jun 2026
- 2026Think Like a Pilot: Fine-Grained Long-Horizon UAV Navigation5 Jun 2026
- 2026CoMaTrack: Competitive Multi-Agent Game-Theoretic Tracking with Vision-Language-Action Models24 Mar 2026
- 2026BagelVLA: Enhancing Long-Horizon Manipulation via Interleaved Vision-Language-Action Generation10 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Expand Your SCOPE: Semantic Cognition over Potential-Based Exploration for Embodied Visual Navigation
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigation
- 2026FantasyVLN: Unified Multimodal Chain-of-Thought Reasoning for Vision-Language Navigation
- 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
- 2026A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration ↗
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigation