mlsanityData to 14 Oct 2026

VLingNav: Embodied Navigation with Adaptive Reasoning and Visual-Assisted Linguistic Memory

arXiv 2601.08665 ↗First posted 13 Jan 2026cs.RO cs.CVcited by 10

On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA

Abstract (arXiv)

VLA models have shown promising potential in embodied navigation by unifying perception and planning while inheriting the strong generalization abilities of large VLMs. However, most existing VLA models rely on reactive mappings directly from observations to actions, lacking the explicit reasoning capabilities and persistent memory required for complex, long-horizon navigation tasks. To address these challenges, we propose VLingNav, a VLA model for embodied navigation grounded in linguistic-driven cognition. First, inspired by the dual-process theory of human cognition, we introduce an adaptive chain-of-thought mechanism, which dynamically triggers explicit reasoning only when necessary, enabling the agent to fluidly switch between fast, intuitive execution and slow, deliberate planning. Second, to handle long-horizon spatial dependencies, we develop a visual-assisted linguistic memory module that constructs a persistent, cross-modal semantic memory, enabling the agent to recall past observations to prevent repetitive exploration and infer movement trends for dynamic environments. For the training recipe, we construct Nav-AdaCoT-2.9M, the largest embodied navigation dataset with reasoning annotations to date, enriched with adaptive CoT annotations that induce a reasoning paradigm capable of adjusting both when to think and what to think about. Moreover, we incorporate an online expert-guided reinforcement learning stage, enabling the model to surpass pure imitation learning and to acquire more robust, self-explored navigation behaviors. Extensive experiments demonstrate that VLingNav achieves state-of-the-art performance across a wide range of embodied navigation benchmarks. Notably, VLingNav transfers to real-world robotic platforms in a zero-shot manner, executing various navigation tasks and demonstrating strong cross-domain and cross-task generalization.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 78 of its 90 references that are in the map. First posted on arXiv 13 Jan 2026.

Builds on

78 of 90 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025TrackVLA++: Unleashing Reasoning and Memory Capabilities in VLA Models for Embodied Visual Tracking8 Oct
  2. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulation26 Aug
  3. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
  4. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  5. 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul

Other references · 73

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  11. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  12. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
38 more
  1. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  2. 2022Token Merging: Your ViT But Fastercited by 1,021
  3. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  4. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
  5. 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 715
  6. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  7. 2023LightGlue: Local Feature Matching at Light Speedcited by 590
  8. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  9. 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
  10. 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
  11. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  12. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
  13. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  14. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
  15. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
  16. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  17. 2024Chain-of-Thought Reasoning Without Promptingcited by 210
  18. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
  19. 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 183
  20. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
  21. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  22. 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 151
  23. 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
  24. 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 119
  25. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
  26. 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
  27. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 109
  28. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 102
  29. 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 98
  30. 2025ReinFlow: Fine-tuning Flow Matching Policy with Online Reinforcement Learningcited by 97
  31. 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
  32. 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 89
  33. 2023GOAT: GO to Any Thingcited by 89
  34. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  35. 2022Offline Visual Representation Learning for Embodied Navigationcited by 75
  36. 2025Embodied Navigation Foundation Modelcited by 72
  37. 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
  38. 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 70

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Expand Your SCOPE: Semantic Cognition over Potential-Based Exploration for Embodied Visual Navigation
  2. 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness
  3. 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigation
  4. 2026FantasyVLN: Unified Multimodal Chain-of-Thought Reasoning for Vision-Language Navigation
  5. 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
  6. 2026A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration ↗
  7. 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning
  8. 2026AgentVLN: Towards Agentic Vision-and-Language Navigation