mlsanityData to 14 Oct 2026

LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation

arXiv 2608.30935 ↗First posted 31 Aug 2026cs.RO cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Embodied navigation requires agents to translate heterogeneous goals and visual observations into actions across tasks, environments, and robot embodiments. Modern vision-language models (VLMs) already encode spatial priors for visual grounding, spatial reasoning, and pointing, but these capabilities are rarely elicited directly for robot control. Existing navigation systems instead rely on task- or embodiment-specific components, fragmenting perception, reasoning, and action while offering limited generalization. Here we present LightNav-0, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads. LightNav-0 represents diverse navigation tasks through a unified token interface: dual-channel pointing expresses task-, scene-, and embodiment-agnostic spatial intent, while a residual vector-quantized action tokenizer maps this intent to precise, embodiment-specific trajectories. Together with temporally aware visual history compression, ER mid-training, supervised fine-tuning, and reinforcement learning, this formulation supports instruction following, open-vocabulary object navigation, and visual tracking within a single model. The navigation training corpus spans 2K+ scenes and 4K+ hours of embodied navigation data. LightNav-ER, the embodied-reasoning checkpoint used to initialize LightNav-0, attains the highest complete-set average across 8 embodied-reasoning benchmarks, while LightNav-0 achieves state-of-the-art monocular success rates across all 10 public navigation simulation settings. Real-world evaluations further demonstrate zero-shot generalization across robot embodiments, diverse scenes, and static and dynamic targets. These results establish compact VLMs as a unified and transferable backbone for generalist embodied navigation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 87 of its 102 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

87 of 102 references.

References · 87

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2025Qwen3-VL Technical Reportcited by 2,793
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  9. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  10. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  11. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  12. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
38 more
  1. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  2. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  3. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  4. 2018On Evaluation of Embodied Navigation Agentscited by 547
  5. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  6. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  7. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  8. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  9. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  10. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
  11. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
  12. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  13. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  14. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
  15. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
  16. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
  17. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  18. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
  19. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
  20. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
  21. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  22. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 156
  23. 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 151
  24. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
  25. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
  26. 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
  27. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 127
  28. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  29. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
  30. 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
  31. 2023Scaling Data Generation in Vision-and-Language Navigationcited by 117
  32. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 109
  33. 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
  34. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  35. 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
  36. 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
  37. 2025Embodied Navigation Foundation Modelcited by 72
  38. 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71

50 most cited of 87 All 87 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Embodied4C: Measuring What Matters for Embodied Vision-Language Navigation
  2. 2026SkillNav: Score-Level Skill Intervention for Zero-Shot Object Goal Navigation
  3. 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation
  4. 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
  5. 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents
  6. 2026AgentVLN: Towards Agentic Vision-and-Language Navigation
  7. 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation
  8. 2026SpatialPoint: Spatial-aware Point Prediction for Embodied Localization