mlsanityData to 7 Oct 2026

Bridging the Indoor-Outdoor Gap: Vision-Centric Instruction-Guided Embodied Navigation for the Last Meters

arXiv 2602.06427 ↗First posted 6 Feb 2026cs.CV cs.ROcited by 3

Not on the map. Why?

Abstract (arXiv)

Embodied navigation holds significant promise for real-world applications such as last-mile delivery. However, most existing approaches are confined to either indoor or outdoor environments and rely heavily on strong assumptions, such as access to precise coordinate systems. While current outdoor methods can guide agents to the vicinity of a target using coarse-grained localization, they fail to enable fine-grained entry through specific building entrances, critically limiting their utility in practical deployment scenarios that require seamless outdoor-to-indoor transitions. To bridge this gap, we introduce a novel task: out-to-in prior-free instruction-driven embodied navigation. This formulation explicitly eliminates reliance on accurate external priors, requiring agents to navigate solely based on egocentric visual observations guided by instructions. To tackle this task, we propose a vision-centric embodied navigation framework that leverages image-based prompts to drive decision-making. Additionally, we present the first open-source dataset for this task, featuring a pipeline that integrates trajectory-conditioned video synthesis into the data generation process. Through extensive experiments, we demonstrate that our proposed method consistently outperforms state-of-the-art baselines across key metrics including success rate and path efficiency.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 64 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

53 of 64 references.

References · 53

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  3. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  4. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  5. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  6. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  7. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
  8. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  9. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  10. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  11. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  12. 2022Visual Language Maps for Robot Navigationcited by 362
38 more
  1. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
  2. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
  3. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  4. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  5. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
  6. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
  7. 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 228
  8. 2023ViNT: A Foundation Model for Visual Navigationcited by 210
  9. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  10. 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
  11. 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
  12. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
  13. 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
  14. 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
  15. 2022Navigating to Objects in the Real Worldcited by 104
  16. 2020Language and Visual Entity Relationship Graph for Agent Navigationcited by 100
  17. 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
  18. 2018Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigationcited by 84
  19. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  20. 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 77
  21. 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 73
  22. 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
  23. 2022ADAPT: Vision-Language Navigation with Modality-Aligned Action Promptscited by 45
  24. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
  25. 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 40
  26. 2021Diagnosing Vision-and-Language Navigation: What Really Matterscited by 36
  27. 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 34
  28. 2024LeLaN: Learning A Language-Conditioned Navigation Policy from In-the-Wild Videoscited by 31
  29. 2020Generating Landmark Navigation Instructions from Maps as a Graph-to-Text Problemcited by 22
  30. 2022PEANUT: Predicting and Navigating to Unseen Targetscited by 22
  31. 2024FLAME: Learning to Navigate with Multimodal LLM in Urban Environmentscited by 19
  32. 2025FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Taskscited by 16
  33. 2024Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigationcited by 15
  34. 2025NaviTrace: Evaluating Embodied Navigation of Vision-Language Modelscited by 13
  35. 2025REGNav: Room Expert Guided Image-Goal Navigationcited by 12
  36. 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
  37. 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 11
  38. 2025UrbanNav: Learning Language-Guided Urban Navigation from Web-Scale Human Trajectoriescited by 6

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.