Bridging the Indoor-Outdoor Gap: Vision-Centric Instruction-Guided Embodied Navigation for the Last Meters
Not on the map. Why?
Abstract (arXiv)
Embodied navigation holds significant promise for real-world applications such as last-mile delivery. However, most existing approaches are confined to either indoor or outdoor environments and rely heavily on strong assumptions, such as access to precise coordinate systems. While current outdoor methods can guide agents to the vicinity of a target using coarse-grained localization, they fail to enable fine-grained entry through specific building entrances, critically limiting their utility in practical deployment scenarios that require seamless outdoor-to-indoor transitions. To bridge this gap, we introduce a novel task: out-to-in prior-free instruction-driven embodied navigation. This formulation explicitly eliminates reliance on accurate external priors, requiring agents to navigate solely based on egocentric visual observations guided by instructions. To tackle this task, we propose a vision-centric embodied navigation framework that leverages image-based prompts to drive decision-making. Additionally, we present the first open-source dataset for this task, featuring a pipeline that integrates trajectory-conditioned video synthesis into the data generation process. Through extensive experiments, we demonstrate that our proposed method consistently outperforms state-of-the-art baselines across key metrics including success rate and path efficiency.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 64 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
53 of 64 references.
References · 53
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2022Visual Language Maps for Robot Navigationcited by 362
38 more
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
- 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 228
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
- 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
- 2022Navigating to Objects in the Real Worldcited by 104
- 2020Language and Visual Entity Relationship Graph for Agent Navigationcited by 100
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
- 2018Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigationcited by 84
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
- 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 77
- 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 73
- 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
- 2022ADAPT: Vision-Language Navigation with Modality-Aligned Action Promptscited by 45
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
- 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 40
- 2021Diagnosing Vision-and-Language Navigation: What Really Matterscited by 36
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 34
- 2024LeLaN: Learning A Language-Conditioned Navigation Policy from In-the-Wild Videoscited by 31
- 2020Generating Landmark Navigation Instructions from Maps as a Graph-to-Text Problemcited by 22
- 2022PEANUT: Predicting and Navigating to Unseen Targetscited by 22
- 2024FLAME: Learning to Navigate with Multimodal LLM in Urban Environmentscited by 19
- 2025FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Taskscited by 16
- 2024Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigationcited by 15
- 2025NaviTrace: Evaluating Embodied Navigation of Vision-Language Modelscited by 13
- 2025REGNav: Room Expert Guided Image-Goal Navigationcited by 12
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
- 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 11
- 2025UrbanNav: Learning Language-Guided Urban Navigation from Web-Scale Human Trajectoriescited by 6
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 23
- 2026POINav: Benchmarking and Enhancing Final-Meters Arrival in Real-World Vision-Language Navigationcited by 2
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoningcited by 0
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning14 Jul 2026
- 2026POINav: Benchmarking and Enhancing Final-Meters Arrival in Real-World Vision-Language Navigation27 May 2026
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigation12 Feb 2026