IndoorUAV: Benchmarking Vision-Language UAV Navigation in Continuous Indoor Environments
Not on the map. Why?
Abstract (arXiv)
Vision-Language Navigation (VLN) enables agents to navigate in complex environments by following natural language instructions grounded in visual observations. Although most existing work has focused on ground-based robots or outdoor Unmanned Aerial Vehicles (UAVs), indoor UAV-based VLN remains underexplored, despite its relevance to real-world applications such as inspection, delivery, and search-and-rescue in confined spaces. To bridge this gap, we introduce IndoorUAV, a novel benchmark and method specifically tailored for VLN with indoor UAVs. We begin by curating over 1,000 diverse and structurally rich 3D indoor scenes from the Habitat simulator. Within these environments, we simulate realistic UAV flight dynamics to collect diverse 3D navigation trajectories manually, further enriched through data augmentation techniques. Furthermore, we design an automated annotation pipeline to generate natural language instructions of varying granularity for each trajectory. This process yields over 16,000 high-quality trajectories, comprising the IndoorUAV-VLN subset, which focuses on long-horizon VLN. To support short-horizon planning, we segment long trajectories into sub-trajectories by selecting semantically salient keyframes and regenerating concise instructions, forming the IndoorUAV-VLA subset. Finally, we introduce IndoorUAV-Agent, a novel navigation model designed for our benchmark, leveraging task decomposition and multimodal reasoning. We hope IndoorUAV serves as a valuable resource to advance research on vision-language embodied AI in the indoor aerial navigation domain.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
19 of 24 references.
References · 19
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2019Vision-and-Dialog Navigationcited by 250
- 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 239
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 119
- 2019General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warpingcited by 105
7 more
- 2021Structured Scene Memory for Vision-Language Navigationcited by 95
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2020Evolving Graphical Planner: Contextual Global Planning for Vision-and-Language Navigationcited by 71
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 67
- 2025UAV-Flow Colosseo: A Real-World Benchmark for Flying-on-a-Word UAV Imitation Learningcited by 31
- 2024RoomTour3D: Geometry-Aware Video-Instruction Tuning for Embodied Navigationcited by 23
- 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligencecited by 6
- 2026UAV-Track VLA: Embodied Aerial Tracking via Vision-Language-Action Modelscited by 4
- 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescuecited by 4
- 2026ActiveFly-Bench: Aligning Embodied Question Answering with Vision-Language-Action for Aerial Embodied Perceptioncited by 2
- 2026Position: Embodied AI Requires a Privacy-Utility Trade-offcited by 1
- 2026CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Trackingcited by 1
- 2026AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimizationcited by 1
- 2026NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigationcited by 1
- 2026AION: Aerial Indoor Object-Goal Navigation Using Dual-Policy Reinforcement Learningcited by 0
- 2026Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigationcited by 0
- 2026NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigation25 Sep 2026
- 2026Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigation5 Sep 2026
- 2026AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimization2 Aug 2026
- 2026CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Tracking16 Jul 2026
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence14 Jul 2026
- 2026ActiveFly-Bench: Aligning Embodied Question Answering with Vision-Language-Action for Aerial Embodied Perception11 Jul 2026
- 2026Position: Embodied AI Requires a Privacy-Utility Trade-off6 May 2026
- 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescue2 May 2026
- 2026UAV-Track VLA: Embodied Aerial Tracking via Vision-Language-Action Models2 Apr 2026
- 2026AION: Aerial Indoor Object-Goal Navigation Using Dual-Policy Reinforcement Learning22 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
- 2026AirNav: A Large-Scale UAV Vision-and-Language Navigation Dataset with Natural and Diverse Instructions
- 2026CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigation
- 2025OpenVLN: Open-world Aerial Vision-Language Navigation
- 2026HUGE-Bench: A Benchmark for High-Level UAV Vision-Language-Action Tasks
- 2026SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagery