AirNav: A Large-Scale UAV Vision-and-Language Navigation Dataset with Natural and Diverse Instructions
Not on the map. Why?
Abstract (arXiv)
Existing UAV vision-and-language navigation (VLN) benchmarks rarely provide realistic aerial scenes, natural process-level instructions, and sufficient scale simultaneously, making it difficult to systematically train and evaluate UAV VLN agents under realistic settings. To address this, we propose AirNav, a large-scale benchmark built on real urban aerial data, comprising 137K navigation samples with natural and diverse instructions generated via a human--LLM collaborative pipeline with 10 user personas. We conduct a systematic evaluation of representative approaches on AirNav, ranging from traditional models to multimodal large language models (MLLMs), under unified metrics with open-source implementations. We further propose AirVLN-R1, trained via supervised fine-tuning (SFT) and reinforcement fine-tuning (RFT), achieving state-of-the-art performance with a 51.82% success rate on the test-unseen split. Real-world experiments on a physical UAV platform provide preliminary evidence of sim-to-real transferability, and our dataset and code are publicly available.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
12 of 21 references.
References · 12
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 119
- 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2022SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Cloudscited by 50
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
- 2023CityRefer: Geography-aware 3D Visual Grounding Dataset on City-scale Point Cloud Datacited by 18
- 2024Generating Content for HDR Deghosting from Frequency Viewcited by 14
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Fly0: Persistent Metric Anchoring for Zero-Shot Aerial Vision-Language Navigationcited by 4
- 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescuecited by 4
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networkscited by 2
- 2026CoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg Learningcited by 2
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigationcited by 1
- 2026SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagerycited by 0
- 2026WareFly-VLA: A Vision-Language-Action Framework for UAV Navigation and Human Tracking in Smart Warehousescited by 0
- 2026WareFly-VLA: A Vision-Language-Action Framework for UAV Navigation and Human Tracking in Smart Warehouses6 Oct 2026
- 2026SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagery25 Sep 2026
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation12 Aug 2026
- 2026CoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg Learning3 Aug 2026
- 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescue2 May 2026
- 2026Fly0: Persistent Metric Anchoring for Zero-Shot Aerial Vision-Language Navigation2 Feb 2026
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networks26 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
- 2025IndoorUAV: Benchmarking Vision-Language UAV Navigation in Continuous Indoor Environments
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
- 2025OpenVLN: Open-world Aerial Vision-Language Navigation
- 2025AeroDuo: Aerial Duo for UAV-based Vision and Language Navigation
- 2026UAVBench and UAVIT-1M: Benchmarking and Enhancing MLLMs for Low-Altitude UAV Vision-Language Understanding