Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
Not on the map. Why?
Abstract (arXiv)
Aerial Vision-and-Language Navigation (VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and navigate complex urban environments using onboard visual observation. This task holds promise for real-world applications such as low-altitude inspection, search-and-rescue, and autonomous aerial delivery. Existing methods often rely on panoramic images, depth inputs, or odometry to support spatial reasoning and action planning. These requirements increase system cost and integration complexity, thus hindering practical deployment for lightweight UAVs. We present a unified aerial VLN framework that operates solely on egocentric monocular RGB observations and natural language instructions. The model formulates navigation as a next-token prediction problem, jointly optimizing spatial perception, trajectory reasoning, and action prediction through prompt-guided multi-task learning. Moreover, we propose a keyframe selection strategy to reduce visual redundancy by retaining semantically informative frames, along with an action merging and label reweighting mechanism that mitigates long-tailed supervision imbalance and facilitates stable multi-task co-training. Extensive experiments on the AerialVLN and OpenFly benchmark validate the effectiveness of our method. Under the challenging monocular RGB-only setting, our model achieves strong results across both seen and unseen environments. It significantly outperforms existing RGB-only baselines and narrows the performance gap with state-of-the-art panoramic RGB-D counterparts. Comprehensive ablation studies further demonstrate the contribution of our task design and architectural choices. Our code is publicly available at https://github.com/return-sleep/AeroAct.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 34 of its 58 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
34 of 58 references.
References · 34
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2024Qwen2 Technical Reportcited by 2,120
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 209
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
22 more
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2024MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigationcited by 86
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
- 2022Aerial Vision-and-Dialog Navigationcited by 49
- 2024Back to Newton's Laws: Learning Vision-based Agile Flight via Differentiable Physicscited by 45
- 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 42
- 2021Vision-Language Navigation: A Survey and Taxonomycited by 34
- 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 33
- 2025CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Spacecited by 32
- 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 32
- 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
- 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigationcited by 20
- 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 16
- 2025AeroDuo: Aerial Duo for UAV-based Vision and Language Navigationcited by 13
- 2025Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Constructioncited by 12
- 2025NavComposer: Composing Language Instructions for Navigation Trajectories through Action-Scene-Object Modularizationcited by 5
- 2022Reactive Navigation of an Unmanned Aerial Vehicle with Perception-based Obstacle Avoidance Constraintscited by 2
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligencecited by 6
- 2026Fly0: Persistent Metric Anchoring for Zero-Shot Aerial Vision-Language Navigationcited by 4
- 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescuecited by 4
- 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMscited by 2
- 2026SpatialFly: Implicit 3D Prior-Guided Visual Reparameterization for Continuous UAV Vision-and-Language Navigationcited by 1
- 2026A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigationcited by 1
- 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigationcited by 0
- 2026LightVLN: Efficient Aerial Vision-and-Language Navigation with Compact Memory and History-Guided Local Aggregationcited by 0
- 2026LightVLN: Efficient Aerial Vision-and-Language Navigation with Compact Memory and History-Guided Local Aggregation4 Oct 2026
- 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigation27 Sep 2026
- 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs17 Jul 2026
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence14 Jul 2026
- 2026A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation9 Jul 2026
- 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescue2 May 2026
- 2026SpatialFly: Implicit 3D Prior-Guided Visual Reparameterization for Continuous UAV Vision-and-Language Navigation22 Mar 2026
- 2026Fly0: Persistent Metric Anchoring for Zero-Shot Aerial Vision-Language Navigation2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2026ViSA-Enhanced Aerial VLN: A Visual-Spatial Reasoning Enhanced Framework for Aerial Vision-Language Navigation
- 2025OpenVLN: Open-world Aerial Vision-Language Navigation
- 2026LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigation
- 2026AutoFly: Vision-Language-Action Model for UAV Autonomous Navigation in the Wild
- 2026CLOSER-VLN: Closed-Loop Self-Verified Retrieval-Augmented Reasoning for Aerial Vision-Language Navigation