# Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap

arXiv: https://arxiv.org/abs/2604.13654 · HTML: https://mlsanity.com/paper/2604.13654/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Placed in Aerial and drone VLA, one of 13 directions in Vision-language-action models.
- First posted on arXiv 15 Apr 2026.

## Placed in

- Vision-language-action models / [Aerial and drone VLA](https://mlsanity.com/vla/aerial-and-drone-vla/)

## Built on by (most cited first, 5 of 5)

- [CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Tracking](https://mlsanity.com/paper/2607.15004/) (2026)
- [AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimization](https://mlsanity.com/paper/2608.07557/) (2026)
- [Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Maps](https://mlsanity.com/paper/2609.03483/) (2026)
- [Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching](https://mlsanity.com/paper/2609.01404/) (2026)
- [ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigation](https://mlsanity.com/paper/2609.33581/) (2026)

## Abstract (arXiv)

Vision-and-Language Navigation for Unmanned Aerial Vehicles (UAV-VLN) represents a pivotal challenge in embodied artificial intelligence, focused on enabling UAVs to interpret high-level human commands and execute long-horizon tasks in complex 3D environments. This paper provides a comprehensive and structured survey of the field, from its formal task definition to the current state of the art. We establish a methodological taxonomy that charts the technological evolution from early modular and deep learning approaches to contemporary agentic systems driven by large foundation models, including Vision-Language Models (VLMs), Vision-Language-Action (VLA) models, and the emerging integration of generative world models with VLA architectures for physically-grounded reasoning. The survey systematically reviews the ecosystem of essential resources simulators, datasets, and evaluation metrics that facilitates standardized research. Furthermore, we conduct a critical analysis of the primary challenges impeding real-world deployment: the simulation-to-reality gap, robust perception in dynamic outdoor settings, reasoning with linguistic ambiguity, and the efficient deployment of large models on resource-constrained hardware. By synthesizing current benchmarks and limitations, this survey concludes by proposing a forward-looking research roadmap to guide future inquiry into key frontiers such as multi-agent swarm coordination and air-ground collaborative robotics.
