mlsanityData to 14 Oct 2026

Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning

arXiv 2512.08639 ↗First posted 9 Dec 2025cs.CV cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Aerial Vision-and-Language Navigation (VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and navigate complex urban environments using onboard visual observation. This task holds promise for real-world applications such as low-altitude inspection, search-and-rescue, and autonomous aerial delivery. Existing methods often rely on panoramic images, depth inputs, or odometry to support spatial reasoning and action planning. These requirements increase system cost and integration complexity, thus hindering practical deployment for lightweight UAVs. We present a unified aerial VLN framework that operates solely on egocentric monocular RGB observations and natural language instructions. The model formulates navigation as a next-token prediction problem, jointly optimizing spatial perception, trajectory reasoning, and action prediction through prompt-guided multi-task learning. Moreover, we propose a keyframe selection strategy to reduce visual redundancy by retaining semantically informative frames, along with an action merging and label reweighting mechanism that mitigates long-tailed supervision imbalance and facilitates stable multi-task co-training. Extensive experiments on the AerialVLN and OpenFly benchmark validate the effectiveness of our method. Under the challenging monocular RGB-only setting, our model achieves strong results across both seen and unseen environments. It significantly outperforms existing RGB-only baselines and narrows the performance gap with state-of-the-art panoramic RGB-D counterparts. Comprehensive ablation studies further demonstrate the contribution of our task design and architectural choices. Our code is publicly available at https://github.com/return-sleep/AeroAct.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 34 of its 58 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

34 of 58 references.

References · 34

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  3. 2024Qwen2 Technical Reportcited by 2,120
  4. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
  5. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  6. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  7. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  8. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
  9. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
  10. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  11. 2024NVILA: Efficient Frontier Visual Language Modelscited by 209
  12. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
22 more
  1. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  2. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  3. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
  4. 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
  5. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
  6. 2024MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigationcited by 86
  7. 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
  8. 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
  9. 2022Aerial Vision-and-Dialog Navigationcited by 49
  10. 2024Back to Newton's Laws: Learning Vision-based Agile Flight via Differentiable Physicscited by 45
  11. 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 42
  12. 2021Vision-Language Navigation: A Survey and Taxonomycited by 34
  13. 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 33
  14. 2025CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Spacecited by 32
  15. 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 32
  16. 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
  17. 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigationcited by 20
  18. 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 16
  19. 2025AeroDuo: Aerial Duo for UAV-based Vision and Language Navigationcited by 13
  20. 2025Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Constructioncited by 12
  21. 2025NavComposer: Composing Language Instructions for Navigation Trajectories through Action-Scene-Object Modularizationcited by 5
  22. 2022Reactive Navigation of an Unmanned Aerial Vehicle with Perception-based Obstacle Avoidance Constraintscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
  2. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
  3. 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
  4. 2026ViSA-Enhanced Aerial VLN: A Visual-Spatial Reasoning Enhanced Framework for Aerial Vision-Language Navigation
  5. 2025OpenVLN: Open-world Aerial Vision-Language Navigation
  6. 2026LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigation
  7. 2026AutoFly: Vision-Language-Action Model for UAV Autonomous Navigation in the Wild
  8. 2026CLOSER-VLN: Closed-Loop Self-Verified Retrieval-Augmented Reasoning for Aerial Vision-Language Navigation