mlsanityData to 7 Oct 2026

AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Control

arXiv 2603.14363 ↗First posted 15 Mar 2026cs.CV cs.AI cs.ROcited by 11

Not on the map. Why?

Abstract (arXiv)

Vision-Language Navigation (VLN) for Unmanned Aerial Vehicles (UAVs) demands complex visual interpretation and continuous control in dynamic 3D environments. Existing hierarchical approaches rely on dense oracle guidance or auxiliary object detectors, creating semantic gaps and limiting genuine autonomy. We propose AerialVLA, a minimalist end-to-end Vision-Language-Action framework mapping raw visual observations and fuzzy linguistic instructions directly to continuous physical control signals. First, we introduce a streamlined dual-view perception strategy that reduces visual redundancy while preserving essential cues for forward navigation and precise grounding, which additionally facilitates future simulation-to-reality transfer. To reclaim genuine autonomy, we deploy a fuzzy directional prompting mechanism derived solely from onboard sensors, completely eliminating the dependency on dense oracle guidance. Ultimately, we formulate a unified control space that integrates continuous 3-Degree-of-Freedom (3-DoF) kinematic commands with an intrinsic landing signal, freeing the agent from external object detectors for precision landing. Extensive experiments on the TravelUAV benchmark demonstrate that AerialVLA achieves state-of-the-art performance in seen environments. Furthermore, it exhibits superior generalization in unseen scenarios by achieving nearly three times the success rate of leading baselines, validating that a minimalist, autonomy-centric paradigm captures more robust visual-motor representations than complex modular systems.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 37 of its 42 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

37 of 42 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  10. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  11. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  12. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
25 more
  1. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  2. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
  3. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  4. 2023ViNT: A Foundation Model for Visual Navigationcited by 210
  5. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 117
  6. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 92
  7. 2025Embodied Navigation Foundation Modelcited by 65
  8. 2022Aerial Vision-and-Dialog Navigationcited by 48
  9. 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
  10. 2024Large Language Models for UAVs: Current State and Pathways to the Futurecited by 33
  11. 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 31
  12. 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 30
  13. 2025UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generationcited by 27
  14. 2025RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviourcited by 22
  15. 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
  16. 2025CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVscited by 21
  17. 2025See, Point, Fly: A Learning-Free VLM Framework for Universal Unmanned Aerial Navigationcited by 18
  18. 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
  19. 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVscited by 13
  20. 2025AeroDuo: Aerial Duo for UAV-based Vision and Language Navigationcited by 13
  21. 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarioscited by 13
  22. 2025OpenVLN: Open-world Aerial Vision-Language Navigationcited by 12
  23. 2025LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integrationcited by 12
  24. 2025Aerial World Model for Long-horizon Visual Generation and Navigation in 3D Spacecited by 11
  25. 2025Is your VLM Sky-Ready? A Comprehensive Spatial Intelligence Benchmark for UAV Navigationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
  2. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
  3. 2026AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimization
  4. 2026AutoFly: Vision-Language-Action Model for UAV Autonomous Navigation in the Wild
  5. 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
  6. 2025Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understanding
  7. 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation
  8. 2025VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environments