AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Control
Not on the map. Why?
Abstract (arXiv)
Vision-Language Navigation (VLN) for Unmanned Aerial Vehicles (UAVs) demands complex visual interpretation and continuous control in dynamic 3D environments. Existing hierarchical approaches rely on dense oracle guidance or auxiliary object detectors, creating semantic gaps and limiting genuine autonomy. We propose AerialVLA, a minimalist end-to-end Vision-Language-Action framework mapping raw visual observations and fuzzy linguistic instructions directly to continuous physical control signals. First, we introduce a streamlined dual-view perception strategy that reduces visual redundancy while preserving essential cues for forward navigation and precise grounding, which additionally facilitates future simulation-to-reality transfer. To reclaim genuine autonomy, we deploy a fuzzy directional prompting mechanism derived solely from onboard sensors, completely eliminating the dependency on dense oracle guidance. Ultimately, we formulate a unified control space that integrates continuous 3-Degree-of-Freedom (3-DoF) kinematic commands with an intrinsic landing signal, freeing the agent from external object detectors for precision landing. Extensive experiments on the TravelUAV benchmark demonstrate that AerialVLA achieves state-of-the-art performance in seen environments. Furthermore, it exhibits superior generalization in unseen scenarios by achieving nearly three times the success rate of leading baselines, validating that a minimalist, autonomy-centric paradigm captures more robust visual-motor representations than complex modular systems.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 37 of its 42 references that are in the map. First posted on arXiv 15 Mar 2026.
Builds on
37 of 42 references.
References · 37
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
25 more
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 117
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 92
- 2025Embodied Navigation Foundation Modelcited by 65
- 2022Aerial Vision-and-Dialog Navigationcited by 48
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
- 2024Large Language Models for UAVs: Current State and Pathways to the Futurecited by 33
- 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 31
- 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 30
- 2025UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generationcited by 27
- 2025RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviourcited by 22
- 2025FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Modelscited by 22
- 2025CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVscited by 21
- 2025See, Point, Fly: A Learning-Free VLM Framework for Universal Unmanned Aerial Navigationcited by 18
- 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVscited by 13
- 2025AeroDuo: Aerial Duo for UAV-based Vision and Language Navigationcited by 13
- 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarioscited by 13
- 2025OpenVLN: Open-world Aerial Vision-Language Navigationcited by 12
- 2025LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integrationcited by 12
- 2025Aerial World Model for Long-horizon Visual Generation and Navigation in 3D Spacecited by 11
- 2025Is your VLM Sky-Ready? A Comprehensive Spatial Intelligence Benchmark for UAV Navigationcited by 10
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigationcited by 3
- 2026See-and-Reach: Precise Vision-Language Navigation for UAVs within the Field of Viewcited by 2
- 2026ActiveFly-Bench: Aligning Embodied Question Answering with Vision-Language-Action for Aerial Embodied Perceptioncited by 2
- 2026CoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg Learningcited by 2
- 2026CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Trackingcited by 1
- 2026LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perceptioncited by 0
- 2026RecoverFly: A Failure-Aware Reinforcement Learning Post-Training Framework for Aerial Vision-Language Navigationcited by 0
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigationcited by 0
- 2026Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigationcited by 0
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agentscited by 0
- 2026VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robotscited by 0
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agents16 Sep 2026
- 2026Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigation5 Sep 2026
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation12 Aug 2026
- 2026RecoverFly: A Failure-Aware Reinforcement Learning Post-Training Framework for Aerial Vision-Language Navigation10 Aug 2026
- 2026VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robots7 Aug 2026
- 2026CoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg Learning3 Aug 2026
- 2026CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Tracking16 Jul 2026
- 2026ActiveFly-Bench: Aligning Embodied Question Answering with Vision-Language-Action for Aerial Embodied Perception11 Jul 2026
- 2026See-and-Reach: Precise Vision-Language Navigation for UAVs within the Field of View18 Jun 2026
- 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation26 May 2026
- 2026LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perception27 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
- 2026AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimization
- 2026AutoFly: Vision-Language-Action Model for UAV Autonomous Navigation in the Wild
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
- 2025Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understanding
- 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation
- 2025VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environments