Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorial
Not on the map. Why?
Abstract (arXiv)
Uncrewed Aerial Vehicles (UAVs) are widely deployed across diverse applications due to their mobility and agility. Recent advances in Large Language Models (LLMs) offer a transformative opportunity to enhance UAV intelligence beyond conventional optimization-based and learning-based approaches. By integrating LLMs into UAV systems, advanced environmental understanding, swarm coordination, mobility optimization, and high-level task reasoning can be achieved, thereby allowing more adaptive and context-aware aerial operations. This survey systematically explores the intersection of LLMs and UAV technologies and proposes a unified framework that consolidates existing architectures, methodologies, and applications for UAVs. We first present a structured taxonomy of LLM adaptation techniques for UAVs, including pretraining, fine-tuning, Retrieval-Augmented Generation (RAG), and prompt engineering, along with key reasoning capabilities such as Chain-of-Thought (CoT) and In-Context Learning (ICL). We then examine LLM-assisted UAV communications and operations, covering navigation, mission planning, swarm control, safety, autonomy, and network management. After that, the survey further discusses Multimodal LLMs (MLLMs) for human-swarm interaction, perception-driven navigation, and collaborative control. Finally, we address ethical considerations, including bias, transparency, accountability, and Human-in-the-Loop (HITL) strategies, and outline future research directions. Overall, this work positions LLM-assisted UAVs as a foundation for intelligent and adaptive aerial systems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 66 of its 133 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
66 of 133 references.
References · 66
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2023Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessmentcited by 227
- 2023Compressing Context to Enhance Inference Efficiency of Large Language Modelscited by 185
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 176
38 more
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 117
- 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 92
- 2023Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunitiescited by 89
- 2024The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunitiescited by 63
- 2024RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generationcited by 59
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 37
- 2024Large Language Models for UAVs: Current State and Pathways to the Futurecited by 33
- 2022Machine Learning-Aided Operations and Communications of Unmanned Aerial Vehicles: A Contemporary Surveycited by 27
- 2025UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generationcited by 27
- 2023TypeFly: Flying Drones with Large Language Modelcited by 23
- 2023How Powerful are Decoder-Only Transformer Neural Models?cited by 20
- 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoningcited by 19
- 2025Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understandingcited by 17
- 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
- 2024Large Language Model Based Multi-Objective Optimization for Integrated Sensing and Communications in UAV Networkscited by 13
- 2025AeroDuo: Aerial Duo for UAV-based Vision and Language Navigationcited by 13
- 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarioscited by 13
- 2024FlockGPT: Guiding UAV Flocking with Linguistic Orchestrationcited by 12
- 2024Large Language Models for Wireless Networks: An Overview from the Prompt Engineering Perspectivecited by 12
- 2025LLM-Enabled In-Context Learning for Data Collection Scheduling in UAV-assisted Sensor Networkscited by 12
- 2019On-board Deep Q-Network for UAV-assisted Online Power Transfer and Data Collectioncited by 11
- 2025Unveiling Environmental Impacts of Large Language Model Serving: A Functional Unit Viewcited by 11
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVscited by 11
- 2025Air-Ground Collaboration for Language-Specified Missions in Unknown Environmentscited by 11
- 2025Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestrationcited by 11
- 2025Next-Generation LLM for UAV: From Natural Language to Autonomous Flightcited by 10
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Modelscited by 9
- 2025From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAVcited by 8
- 2025LLM-Land: Large Language Models for Context-Aware Drone Landingcited by 7
- 2025Multimodal Large Language Models-Enabled UAV Swarm: Towards Efficient and Intelligent Autonomous Aerial Systemscited by 7
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarmscited by 7
- 2024A Study of Optimizations for Fine-tuning Large Language Modelscited by 6
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunitiescited by 6
- 2025UAV-VLRR: Vision-Language Informed NMPC for Rapid Response in UAV Search and Rescuecited by 6
- 2023Deep Reinforcement Learning for Joint Cruise Control and Intelligent Data Acquisition in UAVs-Assisted Sensor Networkscited by 5
- 2025Aero-LLM: A Distributed Framework for Secure UAV Communication and Intelligent Decision-Makingcited by 5
- 2025Hierarchical and Collaborative LLM-Based Control for Multi-UAV Motion and Communication in Integrated Terrestrial and Non-Terrestrial Networkscited by 5
- 2025Be My Eyes: Extending Large Language Models to New Modalities Through Multi-Agent Collaborationcited by 5
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligencecited by 6
- 2026Hierarchical LLM-Driven Control for HAPS-Assisted UAV Networks: Joint Optimization of Flight and Connectivitycited by 0
- 2026RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Controlcited by 0
- 2026LAPF: LLM-Agent-Based Path Finder Using the UAVScenes Datasetcited by 0
- 2026LAPF: LLM-Agent-Based Path Finder Using the UAVScenes Dataset15 Aug 2026
- 2026RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Control20 Jul 2026
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence14 Jul 2026
- 2026Hierarchical LLM-Driven Control for HAPS-Assisted UAV Networks: Joint Optimization of Flight and Connectivity12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility
- 2025Large Language Model-Driven Closed-Loop UAV Operation with Semantic Observations
- 2026α3-Bench: A Unified Benchmark of Safety, Robustness, and Efficiency for LLM-Based UAV Agents over 6G Networks
- 2025When Large Language Models Meet UAV Projects: An Empirical Study from Developers' Perspective
- 2025Efficient Onboard Vision-Language Inference in UAV-Enabled Low-Altitude Economy Networks via LLM-Enhanced Optimization
- 2026Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones
- 2026Intelligent Multi-UAV Navigation in ITNTNs: A Hierarchical LLM Approach
- 2026Ro-SLM: Onboard Small Language Models for Robot Task Planning and Operation Code Generation