Large Language Models for UAVs: Current State and Pathways to the Future
Not on the map. Why?
Abstract (arXiv)
Unmanned Aerial Vehicles (UAVs) have emerged as a transformative technology across diverse sectors, offering adaptable solutions to complex challenges in both military and civilian domains. Their expanding capabilities present a platform for further advancement by integrating cutting-edge computational tools like Artificial Intelligence (AI) and Machine Learning (ML) algorithms. These advancements have significantly impacted various facets of human life, fostering an era of unparalleled efficiency and convenience. Large Language Models (LLMs), a key component of AI, exhibit remarkable learning and adaptation capabilities within deployed environments, demonstrating an evolving form of intelligence with the potential to approach human-level proficiency. This work explores the significant potential of integrating UAVs and LLMs to propel the development of autonomous systems. We comprehensively review LLM architectures, evaluating their suitability for UAV integration. Additionally, we summarize the state-of-the-art LLM-based UAV architectures and identify novel opportunities for LLM embedding within UAV frameworks. Notably, we focus on leveraging LLMs to refine data analysis and decision-making processes, specifically for enhanced spectral sensing and sharing in UAV applications. Furthermore, we investigate how LLM integration expands the scope of existing UAV applications, enabling autonomous data processing, improved decision-making, and faster response times in emergency scenarios like disaster response and network restoration. Finally, we highlight crucial areas for future research that are critical for facilitating the effective integration of LLMs and UAVs.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Builds on 107 of its 235 references that are in the map. First posted on arXiv 2 May 2024.
Builds on
107 of 235 references.
References · 107
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
38 more
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 650
- 2023A Comprehensive Overview of Large Language Modelscited by 648
- 2023Instruction Tuning for Large Language Models: A Surveycited by 623
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2024Large Language Models: A Surveycited by 525
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
- 2023Augmented Language Models: a Surveycited by 403
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
- 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 302
- 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 274
- 2023A Survey on Model Compression for Large Language Modelscited by 269
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 260
- 2023Challenges and Applications of Large Language Modelscited by 254
- 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 246
- 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
- 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 231
- 2020ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graphcited by 211
- 2019BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysiscited by 176
- 2016Exploring the Limits of Language Modelingcited by 173
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
- 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
- 2023Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunitiescited by 90
- 2021Evaluating the Robustness of Neural Language Models to Input Perturbationscited by 87
- 2023AutoML-GPT: Automatic Machine Learning with GPTcited by 81
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2024A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systemscited by 77
- 2024LLM-based NLG Evaluation: Current Status and Challengescited by 73
50 most cited of 107 All 107 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 24; 2026: 6.
33 papers.
Sort:
By area:
- 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directionscited by 25
- 2024100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instancescited by 24
- 2025Embodied AI: From LLMs to World Modelscited by 24
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVscited by 13
- 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarioscited by 13
- 2025LLM-Enabled In-Context Learning for Data Collection Scheduling in UAV-assisted Sensor Networkscited by 12
- 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Controlcited by 11
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directionscited by 10
- 2025From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAVcited by 10
- 2025Next-Generation LLM for UAV: From Natural Language to Autonomous Flightcited by 10
- 2025Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysiscited by 9
21 more
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Modelscited by 9
- 2025PredictaBoard: Benchmarking LLM Score Predictabilitycited by 7
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarmscited by 7
- 2025Agentic UAVs: LLM-Driven Autonomy with Integrated Tool-Calling and Cognitive Reasoningcited by 7
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agentcited by 4
- 2025FRSICL: LLM-Enabled In-Context Learning Flight Resource Allocation for Fresh Data Collection in UAV-Assisted Wildfire Monitoringcited by 4
- 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorialcited by 4
- 2025Interpretable Risk Mitigation in LLM Agent Systemscited by 3
- 2025A Hierarchical Agentic Framework for Autonomous Drone-Based Visual Inspectioncited by 3
- 2025A4FN: an Agentic AI Architecture for Autonomous Flying Networkscited by 2
- 2025Autonomous Navigation of Cloud-Controlled Quadcopters in Confined Spaces Using Multi-Modal Perception and LLM-Driven High Semantic Reasoningcited by 1
- 2025AIC-VDS: Attention-Based In-Context Learning for Joint Velocity Control and Data Collection Scheduling in Multi-UAV-Assisted Pipeline Monitoringcited by 1
- 2025Human-Inspired Neuro-Symbolic World Modeling and Logic Reasoning for Interpretable Safe UAV Landing Site Assessmentcited by 1
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Modelscited by 1
- 2025Semantic-Aware Edge Intelligence for UAV Handover in 6G Networkscited by 0
- 2025Large Multimodal Models-Empowered Task-Oriented Autonomous Communications: Design Methodology and Implementation Challengescited by 0
- 2025PrivLLMSwarm: Privacy-Preserving LLM-Driven UAV Swarms for Secure IoT Surveillancecited by 0
- 2026Bridging Network Fragmentation: A Semantic-Augmented DRL Framework for UAV-aided VANETscited by 0
- 2026SeaAlert: Robust Severity Classification and LLM-Based Information Extraction for Noisy Maritime Distress Communicationscited by 0
- 2026From Particles to Perils: SVGD-Based Hazardous Scenario Generation for Autonomous Driving Systems Testingcited by 0
- 2026PhysAI-Bench: A Benchmark for LLM-Based Agentic Decision-Making in Autonomous UAV-Centric Physical AIcited by 0
- 2026PhysAI-Bench: A Benchmark for LLM-Based Agentic Decision-Making in Autonomous UAV-Centric Physical AI20 Sep 2026
- 2026From Particles to Perils: SVGD-Based Hazardous Scenario Generation for Autonomous Driving Systems Testing20 Apr 2026
- 2026SeaAlert: Robust Severity Classification and LLM-Based Information Extraction for Noisy Maritime Distress Communications23 Mar 2026
- 2026Bridging Network Fragmentation: A Semantic-Augmented DRL Framework for UAV-aided VANETs19 Mar 2026
- 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Control15 Mar 2026
- 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorial23 Feb 2026
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Models9 Dec 2025
- 2025PrivLLMSwarm: Privacy-Preserving LLM-Driven UAV Swarms for Secure IoT Surveillance7 Dec 2025
- 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarios14 Nov 2025
- 2025Human-Inspired Neuro-Symbolic World Modeling and Logic Reasoning for Interpretable Safe UAV Landing Site Assessment25 Oct 2025
- 2025Large Multimodal Models-Empowered Task-Oriented Autonomous Communications: Design Methodology and Implementation Challenges23 Oct 2025
- 2025AIC-VDS: Attention-Based In-Context Learning for Joint Velocity Control and Data Collection Scheduling in Multi-UAV-Assisted Pipeline Monitoring7 Oct 2025
21 more
- 2025A4FN: an Agentic AI Architecture for Autonomous Flying Networks4 Oct 2025
- 2025Next-Generation LLM for UAV: From Natural Language to Autonomous Flight2 Oct 2025
- 2025A Hierarchical Agentic Framework for Autonomous Drone-Based Visual Inspection30 Sep 2025
- 2025Embodied AI: From LLMs to World Models24 Sep 2025
- 2025Agentic UAVs: LLM-Driven Autonomy with Integrated Tool-Calling and Cognitive Reasoning14 Sep 2025
- 2025Semantic-Aware Edge Intelligence for UAV Handover in 6G Networks7 Sep 2025
- 2025Autonomous Navigation of Cloud-Controlled Quadcopters in Confined Spaces Using Multi-Modal Perception and LLM-Driven High Semantic Reasoning11 Aug 2025
- 2025FRSICL: LLM-Enabled In-Context Learning Flight Resource Allocation for Fresh Data Collection in UAV-Assisted Wildfire Monitoring14 Jul 2025
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms2 Jul 2025
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agent9 Jun 2025
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVs8 Jun 2025
- 2025From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAV3 Jun 2025
- 2025Interpretable Risk Mitigation in LLM Agent Systems15 May 2025
- 2025LLM-Enabled In-Context Learning for Data Collection Scheduling in UAV-assisted Sensor Networks20 Apr 2025
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Models11 Mar 2025
- 2025Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysis5 Mar 2025
- 2025PredictaBoard: Benchmarking LLM Score Predictability20 Feb 2025
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions8 Jan 2025
- 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directions16 Dec 2024
- 2024100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instances5 Sep 2024
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directions5 Jul 2024
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVscited by 13
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Modelscited by 9
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarmscited by 7
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agentcited by 4
- 2025Interpretable Risk Mitigation in LLM Agent Systemscited by 3
- 2025A Hierarchical Agentic Framework for Autonomous Drone-Based Visual Inspectioncited by 3
- 2025A4FN: an Agentic AI Architecture for Autonomous Flying Networkscited by 2
- 2026PhysAI-Bench: A Benchmark for LLM-Based Agentic Decision-Making in Autonomous UAV-Centric Physical AIcited by 0
- 2026PhysAI-Bench: A Benchmark for LLM-Based Agentic Decision-Making in Autonomous UAV-Centric Physical AI20 Sep 2026
- 2025A4FN: an Agentic AI Architecture for Autonomous Flying Networks4 Oct 2025
- 2025A Hierarchical Agentic Framework for Autonomous Drone-Based Visual Inspection30 Sep 2025
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms2 Jul 2025
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agent9 Jun 2025
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVs8 Jun 2025
- 2025Interpretable Risk Mitigation in LLM Agent Systems15 May 2025
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Models11 Mar 2025
- 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directionscited by 25
- 2024100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instancescited by 24
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2025LLM-Enabled In-Context Learning for Data Collection Scheduling in UAV-assisted Sensor Networkscited by 12
- 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Controlcited by 11
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directionscited by 10
- 2025From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAVcited by 10
- 2025Next-Generation LLM for UAV: From Natural Language to Autonomous Flightcited by 10
- 2025Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysiscited by 9
- 2025PredictaBoard: Benchmarking LLM Score Predictabilitycited by 7
- 2025FRSICL: LLM-Enabled In-Context Learning Flight Resource Allocation for Fresh Data Collection in UAV-Assisted Wildfire Monitoringcited by 4
- 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorialcited by 4
12 most cited of 19 All 19 (JSON)
- 2026SeaAlert: Robust Severity Classification and LLM-Based Information Extraction for Noisy Maritime Distress Communications23 Mar 2026
- 2026Bridging Network Fragmentation: A Semantic-Augmented DRL Framework for UAV-aided VANETs19 Mar 2026
- 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Control15 Mar 2026
- 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorial23 Feb 2026
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Models9 Dec 2025
- 2025PrivLLMSwarm: Privacy-Preserving LLM-Driven UAV Swarms for Secure IoT Surveillance7 Dec 2025
- 2025AIC-VDS: Attention-Based In-Context Learning for Joint Velocity Control and Data Collection Scheduling in Multi-UAV-Assisted Pipeline Monitoring7 Oct 2025
- 2025Next-Generation LLM for UAV: From Natural Language to Autonomous Flight2 Oct 2025
- 2025Semantic-Aware Edge Intelligence for UAV Handover in 6G Networks7 Sep 2025
- 2025Autonomous Navigation of Cloud-Controlled Quadcopters in Confined Spaces Using Multi-Modal Perception and LLM-Driven High Semantic Reasoning11 Aug 2025
- 2025FRSICL: LLM-Enabled In-Context Learning Flight Resource Allocation for Fresh Data Collection in UAV-Assisted Wildfire Monitoring14 Jul 2025
- 2025From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAV3 Jun 2025
12 newest of 19 All 19 (JSON)