mlsanityData to 14 Oct 2026

Large Language Models for UAVs: Current State and Pathways to the Future

arXiv 2405.01745 ↗First posted 2 May 2024cs.AI cs.LG cs.ROcited by 33

Not on the map. Why?

Abstract (arXiv)

Unmanned Aerial Vehicles (UAVs) have emerged as a transformative technology across diverse sectors, offering adaptable solutions to complex challenges in both military and civilian domains. Their expanding capabilities present a platform for further advancement by integrating cutting-edge computational tools like Artificial Intelligence (AI) and Machine Learning (ML) algorithms. These advancements have significantly impacted various facets of human life, fostering an era of unparalleled efficiency and convenience. Large Language Models (LLMs), a key component of AI, exhibit remarkable learning and adaptation capabilities within deployed environments, demonstrating an evolving form of intelligence with the potential to approach human-level proficiency. This work explores the significant potential of integrating UAVs and LLMs to propel the development of autonomous systems. We comprehensively review LLM architectures, evaluating their suitability for UAV integration. Additionally, we summarize the state-of-the-art LLM-based UAV architectures and identify novel opportunities for LLM embedding within UAV frameworks. Notably, we focus on leveraging LLMs to refine data analysis and decision-making processes, specifically for enhanced spectral sensing and sharing in UAV applications. Furthermore, we investigate how LLM integration expands the scope of existing UAV applications, enabling autonomous data processing, improved decision-making, and faster response times in emergency scenarios like disaster response and network restoration. Finally, we highlight crucial areas for future research that are critical for facilitating the effective integration of LLMs and UAVs.

Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Builds on 107 of its 235 references that are in the map. First posted on arXiv 2 May 2024.

Builds on

107 of 235 references.

References · 107

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  9. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  10. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  11. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  12. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
38 more
  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  2. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  3. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  4. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  5. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  6. 2023A Survey on Multimodal Large Language Modelscited by 909
  7. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  8. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  9. 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 650
  10. 2023A Comprehensive Overview of Large Language Modelscited by 648
  11. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  12. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
  13. 2024Large Language Models: A Surveycited by 525
  14. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
  15. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
  16. 2023Augmented Language Models: a Surveycited by 403
  17. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
  18. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
  19. 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 302
  20. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 274
  21. 2023A Survey on Model Compression for Large Language Modelscited by 269
  22. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 260
  23. 2023Challenges and Applications of Large Language Modelscited by 254
  24. 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 246
  25. 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
  26. 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 231
  27. 2020ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graphcited by 211
  28. 2019BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysiscited by 176
  29. 2016Exploring the Limits of Language Modelingcited by 173
  30. 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
  31. 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
  32. 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
  33. 2023Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunitiescited by 90
  34. 2021Evaluating the Robustness of Neural Language Models to Input Perturbationscited by 87
  35. 2023AutoML-GPT: Automatic Machine Learning with GPTcited by 81
  36. 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
  37. 2024A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systemscited by 77
  38. 2024LLM-based NLG Evaluation: Current Status and Challengescited by 73

50 most cited of 107 All 107 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 24; 2026: 6.

33 papers.

Sort:

By area:

  1. 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directionscited by 25
  2. 2024100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instancescited by 24
  3. 2025Embodied AI: From LLMs to World Modelscited by 24
  4. 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
  5. 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVscited by 13
  6. 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarioscited by 13
  7. 2025LLM-Enabled In-Context Learning for Data Collection Scheduling in UAV-assisted Sensor Networkscited by 12
  8. 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Controlcited by 11
  9. 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directionscited by 10
  10. 2025From Prompts to Protection: Large Language Model-Enabled In-Context Learning for Smart Public Safety UAVcited by 10
  11. 2025Next-Generation LLM for UAV: From Natural Language to Autonomous Flightcited by 10
  12. 2025Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysiscited by 9
21 more
  1. 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Modelscited by 9
  2. 2025PredictaBoard: Benchmarking LLM Score Predictabilitycited by 7
  3. 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarmscited by 7
  4. 2025Agentic UAVs: LLM-Driven Autonomy with Integrated Tool-Calling and Cognitive Reasoningcited by 7
  5. 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agentcited by 4
  6. 2025FRSICL: LLM-Enabled In-Context Learning Flight Resource Allocation for Fresh Data Collection in UAV-Assisted Wildfire Monitoringcited by 4
  7. 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorialcited by 4
  8. 2025Interpretable Risk Mitigation in LLM Agent Systemscited by 3
  9. 2025A Hierarchical Agentic Framework for Autonomous Drone-Based Visual Inspectioncited by 3
  10. 2025A4FN: an Agentic AI Architecture for Autonomous Flying Networkscited by 2
  11. 2025Autonomous Navigation of Cloud-Controlled Quadcopters in Confined Spaces Using Multi-Modal Perception and LLM-Driven High Semantic Reasoningcited by 1
  12. 2025AIC-VDS: Attention-Based In-Context Learning for Joint Velocity Control and Data Collection Scheduling in Multi-UAV-Assisted Pipeline Monitoringcited by 1
  13. 2025Human-Inspired Neuro-Symbolic World Modeling and Logic Reasoning for Interpretable Safe UAV Landing Site Assessmentcited by 1
  14. 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Modelscited by 1
  15. 2025Semantic-Aware Edge Intelligence for UAV Handover in 6G Networkscited by 0
  16. 2025Large Multimodal Models-Empowered Task-Oriented Autonomous Communications: Design Methodology and Implementation Challengescited by 0
  17. 2025PrivLLMSwarm: Privacy-Preserving LLM-Driven UAV Swarms for Secure IoT Surveillancecited by 0
  18. 2026Bridging Network Fragmentation: A Semantic-Augmented DRL Framework for UAV-aided VANETscited by 0
  19. 2026SeaAlert: Robust Severity Classification and LLM-Based Information Extraction for Noisy Maritime Distress Communicationscited by 0
  20. 2026From Particles to Perils: SVGD-Based Hazardous Scenario Generation for Autonomous Driving Systems Testingcited by 0
  21. 2026PhysAI-Bench: A Benchmark for LLM-Based Agentic Decision-Making in Autonomous UAV-Centric Physical AIcited by 0