RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Intelligent control of Unmanned Aerial Vehicles (UAVs) swarms has emerged as a critical research focus, and it typically requires the swarm to navigate effectively while avoiding obstacles and achieving continuous coverage over multiple mission targets. Although traditional Multi-Agent Reinforcement Learning (MARL) approaches offer dynamic adaptability, they are hindered by the semantic gap in numerical communication and the rigidity of homogeneous role structures, resulting in poor generalization and limited task scalability. Recent advances in Large Language Model (LLM)-based control frameworks demonstrate strong semantic reasoning capabilities by leveraging extensive prior knowledge. However, due to the lack of online learning and over-reliance on static priors, these works often struggle with effective exploration, leading to reduced individual potential and overall system performance. To address these limitations, we propose a Role-Adaptive LLM-Driven Yoked navigation algorithm RALLY. Specifically, we first develop an LLM-driven semantic decision framework that uses structured natural language for efficient semantic communication and collaborative reasoning. Afterward, we introduce a dynamic role-heterogeneity mechanism for adaptive role switching and personalized decision-making. Furthermore, we propose a Role-value Mixing Network (RMIX)-based assignment strategy that integrates LLM offline priors with MARL online policies to enable semi-offline training of role selection strategies. Experiments in the Multi-Agent Particle Environment (MPE) environment and a Software-In-The-Loop (SITL) platform demonstrate that RALLY outperforms conventional approaches in terms of task coverage, convergence speed, and generalization, highlighting its strong potential for collaborative navigation in agentic multi-UAV systems.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 42 of its 65 references that are in the map. First posted on arXiv 2 Jul 2025.
Builds on
42 of 65 references.
References · 42
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024GPT-4o System Cardcited by 4,588
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
30 more
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 708
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
- 2023Cognitive Architectures for Language Agentscited by 429
- 2019QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learningcited by 379
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
- 2018TarMAC: Targeted Multi-Agent Communicationcited by 208
- 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 172
- 2023Simulating Opinion Dynamics with Networks of LLM-based Agentscited by 154
- 2019A Review of Cooperative Multi-Agent Deep Reinforcement Learningcited by 147
- 2024Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignmentcited by 104
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directionscited by 67
- 2024Determinants of LLM-assisted Decision-Makingcited by 56
- 2024Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMscited by 54
- 2023Multi-Agent Consensus Seeking via Large Language Modelscited by 50
- 2024Large Language Models for UAVs: Current State and Pathways to the Futurecited by 33
- 2021Rethinking Modern Communication from Semantic Coding to Semantic Communicationcited by 24
- 2024YOLO-MARL: You Only LLM Once for Multi-Agent Reinforcement Learningcited by 9
- 2022Semantics-Empowered Communication: A Tutorial-cum-Surveycited by 8
- 2019Distillation Strategies for Proximal Policy Optimizationcited by 7
- 2021Relative Distributed Formation and Obstacle Avoidance with Multi-agent Reinforcement Learningcited by 7
- 2024PersLLM: A Personified Training Approach for Large Language Modelscited by 6
- 2023Self-Critical Alternate Learning based Semantic Broadcast Communicationcited by 5
- 2025Separate Source Channel Coding Is Still What You Need: An LLM-based Rethinkingcited by 5
- 2025LLM-Mediated Guidance of MARL Systemscited by 3
- 2014Outdoor flocking and formation flight with autonomous aerial robotscited by 2
- 2025Decentralized Consensus Inference-based Hierarchical Reinforcement Learning for Multi-Constrained UAV Pursuit-Evasion Gamecited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarioscited by 13
- 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorialcited by 4
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networkscited by 2
- 2026Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Methodcited by 1
- 2026Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searchingcited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0
- 2026Managing Context and Communication in Distributed Agentic UAV Swarmscited by 0
- 2026Managing Context and Communication in Distributed Agentic UAV Swarms1 Oct 2026
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems15 Sep 2026
- 2026Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method8 Sep 2026
- 2026Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching1 Sep 2026
- 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorial23 Feb 2026
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networks26 Jan 2026
- 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarios14 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026AeroWeaver: An Embodied-Agent Harness for Weaving Aerial Skills into Distributed, Adaptive Swarm Execution
- 2026LAPF: LLM-Agent-Based Path Finder Using the UAVScenes Dataset
- 2026Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones
- 2026LLM-Centric Agentic AI for UAV Swarms: Architecture, Enabling Technologies, and Open Problems
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Models
- 2026Intelligent Multi-UAV Navigation in ITNTNs: A Hierarchical LLM Approach
- 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility
- 2026α3-Bench: A Unified Benchmark of Safety, Robustness, and Efficiency for LLM-Based UAV Agents over 6G Networks