An LLM-based Framework for Human-Swarm Teaming Cognition in Disaster Search and Rescue
Not on the map. Why?
Abstract (arXiv)
Large-scale disaster Search And Rescue (SAR) operations are persistently challenged by complex terrain and disrupted communications. While Unmanned Aerial Vehicle (UAV) swarms offer a promising solution for tasks like wide-area search and supply delivery, yet their effective coordination places a significant cognitive burden on human operators. The core human-machine collaboration bottleneck lies in the ``intention-to-action gap'', which is an error-prone process of translating a high-level rescue objective into a low-level swarm command under high intensity and pressure. To bridge this gap, this study proposes a novel LLM-CRF system that leverages Large Language Models (LLMs) to model and augment human-swarm teaming cognition. The proposed framework initially captures the operator's intention through natural and multi-modal interactions with the device via voice or graphical annotations. It then employs the LLM as a cognitive engine to perform intention comprehension, hierarchical task decomposition, and mission planning for the UAV swarm. This closed-loop framework enables the swarm to act as a proactive partner, providing active feedback in real-time while reducing the need for manual monitoring and control, which considerably advances the efficacy of the SAR task. We evaluate the proposed framework in a simulated SAR scenario. Experimental results demonstrate that, compared to traditional order and command-based interfaces, the proposed LLM-driven approach reduced task completion time by approximately 64.2% and improved task success rate by 7%. It also leads to a considerable reduction in subjective cognitive workload, with NASA-TLX scores dropping by 42.9%. This work establishes the potential of LLMs to create more intuitive and effective human-swarm collaborations in high-stakes scenarios.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 45 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
25 of 45 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Visual Instruction Tuningcited by 7,792
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2023Qwen Technical Reportcited by 3,273
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
13 more
- 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
- 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 296
- 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 293
- 2024Multi-Modal Hallucination Control by Visual Information Groundingcited by 196
- 2020Human Action Recognition from Various Data Modalities: A Reviewcited by 162
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
- 2021UAV-Human: A Large Benchmark for Human Behavior Understanding with Unmanned Aerial Vehiclescited by 95
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Trackingcited by 26
- 2024A comprehensive survey of research towards AI-enabled unmanned aerial systems in pre-, active-, and post-wildfire managementcited by 23
- 2023InsPLAD: A Dataset and Benchmark for Power Line Asset Inspection in UAV Imagescited by 15
- 2023A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMscited by 13
- 2021Safety-enhanced UAV Path Planning with Spherical Vector-based Particle Swarm Optimizationcited by 9
- 2025Fusion Meets Diverse Conditions: A High-diversity Benchmark and Baseline for UAV-based Multimodal Object Detection with Condition Cuescited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.