An LLM-Agnostic, MAVLink-Based Drone Command and Control Interface and Agentic Harness Using the Model Context Protocol
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Artificial intelligence integrated with drone command and control (physical AI) offers a route to autonomy through large language models (LLMs), yet a unified LLM-to-drone interface has been missing. We present an LLM-agnostic command-and-control interface and agentic harness joining the Model Context Protocol (MCP) to MAVLink, the near-universal drone command-and-telemetry standard: "DroneServer" gives any MCP-capable LLM command, telemetry, mission, and safety functions over ArduPilot and PX4. Its 98 tools cover 223 of 238 client-side methods of MavSDK, MAVLink's library; 61 of the 98 were exercised in software-in-the-loop. We treat the LLM as an untrusted commander: zero public ports (externally verified); every command validated server-side (tiers, confirmation handshakes, independent geofence, audit log), exercised by an adversarial safety suite. Server-side mission state resolves the "fire-and-forget" mismatch: a scripted client's 37.8-minute mission survived a 4-minute disconnection. Over 1,000 simulated flights ran a ten-mission LLM-UAV control benchmark; eight of eleven models complete 90.0-100% of its six flying missions, and no aircraft left the permitted zone in 110 geofence-violation trials. On real hardware, the unmodified server commanded three quadcopters, GPS-guided and GPS-denied; five providers' models flew an unseen mission, ten of ten. The tests and datasets include: repeated trials, standardized evaluation tasks, success/failure statistics, latency analysis, uncertainty treatment, comparative benchmarking across models/platforms, prompt sets, mission complexity, tool-call traces, safety-intervention logs, and safety-performance assessment. The architecture is a scaffold for a higher-level drone-LLM operating system where plain-language commands realize complex missions, and a path to agent swarms commanding drone swarms under one security umbrella.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 70 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
20 of 70 references.
Closest ancestors · 8
Same direction, newest first
- 2026α3-Bench: A Unified Benchmark of Safety, Robustness, and Efficiency for LLM-Based UAV Agents over 6G Networks1 Jan
- 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarios14 Nov
- 2025Agentic UAVs: LLM-Driven Autonomy with Integrated Tool-Calling and Cognitive Reasoning14 Sep
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agent9 Jun
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVs8 Jun
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Models11 Mar
- 2025LLM-Agents Driven Automated Simulation Testing and Analysis of small Uncrewed Aerial Systems21 Jan
- 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models28 Aug
Other references · 12
- 2024Real-Time Anomaly Detection and Reactive Planning with Large Language Modelscited by 67
- 2025Next-Generation LLM for UAV: From Natural Language to Autonomous Flightcited by 10
- 2025LogisticsVLN: Vision-Language Navigation For Low-Altitude Terminal Delivery Based on Agentic UAVscited by 9
- 2025CHAI: Command Hijacking against embodied AIcited by 9
- 2025Cognitive Guardrails for Open-World Decision Making in Autonomous Drone Swarmscited by 3
- 2025Recent Advances in Transformer and Large Language Models for UAV Applicationscited by 3
- 2025When Large Language Models Meet UAV Projects: An Empirical Study from Developers' Perspectivecited by 2
- 2025Beyond Visual Line of Sight: UAVs with Edge AI, Connected LLMs, and VR for Autonomous Aerial Intelligencecited by 1
- 2025Robot builds a robot's brain: AI generated drone command and control station hosted in the skycited by 1
- 2025Autonomous Navigation of Cloud-Controlled Quadcopters in Confined Spaces Using Multi-Modal Perception and LLM-Driven High Semantic Reasoningcited by 1
- 2025AERMANI-VLM: Structured Prompting and Reasoning for Aerial Manipulation with Vision Language Modelscited by 1
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones
- 2026AeroGen: Agentic Drone Autonomy through Single-Shot Structured Prompting & Drone SDK
- 2025GSCE: A Prompt Framework with Enhanced Reasoning for Reliable LLM-driven Drone Control
- 2026SkySim: A ROS2-based Simulation Environment for Natural Language Control of Drone Swarms using Large Language Models
- 2026AeroEval: Staged Program and Execution Validation for AI-Generated Drone Missions ↗
- 2025TACOS: Task Agnostic COordinator of a multi-drone System
- 2026AerialClaw: An Open-Source Framework for LLM-Driven Autonomous Aerial Agents
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networks