AeroGen: Agentic Drone Autonomy through Single-Shot Structured Prompting & Drone SDK
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Designing correct UAV autonomy programs is challenging due to joint navigation, sensing and analytics requirements. While LLMs can generate code, their reliability for safety-critical UAVs remains uncertain. This paper presents AeroGen, an open-loop framework that enables consistently correct single-shot AI-generated drone control programs through structured guardrail prompting and integration with the AeroDaaS drone SDK. AeroGen encodes API descriptions, flight constraints and operational world rules directly into the system context prompt, enabling generic LLMs to produce constraint-aware code from user prompts, with minimal example code. We evaluate AeroGen across a diverse benchmark of 20 navigation tasks and 5 drone missions on urban, farm and inspection environments, using both imperative and declarative user prompts. AeroGen generates about 40 lines of AeroDaaS Python code in about 20s per mission, in both real-world and simulations, showing that structured prompting with a well-defined SDK improves robustness, correctness and deployability of LLM-generated drone autonomy programs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 19 references that are in the map. First posted on arXiv 15 Mar 2026.
Builds on
15 of 19 references.
References · 15
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 153
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
- 2023Autonomous Power Line Inspection with Drones via Perception-Aware MPCcited by 17
- 2021FogROS: An Adaptive Framework for Automating Fog Robotics Deploymentcited by 7
- 2025GSCE: A Prompt Framework with Enhanced Reasoning for Reliable LLM-driven Drone Controlcited by 7
- 2024Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robotscited by 5
- 2023Aerostack2: A Software Framework for Developing Multi-robot Aerial Systemscited by 4
- 2025ImpedanceGPT: VLM-driven Impedance Control of Swarm of Mini-drones for Intelligent Navigation in Dynamic Environmentcited by 4
- 2025Large Language Model-Driven Closed-Loop UAV Operation with Semantic Observationscited by 3
- 2025AeroDaaS: Towards an Application Programming Framework for Drones-as-a-Servicecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AeroEval: Staged Program and Execution Validation for AI-Generated Drone Missions ↗
- 2025Robot builds a robot's brain: AI generated drone command and control station hosted in the sky
- 2026An LLM-Agnostic, MAVLink-Based Drone Command and Control Interface and Agentic Harness Using the Model Context Protocol
- 2026AerialClaw: An Open-Source Framework for LLM-Driven Autonomous Aerial Agents
- 2025UAVBench: An Open Benchmark Dataset for Autonomous and Agentic AI UAV Systems via LLM-Generated Flight Scenarios
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agent
- 2026SkySim: A ROS2-based Simulation Environment for Natural Language Control of Drone Swarms using Large Language Models
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVs