PEACE: A Planner-Executor Agent with Constraint Enforcement for UAVs
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Foundation models are increasingly used to drive autonomous systems, yet existing approaches either keep the model in a tight control loop, raising latency and hallucination risk, or compile natural language into opaque end-to-end policies that are hard to explain, constraint and require domain-specific datasets and fine-tuning. We propose a planner-executor agent for PX4-based drones that decouples high-level mission planning from low-level control. A large language model performs single-pass task planning, while execution is handled through a structured ROS 2 tool-calling interface bridged to MAVLink. The system constructs a world model by combining modular 2D detectors (e.g., YOLO or vision-language models) with a pinhole depth projection module for 3D object localization. A constraint enforcement layer enforces altitude limits and horizontal geofencing, and bounded replanning enables recovery from execution-time action failures. We position our approach within three common design patterns for foundation-model-based robotics systems and demonstrate its feasibility in PX4 software-in-the-loop simulations in Gazebo. Results highlight improved explainability, constraint enforcement, and reduced LLM calls compared to tightly coupled LLM control. The code, dataset, videos, and other material can be found at the following link: https://github.com/erdemuysalx/PEACE
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 25 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
23 of 25 references.
Closest ancestors · 3
Same direction, newest first
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVs8 Jun
- 2025UAV-CodeAgents: Scalable UAV Mission Planning via Multi-Agent ReAct and Vision-Language Reasoning12 May
- 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility4 Jan
Other references · 20
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2023Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?cited by 218
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 146
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigationcited by 67
- 2023TypeFly: Flying Drones with Large Language Modelcited by 23
- 2025RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviourcited by 23
8 more
- 2025CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVscited by 22
- 2024NavAgent: Multi-scale Urban Street View Fusion For UAV Embodied Vision-and-Language Navigationcited by 18
- 2024FlockGPT: Guiding UAV Flocking with Linguistic Orchestrationcited by 12
- 2024LLM2Swarm: Robot Swarms that Responsively Reason, Plan, and Collaborate through LLMscited by 12
- 2024Defining and Evaluating Physical Safety for Large Language Modelscited by 9
- 2023Co-NavGPT: Multi-Robot Cooperative Visual Semantic Navigation Using Vision Language Modelscited by 8
- 2023Multi-Agent Behavior Retrieval: Retrieval-Augmented Policy Training for Cooperative Push Manipulation by Mobile Robotscited by 6
- 2025SINGER: An Onboard Generalist Vision-Language Navigation Policy for Dronescited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Models
- 2026SkySim: A ROS2-based Simulation Environment for Natural Language Control of Drone Swarms using Large Language Models
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agent
- 2026AeroDPO: Unleashing Lightweight UAV Navigation with High-Fidelity Perception and Automated Preference Optimization
- 2026Exp2VLA: Enabling Vision-Language-Action for Drone Navigation from Expert Demonstrations
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2026VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robots
- 2025GRaD-Nav++: Vision-Language Model Enabled Visual Drone Navigation with Gaussian Radiance Fields and Differentiable Dynamics