mlsanityData to 7 Oct 2026

SwarmGPT: Combining Large Language Models with Safe Motion Planning for Drone Swarm Choreography

arXiv 2412.08428 ↗First posted 11 Dec 2024cs.RO cs.AI cs.SYcited by 5

Not on the map. Why?

Abstract (arXiv)

Drone swarm performances -- synchronized, expressive aerial displays set to music -- have emerged as a captivating application of modern robotics. Yet designing smooth, safe choreographies remains a complex task requiring expert knowledge. We present SwarmGPT, a language-based choreographer that leverages the reasoning power of large language models (LLMs) to streamline drone performance design. The LLM is augmented by a safety filter that ensures deployability by making minimal corrections when safety or feasibility constraints are violated. By decoupling high-level choreographic design from low-level motion planning, our system enables non-experts to iteratively refine choreographies using natural language without worrying about collisions or actuator limits. We validate our approach through simulations with swarms up to 200 drones and real-world experiments with up to 20 drones performing choreographies to diverse types of songs, demonstrating scalable, synchronized, and safe performances. Beyond entertainment, this work offers a blueprint for integrating foundation models into safety-critical swarm robotics applications.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 23 of its 48 references that are in the map. First posted on arXiv 11 Dec 2024.

Builds on

23 of 48 references.

References · 23

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  5. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  6. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  7. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  8. 2022Visual Language Maps for Robot Navigationcited by 362
  9. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
  10. 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 337
  11. 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 296
  12. 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
11 more
  1. 2023Physically Grounded Vision-Language Models for Robotic Manipulationcited by 163
  2. 2023Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisitioncited by 156
  3. 2023Language Embedded Radiance Fields for Zero-Shot Task-Oriented Graspingcited by 91
  4. 2021Learning to Fly -- a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Controlcited by 68
  5. 2022LATTE: LAnguage Trajectory TransformErcited by 40
  6. 2023SayTap: Language to Quadrupedal Locomotioncited by 40
  7. 2019Online Trajectory Generation with Distributed Model Predictive Control for Multi-Robot Motion Planningcited by 13
  8. 2023AMSwarm: An Alternating Minimization Approach for Safe Motion Planning of Quadrotor Swarms in Cluttered Environmentscited by 5
  9. 2018Trajectory Generation for Multiagent Point-To-Point Transitions via Distributed Model Predictive Controlcited by 4
  10. 2017Downwash-Aware Trajectory Planning for Large Quadrotor Teamscited by 2
  11. 2018Fast and In Sync: Periodic Swarm Patterns for Quadrotorscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkySim: A ROS2-based Simulation Environment for Natural Language Control of Drone Swarms using Large Language Models
  2. 2026AeroWeaver: An Embodied-Agent Harness for Weaving Aerial Skills into Distributed, Adaptive Swarm Execution
  3. 2025SINGER: An Onboard Generalist Vision-Language Navigation Policy for Drones
  4. 2026Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones
  5. 2025Using Language Models as Closed-Loop High-Level Planners for Robotics Applications: A Brief Overview and Benchmarks
  6. 2025Multimodal Large Language Models-Enabled UAV Swarm: Towards Efficient and Intelligent Autonomous Aerial Systems
  7. 2026Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching
  8. 2026Melding LLM and temporal logic for reliable human-swarm collaboration in complex scenarios ↗