mlsanityData to 14 Oct 2026

SkySim: A ROS2-based Simulation Environment for Natural Language Control of Drone Swarms using Large Language Models

arXiv 2602.01226 ↗First posted 1 Feb 2026cs.RO cs.HCcited by 3

Not on the map. Why?

Abstract (arXiv)

Unmanned Aerial Vehicle (UAV) swarms offer versatile applications in logistics, agriculture, and surveillance, yet controlling them requires expert knowledge for safety and feasibility. Traditional static methods limit adaptability, while Large Language Models (LLMs) enable natural language control but generate unsafe trajectories due to lacking physical grounding. This paper introduces SkySim, a ROS2-based simulation framework in Gazebo that decouples LLM high-level planning from low-level safety enforcement. Using Gemini 3.5 Pro, SkySim translates user commands (e.g., "Form a circle") into spatial waypoints, informed by real-time drone states. An Artificial Potential Field (APF) safety filter applies minimal adjustments for collision avoidance, kinematic limits, and geo-fencing, ensuring feasible execution at 20 Hz. Experiments with swarms of 3, 10, and 30 Crazyflie drones validate spatial reasoning accuracy (100% across tested geometric primitives), real-time collision prevention, and scalability. SkySim empowers non-experts to iteratively refine behaviors, bridging AI cognition with robotic safety for dynamic environments. Future work targets hardware integration.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Feb 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024SwarmGPT: Combining Large Language Models with Safe Motion Planning for Drone Swarm Choreography
  2. 2026Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones
  3. 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agent
  4. 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Models
  5. 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorial
  6. 2025TACOS: Task Agnostic COordinator of a multi-drone System
  7. 2025Multimodal Large Language Models-Enabled UAV Swarm: Towards Efficient and Intelligent Autonomous Aerial Systems
  8. 2026An LLM-Agnostic, MAVLink-Based Drone Command and Control Interface and Agentic Harness Using the Model Context Protocol