Safe and Scalable Multi-Drone Payload Transport via CBF-based Reinforcement Learning with Zero-Shot Sim-to-Real Transfer
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
Multi-drone payload transportation has emerged as a promising research paradigm with potential applications in construction, logistics, and disaster response. However, the complex coupled dynamics among drones, cables, and payloads pose significant challenges, and existing approaches remain limited in safety and scalability, particularly in dynamic and unstructured environments. In this work, we propose a learning-based framework for safe and scalable multi-drone cooperative payload transport. We introduce a minimal 2D abstraction that preserves the task-relevant drone-payload coupling required for coordination and safety, while remaining computationally efficient for large-scale learning. Using domain randomization over team size and physical parameters, we train a fully distributed policy via Discrete Graph Control Barrier Function Proximal Policy Optimization (DGPPO), enabling robust zero-shot sim-to-real transfer without fine-tuning. Extensive real-world evaluations demonstrate that a single learned policy generalizes across varying team sizes and task scenarios. Furthermore, multi-group hardware experiments show that the same policy can safely operate in dynamic environments, where other drone teams act as moving obstacles. These results indicate that the proposed framework enables efficient, safe, and scalable multi-drone payload transportation with strong generalization to complex real-world conditions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 16 of its 45 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
16 of 45 references.
References · 16
- 2019Control Barrier Functions: Theory and Applicationscited by 372
- 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregationcited by 36
- 2021Multi-Agent Constrained Policy Optimisationcited by 35
- 2024GCBF+: A Neural Graph Control Barrier Function Framework for Distributed Safe Multi-Agent Controlcited by 22
- 2022Control Barrier Functions and Input-to-State Safety with Application to Automated Vehiclescited by 13
- 2024DRAL: Deep Reinforcement Adaptive Learning for Multi-UAVs Navigation in Unknown Indoor Environmentcited by 11
- 2025Discrete GCBF Proximal Policy Optimization for Multi-agent Safe Optimal Controlcited by 8
- 2022Human-Aware Physical Human-Robot Collaborative Transportation and Manipulation with Multiple Aerial Robotscited by 6
- 2025Agile and Cooperative Aerial Manipulation of a Cable-Suspended Loadcited by 6
- 2025Solving Multi-Agent Safe Optimal Control with Distributed Epigraph Form MARLcited by 6
- 2023Nonlinear Model Predictive Control for Cooperative Transportation and Manipulation of Cable Suspended Payloads with Multiple Quadrotorscited by 4
- 2025Decentralized Aerial Manipulation of a Cable-Suspended Load using Multi-Agent Reinforcement Learningcited by 4
4 more
- 2023Nonlinear MPC for Full-Pose Manipulation of a Cable-Suspended Load using Multiple UAVscited by 3
- 2024HPA-MPC: Hybrid Perception-Aware Nonlinear Model Predictive Control for Quadrotors with Suspended Loadscited by 2
- 2021Cooperative Transportation using Multiple Single-Rotor Robots and Decentralized Control for Unknown Payloadscited by 1
- 2025Optimal Trajectory Planning for Cooperative Manipulation with Multiple Quadrotors Using Control Barrier Functionscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Dashing for the Golden Snitch: Multi-Drone Time-Optimal Motion Planning with Multi-Agent Reinforcement Learning
- 2026Intercepting an Agile Target with Net-Carrying Drones using Competitive Multi-Agent Reinforcement Learning ↗
- 2024Energy-Aware Multi-Agent Reinforcement Learning for Collaborative Execution in Mission-Oriented Drone Networks
- 2025Onboard Mission Replanning for Adaptive Cooperative Multi-Robot Systems
- 2024Reinforcement Learning Driven Cooperative Ball Balance in Rigidly Coupled Drones
- 2025Towards Robust Multi-UAV Collaboration: MARL with Noise-Resilient Communication and Attention Mechanisms
- 2025From Static to Adaptive Defense: Federated Multi-Agent Deep Reinforcement Learning-Driven Moving Target Defense Against DoS Attacks in UAV Swarm Networks
- 2025SafeSwarm: Decentralized Safe RL for the Swarm of Drones Landing in Dense Crowds