Deep Drone Acrobatics
Not on the map. Why?
Abstract (arXiv)
Performing acrobatic maneuvers with quadrotors is extremely challenging. Acrobatic flight requires high thrust and extreme angular accelerations that push the platform to its physical limits. Professional drone pilots often measure their level of mastery by flying such maneuvers in competitions. In this paper, we propose to learn a sensorimotor policy that enables an autonomous quadrotor to fly extreme acrobatic maneuvers with only onboard sensing and computation. We train the policy entirely in simulation by leveraging demonstrations from an optimal controller that has access to privileged information. We use appropriate abstractions of the visual input to enable transfer to a real quadrotor. We show that the resulting policy can be directly deployed in the physical world without any fine-tuning on real data. Our methodology has several favorable properties: it does not require a human expert to provide demonstrations, it cannot harm the physical system during training, and it can be used to learn maneuvers that are challenging even for the best human pilots. Our approach enables a physical quadrotor to fly maneuvers such as the Power Loop, the Barrel Roll, and the Matty Flip, during which it incurs accelerations of up to 3g.
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 12; 2023: 12; 2024: 10; 2025: 9; 2026: 5.
66 papers.
Sort:
By area:
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2022Navigating to Objects in the Real Worldcited by 104
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2021Learning High-Speed Flight in the Wildcited by 98
- 2021Autonomous Drone Racing with Deep Reinforcement Learningcited by 51
- 2023Neural Volumetric Memory for Visual Locomotion Controlcited by 40
- 2022Real-time Neural-MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platformscited by 36
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environmentscited by 30
- 2021Causal Navigation by Continuous-time Neural Networkscited by 23
- 2021A Survey on Human-aware Robot Navigationcited by 23
- 2024Bootstrapping Reinforcement Learning with Imitation for Vision-Based Agile Flightcited by 22
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 22
38 more
- 2024CGD: Constraint-Guided Diffusion Policies for UAV Trajectory Planningcited by 21
- 2021Learning Modular Robot Control Policiescited by 18
- 2023Learning to Fly in Secondscited by 18
- 2024Adaptive Horizon Actor-Critic for Policy Learning in Contact-Rich Differentiable Simulationcited by 18
- 2025See, Point, Fly: A Learning-Free VLM Framework for Universal Unmanned Aerial Navigationcited by 18
- 2021Policy Search for Model Predictive Control with Application to Agile Drone Flightcited by 17
- 2022Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Trackingcited by 16
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
- 2022Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racingcited by 13
- 2023Contrastive Learning for Enhancing Robust Scene Transfer in Vision-based Agile Flightcited by 11
- 2023DATT: Deep Adaptive Trajectory Tracking for Quadrotor Controlcited by 11
- 2021Demonstration-Efficient Guided Policy Search via Imitation of Robust Tube MPCcited by 10
- 2023Towards Generalist Robots: A Promising Paradigm via Generative Simulationcited by 9
- 2023Vision-based Learning for Drones: A Surveycited by 9
- 2021Invariance Through Latent Alignmentcited by 8
- 2021MPC-MPNet: Model-Predictive Motion Planning Networks for Fast, Near-Optimal Planning under Kinodynamic Constraintscited by 7
- 2023Deep Model Predictive Optimizationcited by 7
- 2021The Artificial Intelligence behind the winning entry to the 2019 AI Robotic Racing Competitioncited by 6
- 2022Visual Attention Prediction Improves Performance of Autonomous Drone Racing Agentscited by 6
- 2021AutoTune: Controller Tuning for High-Speed Flightcited by 5
- 2021The Holy Grail of Multi-Robot Planning: Learning to Generate Online-Scalable Solutions from Offline-Optimal Expertscited by 4
- 2022Using Simulation Optimization to Improve Zero-shot Policy Transfer of Quadrotorscited by 4
- 2023BatMobility: Towards Flying Without Seeing for Autonomous Dronescited by 4
- 2024Neuromorphic Attitude Estimation and Controlcited by 4
- 2025RoVerFly: Robust and Versatile Implicit Hybrid Control of Quadrotor-Payload Systemscited by 4
- 2021Temporal Convolutions for Multi-Step Quadrotor Motion Predictioncited by 3
- 2022Constrained Imitation Learning for a Flapping Wing Unmanned Aerial Vehiclecited by 3
- 2025FM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigationcited by 3
- 2026SPEAR: A Simulator for Photorealistic Embodied AI Researchcited by 3
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contextscited by 2
- 2022Output Feedback Tube MPC-Guided Data Augmentation for Robust, Efficient Sensorimotor Policy Learningcited by 2
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racingcited by 2
- 2025Automatic Generation of Aerobatic Flight in Complex Environments via Diffusion Modelscited by 2
- 2025DiffAero: A GPU-Accelerated Differentiable Simulation Framework for Efficient Quadrotor Policy Learningcited by 2
- 2021Deep Inertial Odometry with Accurate IMU Preintegrationcited by 1
- 2022Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Networkcited by 1
- 2024Distilling Privileged Information for Dubins Traveling Salesman Problems with Neighborhoodscited by 1
- 2024Learning Long-Horizon Predictions for Quadrotor Dynamicscited by 1
50 most cited of 66 All 66 (JSON)
- 2026Learning to Fly: Stable Vision-Guided UAV Servoing with Compact Target-Centric Cues and Reinforcement Learning7 Sep 2026
- 2026Conditional Invertible Neural Networks for Data-Driven UAV Control: A 2-D Proof of Concept15 Jul 2026
- 2026SPEAR: A Simulator for Photorealistic Embodied AI Research7 Jul 2026
- 2026Provably Safe, Yet Scalable Reinforcement Learning12 Jun 2026
- 2026Progressive Generalization Augmentation with Deeply Coupled RND-PPO and Domain-Prioritized Noise Injection for Robust Crop Management Reinforcement Learning17 May 2026
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practices23 Oct 2025
- 2025See, Point, Fly: A Learning-Free VLM Framework for Universal Unmanned Aerial Navigation26 Sep 2025
- 2025Synthetic vs. Real Training Data for Visual Navigation15 Sep 2025
- 2025RoVerFly: Robust and Versatile Implicit Hybrid Control of Quadrotor-Payload Systems14 Sep 2025
- 2025DiffAero: A GPU-Accelerated Differentiable Simulation Framework for Efficient Quadrotor Policy Learning12 Sep 2025
- 2025FM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigation27 May 2025
- 2025Automatic Generation of Aerobatic Flight in Complex Environments via Diffusion Models21 Apr 2025
38 more
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racing10 Mar 2025
- 2025End-to-End Imitation Learning for Optimal Asteroid Proximity Operations3 Feb 2025
- 2024Neuromorphic Attitude Estimation and Control21 Nov 2024
- 2024Tangled Program Graphs as an alternative to DRL-based control algorithms for UAVs8 Nov 2024
- 2024Whisker-Inspired Tactile Sensing: A Sim2Real Approach for Precise Underwater Contact Tracking17 Oct 2024
- 2024Learning Long-Horizon Predictions for Quadrotor Dynamics17 Jul 2024
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy23 Jun 2024
- 2024Adaptive Horizon Actor-Critic for Policy Learning in Contact-Rich Differentiable Simulation28 May 2024
- 2024CGD: Constraint-Guided Diffusion Policies for UAV Trajectory Planning2 May 2024
- 2024Distilling Privileged Information for Dubins Traveling Salesman Problems with Neighborhoods25 Apr 2024
- 2024Extremum-Seeking Action Selection for Accelerating Policy Optimization2 Apr 2024
- 2024Bootstrapping Reinforcement Learning with Imitation for Vision-Based Agile Flight18 Mar 2024
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis14 Dec 2023
- 2023Vision-based Learning for Drones: A Survey8 Dec 2023
- 2023Tube-NeRF: Efficient Imitation Learning of Visuomotor Policies from MPC using Tube-Guided Data Augmentation and NeRFs23 Nov 2023
- 2023Learning to Fly in Seconds22 Nov 2023
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation2 Nov 2023
- 2023DATT: Deep Adaptive Trajectory Tracking for Quadrotor Control13 Oct 2023
- 2023Deep Model Predictive Optimization6 Oct 2023
- 2023Contrastive Learning for Enhancing Robust Scene Transfer in Vision-based Agile Flight18 Sep 2023
- 2023BatMobility: Towards Flying Without Seeing for Autonomous Drones21 Jul 2023
- 2023Towards Generalist Robots: A Promising Paradigm via Generative Simulation17 May 2023
- 2023Neural Volumetric Memory for Visual Locomotion Control3 Apr 2023
- 2023Efficient Deep Learning of Robust, Adaptive Policies using Tube MPC-Guided Data Augmentation28 Mar 2023
- 2022Navigating to Objects in the Real World2 Dec 2022
- 2022Learning Modular Robot Locomotion from Demonstrations31 Oct 2022
- 2022Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing26 Oct 2022
- 2022Output Feedback Tube MPC-Guided Data Augmentation for Robust, Efficient Sensorimotor Policy Learning18 Oct 2022
- 2022Accelerate Reinforcement Learning with PID Controllers in the Pendulum Simulations3 Oct 2022
- 2022Constrained Imitation Learning for a Flapping Wing Unmanned Aerial Vehicle8 Jun 2022
- 2022Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking7 Jun 2022
- 2022Real-time Neural-MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platforms15 Mar 2022
- 2022Learning to control from expert demonstrations9 Mar 2022
- 2022Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network19 Feb 2022
- 2022Visual Attention Prediction Improves Performance of Autonomous Drone Racing Agents7 Jan 2022
- 2022Using Simulation Optimization to Improve Zero-shot Policy Transfer of Quadrotors4 Jan 2022
- 2021Invariance Through Latent Alignment15 Dec 2021
- 2021Autonomous Aerial Robot for High-Speed Search and Intercept Applications10 Dec 2021
50 newest of 66 All 66 (JSON)
- 2021Causal Navigation by Continuous-time Neural Networkscited by 23
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
- 2021Demonstration-Efficient Guided Policy Search via Imitation of Robust Tube MPCcited by 10
- 2022Constrained Imitation Learning for a Flapping Wing Unmanned Aerial Vehiclecited by 3
- 2022Output Feedback Tube MPC-Guided Data Augmentation for Robust, Efficient Sensorimotor Policy Learningcited by 2
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racingcited by 2
- 2023Tube-NeRF: Efficient Imitation Learning of Visuomotor Policies from MPC using Tube-Guided Data Augmentation and NeRFscited by 0
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racing10 Mar 2025
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy23 Jun 2024
- 2023Tube-NeRF: Efficient Imitation Learning of Visuomotor Policies from MPC using Tube-Guided Data Augmentation and NeRFs23 Nov 2023
- 2022Output Feedback Tube MPC-Guided Data Augmentation for Robust, Efficient Sensorimotor Policy Learning18 Oct 2022
- 2022Constrained Imitation Learning for a Flapping Wing Unmanned Aerial Vehicle8 Jun 2022
- 2021Demonstration-Efficient Guided Policy Search via Imitation of Robust Tube MPC21 Sep 2021
- 2021Causal Navigation by Continuous-time Neural Networks15 Jun 2021
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2022Navigating to Objects in the Real Worldcited by 104
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2021Learning High-Speed Flight in the Wildcited by 98
- 2021Autonomous Drone Racing with Deep Reinforcement Learningcited by 51
- 2023Neural Volumetric Memory for Visual Locomotion Controlcited by 40
- 2022Real-time Neural-MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platformscited by 36
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environmentscited by 30
- 2021A Survey on Human-aware Robot Navigationcited by 23
- 2024Bootstrapping Reinforcement Learning with Imitation for Vision-Based Agile Flightcited by 22
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 22
- 2021Learning Modular Robot Control Policiescited by 18
12 most cited of 56 All 56 (JSON)
- 2026Learning to Fly: Stable Vision-Guided UAV Servoing with Compact Target-Centric Cues and Reinforcement Learning7 Sep 2026
- 2026Conditional Invertible Neural Networks for Data-Driven UAV Control: A 2-D Proof of Concept15 Jul 2026
- 2026SPEAR: A Simulator for Photorealistic Embodied AI Research7 Jul 2026
- 2026Provably Safe, Yet Scalable Reinforcement Learning12 Jun 2026
- 2026Progressive Generalization Augmentation with Deeply Coupled RND-PPO and Domain-Prioritized Noise Injection for Robust Crop Management Reinforcement Learning17 May 2026
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practices23 Oct 2025
- 2025Synthetic vs. Real Training Data for Visual Navigation15 Sep 2025
- 2025RoVerFly: Robust and Versatile Implicit Hybrid Control of Quadrotor-Payload Systems14 Sep 2025
- 2025DiffAero: A GPU-Accelerated Differentiable Simulation Framework for Efficient Quadrotor Policy Learning12 Sep 2025
- 2025FM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigation27 May 2025
- 2025End-to-End Imitation Learning for Optimal Asteroid Proximity Operations3 Feb 2025
- 2024Neuromorphic Attitude Estimation and Control21 Nov 2024
12 newest of 56 All 56 (JSON)