Reinforcement Learning for Collision-free Flight Exploiting Deep Collision Encoding
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
This work contributes a novel deep navigation policy that enables collision-free flight of aerial robots based on a modular approach exploiting deep collision encoding and reinforcement learning. The proposed solution builds upon a deep collision encoder that is trained on both simulated and real depth images using supervised learning such that it compresses the high-dimensional depth data to a low-dimensional latent space encoding collision information while accounting for the robot size. This compressed encoding is combined with an estimate of the robot's odometry and the desired target location to train a deep reinforcement learning navigation policy that offers low-latency computation and robust sim2real performance. A set of simulation and experimental studies in diverse environments are conducted and demonstrate the efficiency of the emerged behavior and its resilience in real-life deployments.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 33 of its 48 references that are in the map. First posted on arXiv 6 Feb 2024.
Builds on
33 of 48 references.
References · 33
- 2016Tutorial on Variational Autoencoderscited by 409
- 2021End-to-end Interpretable Neural Motion Plannercited by 242
- 2021Learning High-Speed Flight in the Wildcited by 128
- 2023Reaching the Limit in Autonomous Racing: Optimal Control versus Reinforcement Learningcited by 111
- 2020BADGR: An Autonomous Self-Supervised Learning-Based Navigation Systemcited by 102
- 2020Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learningcited by 93
- 2020Flightmare: A Flexible Quadrotor Simulatorcited by 84
- 2019Deep Drone Racing: From Simulation to Reality with Domain Randomizationcited by 76
- 2020Deep Drone Acrobaticscited by 75
- 2019Motion Planning Networks: Bridging the Gap Between Learning-based and Classical Motion Plannerscited by 66
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 58
- 2018Robot Motion Planning in Learned Latent Spacescited by 42
21 more
- 2017Learning to Fly by Crashingcited by 41
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environmentscited by 41
- 2019Long-Range Indoor Navigation with PRM-RLcited by 31
- 2020AlphaPilot: Autonomous Drone Racingcited by 30
- 2022Locomotion Policy Guided Traversability Learning using Volumetric Representations of Complex Environmentscited by 28
- 2022How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle Traversabilitycited by 27
- 2020LaND: Learning to Navigate from Disengagementscited by 25
- 2018Beauty and the Beast: Optimal Methods Meet Learning for Drone Racingcited by 21
- 2020Learning-based 3D Occupancy Prediction for Autonomous Navigation in Occluded Environmentscited by 21
- 2022CERBERUS: Autonomous Legged and Aerial Robotic Exploration in the Tunnel and Urban Circuits of the DARPA Subterranean Challengecited by 17
- 2020NavRep: Unsupervised Representations for Reinforcement Learning of Robot Navigation in Dynamic Human Environmentscited by 15
- 2022Team CERBERUS Wins the DARPA Subterranean Challenge: Technical Overview and Lessons Learnedcited by 14
- 2020Visual Navigation Among Humans with Optimal Control as a Supervisorcited by 12
- 2022Motion Primitives-based Navigation Planning using Deep Collision Predictioncited by 11
- 2023Aerial Gym -- Isaac Gym Simulator for Aerial Robotscited by 11
- 2022Present and Future of SLAM in Extreme Underground Environmentscited by 10
- 2021The Artificial Intelligence behind the winning entry to the 2019 AI Robotic Racing Competitioncited by 8
- 2021Double Critic Deep Reinforcement Learning for Mapless 3D Navigation of Unmanned Aerial Vehiclescited by 8
- 2023Semantically-enhanced Deep Collision Prediction for Autonomous Navigation using Aerial Robotscited by 7
- 2023Task-driven Compression for Collision Encoding based on Depth Imagescited by 7
- 2019Nuclear Environments Inspection with Micro Aerial Vehicles: Algorithms and Experimentscited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 7.
13 papers.
Sort:
By area:
- 2025Flying on Point Clouds with Reinforcement Learningcited by 7
- 2025RAPID: Robust and Agile Planner Using Inverse Reinforcement Learning for Vision-Based Drone Navigationcited by 6
- 2026Reinforcement Learning for Active Perception in Autonomous Navigationcited by 4
- 2024Learning Long-Horizon Predictions for Quadrotor Dynamicscited by 1
- 2025Towards Task-Oriented Flying: Framework, Infrastructure, and Principlescited by 1
- 2025Synthetic vs. Real Training Data for Visual Navigationcited by 1
- 2024Non-Prehensile Aerial Manipulation using Model-Based Deep Reinforcement Learningcited by 0
- 2026Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splattingcited by 0
- 2026Cross-Modal Reinforcement Learning for Navigation with Degraded Depth Measurementscited by 0
- 2026CMRL: Collision-Aware and Memory-Enhanced Reinforcement Learning for UAV Navigation in Multi-Scale Obstacle Environmentscited by 0
- 2026A Heuristic Approach for Performance Tuning in RL-based Quadrotor Control via Reward Design and Termination Conditionscited by 0
- 2026Vision-Guided Outdoor Flight and Obstacle Evasion via Reinforcement Learningcited by 0
- 2026A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environments20 Aug 2026
- 2026Vision-Guided Outdoor Flight and Obstacle Evasion via Reinforcement Learning23 May 2026
- 2026A Heuristic Approach for Performance Tuning in RL-based Quadrotor Control via Reward Design and Termination Conditions18 May 2026
- 2026CMRL: Collision-Aware and Memory-Enhanced Reinforcement Learning for UAV Navigation in Multi-Scale Obstacle Environments14 May 2026
- 2026Cross-Modal Reinforcement Learning for Navigation with Degraded Depth Measurements23 Mar 2026
- 2026Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splatting6 Feb 2026
- 2026Reinforcement Learning for Active Perception in Autonomous Navigation1 Feb 2026
- 2025Synthetic vs. Real Training Data for Visual Navigation15 Sep 2025
- 2025Towards Task-Oriented Flying: Framework, Infrastructure, and Principles21 Apr 2025
- 2025Flying on Point Clouds with Reinforcement Learning1 Mar 2025
- 2025RAPID: Robust and Agile Planner Using Inverse Reinforcement Learning for Vision-Based Drone Navigation4 Feb 2025
- 2024Learning Long-Horizon Predictions for Quadrotor Dynamics17 Jul 2024
1 more
- 2025Flying on Point Clouds with Reinforcement Learningcited by 7
- 2026Reinforcement Learning for Active Perception in Autonomous Navigationcited by 4
- 2024Non-Prehensile Aerial Manipulation using Model-Based Deep Reinforcement Learningcited by 0
- 2026Cross-Modal Reinforcement Learning for Navigation with Degraded Depth Measurementscited by 0
- 2026CMRL: Collision-Aware and Memory-Enhanced Reinforcement Learning for UAV Navigation in Multi-Scale Obstacle Environmentscited by 0
- 2026A Heuristic Approach for Performance Tuning in RL-based Quadrotor Control via Reward Design and Termination Conditionscited by 0
- 2026Vision-Guided Outdoor Flight and Obstacle Evasion via Reinforcement Learningcited by 0
- 2026Vision-Guided Outdoor Flight and Obstacle Evasion via Reinforcement Learning23 May 2026
- 2026A Heuristic Approach for Performance Tuning in RL-based Quadrotor Control via Reward Design and Termination Conditions18 May 2026
- 2026CMRL: Collision-Aware and Memory-Enhanced Reinforcement Learning for UAV Navigation in Multi-Scale Obstacle Environments14 May 2026
- 2026Cross-Modal Reinforcement Learning for Navigation with Degraded Depth Measurements23 Mar 2026
- 2026Reinforcement Learning for Active Perception in Autonomous Navigation1 Feb 2026
- 2025Flying on Point Clouds with Reinforcement Learning1 Mar 2025
- 2024Non-Prehensile Aerial Manipulation using Model-Based Deep Reinforcement Learning1 Jul 2024
- 2024Learning Long-Horizon Predictions for Quadrotor Dynamicscited by 1
- 2025Towards Task-Oriented Flying: Framework, Infrastructure, and Principlescited by 1
- 2025Synthetic vs. Real Training Data for Visual Navigationcited by 1
- 2026Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splattingcited by 0
- 2026A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environmentscited by 0
- 2026A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environments20 Aug 2026
- 2026Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splatting6 Feb 2026
- 2025Synthetic vs. Real Training Data for Visual Navigation15 Sep 2025
- 2025Towards Task-Oriented Flying: Framework, Infrastructure, and Principles21 Apr 2025
- 2024Learning Long-Horizon Predictions for Quadrotor Dynamics17 Jul 2024
Similar, not cited
Close in wording, no citation either way
- 2026Learning-Based Dynamic Obstacle Avoidance for a UAV Using Only Three Range Sensors
- 2025Mastering Diverse, Unknown, and Cluttered Tracks for Robust Vision-Based Drone Racing
- 2024Robust Policy Learning for Multi-UAV Collision Avoidance with Causal Feature Selection ↗
- 2024Dual Agent Learning Based Aerial Trajectory Tracking
- 2025Collision-Aware Object-Goal Visual Navigation via Two-Stage Deep Reinforcement Learning
- 2024Collision Avoidance for Multiple UAVs in Unknown Scenarios with Causal Representation Disentanglement
- 2026High-Speed Vision-Based Flight in Clutter with Safety-Shielded Reinforcement Learning
- 2025Flying in Highly Dynamic Environments with End-to-end Learning Approach