End-to-End Race Driving with Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
We present research using the latest reinforcement learning algorithm for end-to-end driving without any mediated perception (object recognition, scene understanding). The newly proposed reward and learning strategies lead together to faster convergence and more robust driving using only RGB image from a forward facing camera. An Asynchronous Actor Critic (A3C) framework is used to learn the car control in a physically and graphically realistic rally game, with the agents evolving simultaneously on tracks with a variety of road structures (turns, hills), graphics (seasons, location) and physics (road adherence). A thorough evaluation is conducted and generalization is proven on unseen tracks and using legal speed limits. Open loop tests on real sequences of images show some domain adaption capability of our method.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 4; 2023: 6; 2024: 7; 2025: 5.
38 papers.
Sort:
By area:
- 2021Reward (Mis)design for Autonomous Drivingcited by 102
- 2022Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racingcited by 56
- 2021Autonomous Drone Racing with Deep Reinforcement Learningcited by 51
- 2021Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learningcited by 41
- 2021Latent Imagination Facilitates Zero-Shot Transfer in Autonomous Racingcited by 22
- 2024A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismocited by 12
- 2021Formula RL: Deep Reinforcement Learning for Autonomous Racing using Telemetry Datacited by 10
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehiclescited by 10
- 2021Runtime Safety Assurance for Learning-enabled Control of Autonomous Driving Vehiclescited by 8
- 2021Encoding Distributional Soft Actor-Critic for Autonomous Driving in Multi-lane Scenarioscited by 5
- 2024Informed Reinforcement Learning for Situation-Aware Traffic Rule Exceptionscited by 4
- 2025A Champion-level Vision-based Reinforcement Learning Agent for Competitive Racing in Gran Turismo 7cited by 4
26 more
- 2021Steadily Learn to Drive with Virtual Memorycited by 3
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Drivingcited by 3
- 2021Expert Human-Level Driving in Gran Turismo Sport Using Deep Reinforcement Learning with Image-based Representationcited by 3
- 2025V-Max: A Reinforcement Learning Framework for Autonomous Drivingcited by 3
- 2025Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing Systemcited by 3
- 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environmentcited by 2
- 2022Incorporating Voice Instructions in Model-Based Reinforcement Learning for Self-Driving Carscited by 2
- 2023End-to-end Lidar-Driven Reinforcement Learning for Autonomous Racingcited by 2
- 2023Development and Assessment of Autonomous Vehicles in Both Fully Automated and Mixed Traffic Conditionscited by 2
- 2024AARK: An Open Toolkit for Autonomous Racing Researchcited by 2
- 2021OctoPath: An OcTree Based Self-Supervised Learning Approach to Local Trajectory Planning for Mobile Robotscited by 1
- 2021Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecturecited by 1
- 2023Towards Optimal Head-to-head Autonomous Racing with Curriculum Reinforcement Learningcited by 1
- 2023Partial End-to-end Reinforcement Learning for Robustness Against Modelling Error in Autonomous Racingcited by 1
- 2023Scalable Decentralized Cooperative Platoon using Multi-Agent Deep Reinforcement Learningcited by 1
- 2024Learning Autonomous Race Driving with Action Mapping Reinforcement Learningcited by 1
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehiclescited by 0
- 2021Geo-Context Aware Study of Vision-Based Autonomous Driving Models and Spatial Video Datacited by 0
- 2022A New Approach to Training Multiple Cooperative Agents for Autonomous Drivingcited by 0
- 2022Integrated Decision and Control for High-Level Automated Vehicles by Mixed Policy Gradient and Its Experiment Verificationcited by 0
- 2023Automated Driving Without Ethics: Meaning, Design and Real-World Implementationcited by 0
- 2024Deep Reinforcement Learning for Local Path Following of an Autonomous Formula SAE Vehiclecited by 0
- 2024Bidirectional-Reachable Hierarchical Reinforcement Learning with Mutually Responsive Policiescited by 0
- 2024Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changingcited by 0
- 2025Experimental investigation of pose informed reinforcement learning for skid-steered visual navigationcited by 0
- 2025Context-Aware Model-Based Reinforcement Learning for Autonomous Racingcited by 0
- 2025Context-Aware Model-Based Reinforcement Learning for Autonomous Racing13 Oct 2025
- 2025Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System13 Aug 2025
- 2025Experimental investigation of pose informed reinforcement learning for skid-steered visual navigation26 Jun 2025
- 2025A Champion-level Vision-based Reinforcement Learning Agent for Competitive Racing in Gran Turismo 712 Apr 2025
- 2025V-Max: A Reinforcement Learning Framework for Autonomous Driving11 Mar 2025
- 2024AARK: An Open Toolkit for Autonomous Racing Research1 Oct 2024
- 2024Bidirectional-Reachable Hierarchical Reinforcement Learning with Mutually Responsive Policies26 Jun 2024
- 2024Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changing25 Jun 2024
- 2024Learning Autonomous Race Driving with Action Mapping Reinforcement Learning21 Jun 2024
- 2024A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismo18 Jun 2024
- 2024Informed Reinforcement Learning for Situation-Aware Traffic Rule Exceptions6 Feb 2024
- 2024Deep Reinforcement Learning for Local Path Following of an Autonomous Formula SAE Vehicle5 Jan 2024
26 more
- 2023Scalable Decentralized Cooperative Platoon using Multi-Agent Deep Reinforcement Learning11 Dec 2023
- 2023Partial End-to-end Reinforcement Learning for Robustness Against Modelling Error in Autonomous Racing11 Dec 2023
- 2023Development and Assessment of Autonomous Vehicles in Both Fully Automated and Mixed Traffic Conditions8 Dec 2023
- 2023End-to-end Lidar-Driven Reinforcement Learning for Autonomous Racing1 Sep 2023
- 2023Towards Optimal Head-to-head Autonomous Racing with Curriculum Reinforcement Learning25 Aug 2023
- 2023Automated Driving Without Ethics: Meaning, Design and Real-World Implementation9 Aug 2023
- 2022Integrated Decision and Control for High-Level Automated Vehicles by Mixed Policy Gradient and Its Experiment Verification19 Oct 2022
- 2022A New Approach to Training Multiple Cooperative Agents for Autonomous Driving5 Sep 2022
- 2022Incorporating Voice Instructions in Model-Based Reinforcement Learning for Self-Driving Cars21 Jun 2022
- 2022Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racing14 Feb 2022
- 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environment22 Dec 2021
- 2021Expert Human-Level Driving in Gran Turismo Sport Using Deep Reinforcement Learning with Image-based Representation11 Nov 2021
- 2021Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecture11 Oct 2021
- 2021Runtime Safety Assurance for Learning-enabled Control of Autonomous Driving Vehicles28 Sep 2021
- 2021Encoding Distributional Soft Actor-Critic for Autonomous Driving in Multi-lane Scenarios12 Sep 2021
- 2021Geo-Context Aware Study of Vision-Based Autonomous Driving Models and Spatial Video Data20 Aug 2021
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles19 Jul 2021
- 2021OctoPath: An OcTree Based Self-Supervised Learning Approach to Local Trajectory Planning for Mobile Robots2 Jun 2021
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehicles29 May 2021
- 2021Reward (Mis)design for Autonomous Driving28 Apr 2021
- 2021Formula RL: Deep Reinforcement Learning for Autonomous Racing using Telemetry Data22 Apr 2021
- 2021Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learning26 Mar 2021
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Driving16 Mar 2021
- 2021Autonomous Drone Racing with Deep Reinforcement Learning15 Mar 2021
- 2021Latent Imagination Facilitates Zero-Shot Transfer in Autonomous Racing8 Mar 2021
- 2021Steadily Learn to Drive with Virtual Memory16 Feb 2021
- 2021Reward (Mis)design for Autonomous Drivingcited by 102
- 2022Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racingcited by 56
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehiclescited by 10
- 2021Runtime Safety Assurance for Learning-enabled Control of Autonomous Driving Vehiclescited by 8
- 2021Encoding Distributional Soft Actor-Critic for Autonomous Driving in Multi-lane Scenarioscited by 5
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Drivingcited by 3
- 2025V-Max: A Reinforcement Learning Framework for Autonomous Drivingcited by 3
- 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environmentcited by 2
- 2022Incorporating Voice Instructions in Model-Based Reinforcement Learning for Self-Driving Carscited by 2
- 2023Development and Assessment of Autonomous Vehicles in Both Fully Automated and Mixed Traffic Conditionscited by 2
- 2024Learning Autonomous Race Driving with Action Mapping Reinforcement Learningcited by 1
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehiclescited by 0
- 2025V-Max: A Reinforcement Learning Framework for Autonomous Driving11 Mar 2025
- 2024Learning Autonomous Race Driving with Action Mapping Reinforcement Learning21 Jun 2024
- 2023Development and Assessment of Autonomous Vehicles in Both Fully Automated and Mixed Traffic Conditions8 Dec 2023
- 2022Incorporating Voice Instructions in Model-Based Reinforcement Learning for Self-Driving Cars21 Jun 2022
- 2022Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racing14 Feb 2022
- 2021Evaluating the Robustness of Deep Reinforcement Learning for Autonomous Policies in a Multi-agent Urban Driving Environment22 Dec 2021
- 2021Runtime Safety Assurance for Learning-enabled Control of Autonomous Driving Vehicles28 Sep 2021
- 2021Encoding Distributional Soft Actor-Critic for Autonomous Driving in Multi-lane Scenarios12 Sep 2021
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles19 Jul 2021
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehicles29 May 2021
- 2021Reward (Mis)design for Autonomous Driving28 Apr 2021
- 2021Goal-constrained Sparse Reinforcement Learning for End-to-End Driving16 Mar 2021
- 2021Autonomous Drone Racing with Deep Reinforcement Learningcited by 51
- 2021Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learningcited by 41
- 2024A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismocited by 12
- 2021Formula RL: Deep Reinforcement Learning for Autonomous Racing using Telemetry Datacited by 10
- 2024Informed Reinforcement Learning for Situation-Aware Traffic Rule Exceptionscited by 4
- 2025A Champion-level Vision-based Reinforcement Learning Agent for Competitive Racing in Gran Turismo 7cited by 4
- 2021Steadily Learn to Drive with Virtual Memorycited by 3
- 2021Expert Human-Level Driving in Gran Turismo Sport Using Deep Reinforcement Learning with Image-based Representationcited by 3
- 2025Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing Systemcited by 3
- 2023End-to-end Lidar-Driven Reinforcement Learning for Autonomous Racingcited by 2
- 2024AARK: An Open Toolkit for Autonomous Racing Researchcited by 2
- 2021OctoPath: An OcTree Based Self-Supervised Learning Approach to Local Trajectory Planning for Mobile Robotscited by 1
12 most cited of 24 All 24 (JSON)
- 2025Context-Aware Model-Based Reinforcement Learning for Autonomous Racing13 Oct 2025
- 2025Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System13 Aug 2025
- 2025Experimental investigation of pose informed reinforcement learning for skid-steered visual navigation26 Jun 2025
- 2025A Champion-level Vision-based Reinforcement Learning Agent for Competitive Racing in Gran Turismo 712 Apr 2025
- 2024AARK: An Open Toolkit for Autonomous Racing Research1 Oct 2024
- 2024Bidirectional-Reachable Hierarchical Reinforcement Learning with Mutually Responsive Policies26 Jun 2024
- 2024Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changing25 Jun 2024
- 2024A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismo18 Jun 2024
- 2024Informed Reinforcement Learning for Situation-Aware Traffic Rule Exceptions6 Feb 2024
- 2023Scalable Decentralized Cooperative Platoon using Multi-Agent Deep Reinforcement Learning11 Dec 2023
- 2023Partial End-to-end Reinforcement Learning for Robustness Against Modelling Error in Autonomous Racing11 Dec 2023
- 2023End-to-end Lidar-Driven Reinforcement Learning for Autonomous Racing1 Sep 2023
12 newest of 24 All 24 (JSON)