Towards End-to-End Deep Learning for Autonomous Racing: On Data Collection and a Unified Architecture for Steering and Throttle Prediction
Not on the map. Why?
Abstract (arXiv)
Deep Neural Networks (DNNs) which are trained end-to-end have been successfully applied to solve complex problems that we have not been able to solve in past decades. Autonomous driving is one of the most complex problems which is yet to be completely solved and autonomous racing adds more complexity and exciting challenges to this problem. Towards the challenge of applying end-to-end learning to autonomous racing, this paper shows results on two aspects: (1) Analyzing the relationship between the driving data used for training and the maximum speed at which the DNN can be successfully applied for predicting steering angle, (2) Neural network architecture and training methodology for learning steering and throttle without any feedback or recurrent connections.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 12 of its 17 references that are in the map. First posted on arXiv 4 May 2021.
Builds on
12 of 17 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2014Going Deeper with Convolutionscited by 4,231
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2018Unity: A General Platform for Intelligent Agentscited by 232
- 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 147
- 2018On Offline Evaluation of Vision-based Driving Modelscited by 62
- 2018End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perceptioncited by 27
- 2018End-to-End Learning of Driving Models with Surround-View Cameras and Route Plannerscited by 27
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 2; 2024: 2; 2025: 1.
7 papers.
- 2022Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racingcited by 56
- 2023Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challengescited by 39
- 2024A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismocited by 12
- 2021Deep Visual Navigation under Partial Observabilitycited by 6
- 2024TinyLidarNet: 2D LiDAR-based End-to-End Deep Learning Model for F1TENTH Autonomous Racingcited by 4
- 2025Saliency-Guided Domain Adaptation for Left-Hand Driving in Autonomous Steeringcited by 2
- 2023Enhancing Robot Learning through Learned Human-Attention Feature Mapscited by 0
- 2025Saliency-Guided Domain Adaptation for Left-Hand Driving in Autonomous Steering3 Nov 2025
- 2024TinyLidarNet: 2D LiDAR-based End-to-End Deep Learning Model for F1TENTH Autonomous Racing9 Oct 2024
- 2024A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismo18 Jun 2024
- 2023Enhancing Robot Learning through Learned Human-Attention Feature Maps29 Aug 2023
- 2023Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challenges21 Aug 2023
- 2022Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racing14 Feb 2022
- 2021Deep Visual Navigation under Partial Observability16 Sep 2021