Robust Behavioral Cloning for Autonomous Vehicles using End-to-End Imitation Learning
On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving
Abstract (arXiv)
In this work, we present a lightweight pipeline for robust behavioral cloning of a human driver using end-to-end imitation learning. The proposed pipeline was employed to train and deploy three distinct driving behavior models onto a simulated vehicle. The training phase comprised of data collection, balancing, augmentation, preprocessing and training a neural network, following which, the trained model was deployed onto the ego vehicle to predict steering commands based on the feed from an onboard camera. A novel coupled control law was formulated to generate longitudinal control commands on-the-go based on the predicted steering angle and other parameters such as actual speed of the ego vehicle and the prescribed constraints for speed and steering. We analyzed computational efficiency of the pipeline and evaluated robustness of the trained models through exhaustive experimentation during the deployment phase. We also compared our approach against state-of-the-art implementation in order to comment on its validity.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 8 of its 19 references that are in the map. First posted on arXiv 9 Oct 2020.
Builds on
8 of 19 references.
References · 8
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
- 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 147
- 2020A Survey of End-to-End Driving: Architectures and Training Methodscited by 123
- 2018A Survey on Data Collection for Machine Learning: a Big Data -- AI Integration Perspectivecited by 111
- 2018The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approachescited by 74
- 2017Explaining How a Deep Neural Network Trained with End-to-End Learning Steers a Carcited by 65
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 1; 2024: 3; 2025: 3.
11 papers.
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2024Zero-shot Imitation Policy via Search in Demonstration Datasetcited by 13
- 2024Diffusion Imitation from Observationcited by 12
- 2022AutoDRIVE: A Comprehensive, Flexible and Integrated Digital Twin Ecosystem for Enhancing Autonomous Driving Research and Educationcited by 10
- 2024Reinforced Sequential Decision-Making for Sepsis Treatment: The POSNEGDM Framework with Mortality Classifier and Transformercited by 6
- 2025Sim2Real Diffusion: Leveraging Foundation Vision Language Models for Adaptive Automated Drivingcited by 5
- 2023Behavioral Cloning via Search in Embedded Demonstration Datasetcited by 3
- 2021Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecturecited by 1
- 2021AGPNet -- Autonomous Grading Policy Networkcited by 1
- 2025Imitation Learning for Autonomous Driving: Insights from Real-World Testingcited by 0
- 2025SD2AIL: Adversarial Imitation Learning from Synthetic Demonstrations via Diffusion Modelscited by 0
- 2025SD2AIL: Adversarial Imitation Learning from Synthetic Demonstrations via Diffusion Models21 Dec 2025
- 2025Sim2Real Diffusion: Leveraging Foundation Vision Language Models for Adaptive Automated Driving30 Jun 2025
- 2025Imitation Learning for Autonomous Driving: Insights from Real-World Testing26 Apr 2025
- 2024Diffusion Imitation from Observation7 Oct 2024
- 2024Reinforced Sequential Decision-Making for Sepsis Treatment: The POSNEGDM Framework with Mortality Classifier and Transformer12 Mar 2024
- 2024Zero-shot Imitation Policy via Search in Demonstration Dataset29 Jan 2024
- 2023Behavioral Cloning via Search in Embedded Demonstration Dataset15 Jun 2023
- 2022AutoDRIVE: A Comprehensive, Flexible and Integrated Digital Twin Ecosystem for Enhancing Autonomous Driving Research and Education10 Dec 2022
- 2021AGPNet -- Autonomous Grading Policy Network20 Dec 2021
- 2021Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecture11 Oct 2021
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles16 Jan 2021
Similar, not cited
Close in wording, no citation either way
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Driving
- 2026Imitation Learning for Autonomous Driving in CARLA
- 2026Learning from Human Driving: A Human-in-the-Loop Online Behavior Cloning Framework for Autonomous Driving
- 2022Evaluation of MPC-based Imitation Learning for Human-like Autonomous Driving
- 2025From Imitation to Optimization: A Comparative Study of Offline Learning for Autonomous Driving
- 2019Safer End-to-End Autonomous Driving via Conditional Imitation Learning and Command Augmentation
- 2020Enhanced Behavioral Cloning Based self-driving Car Using Transfer Learning
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst