Behavioral Cloning Models Reality Check for Autonomous Driving
On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving
Abstract (arXiv)
How effective are recent advancements in autonomous vehicle perception systems when applied to real-world autonomous vehicle control? While numerous vision-based autonomous vehicle systems have been trained and evaluated in simulated environments, there is a notable lack of real-world validation for these systems. This paper addresses this gap by presenting the real-world validation of state-of-the-art perception systems that utilize Behavior Cloning (BC) for lateral control, processing raw image data to predict steering commands. The dataset was collected using a scaled research vehicle and tested on various track setups. Experimental results demonstrate that these methods predict steering angles with low error margins in real-time, indicating promising potential for real-world applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 16 of its 28 references that are in the map. First posted on arXiv 11 Sep 2024.
Builds on
16 of 28 references.
Closest ancestors · 1
Same direction, newest first
Other references · 15
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2016Variational Lossy Autoencodercited by 175
- 2021SiT: Self-supervised vIsion Transformercited by 99
- 2018On Offline Evaluation of Vision-based Driving Modelscited by 62
- 2021Mind the Gap! A Study on the Transferability of Virtual vs Physical-world Testing of Autonomous Driving Systemscited by 36
- 2020Explaining Autonomous Driving by Learning End-to-End Visual Attentioncited by 25
- 2019Self-Driving Car Steering Angle Prediction Based on Image Recognitioncited by 14
- 2024HighwayLLM: Decision-Making and Navigation in Highway Driving with RL-Informed Language Modelcited by 9
3 more
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2020Robust Behavioral Cloning for Autonomous Vehicles using End-to-End Imitation Learning
- 2020Driving Through Ghosts: Behavioral Cloning with False Positives
- 2026Imitation Learning for Autonomous Driving in CARLA
- 2026Diffusion-2BC: Hybrid Diffusion and Regression Training for Offline Behavior Cloning in Autonomous Driving
- 2026Learning from Human Driving: A Human-in-the-Loop Online Behavior Cloning Framework for Autonomous Driving
- 2023Controlling Steering with Energy-Based Models
- 2021Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving
- 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving