mlsanityData to 7 Oct 2026

Behavioral Cloning Models Reality Check for Autonomous Driving

arXiv 2409.07218 ↗First posted 11 Sep 2024cs.RO cs.AI cs.CVcited by 1

On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving

Abstract (arXiv)

How effective are recent advancements in autonomous vehicle perception systems when applied to real-world autonomous vehicle control? While numerous vision-based autonomous vehicle systems have been trained and evaluated in simulated environments, there is a notable lack of real-world validation for these systems. This paper addresses this gap by presenting the real-world validation of state-of-the-art perception systems that utilize Behavior Cloning (BC) for lateral control, processing raw image data to predict steering commands. The dataset was collected using a scaled research vehicle and tested on various track setups. Experimental results demonstrate that these methods predict steering angles with low error margins in real-time, indicating promising potential for real-world applications.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 16 of its 28 references that are in the map. First posted on arXiv 11 Sep 2024.

Builds on

16 of 28 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Addressing Limitations of State-Aware Imitation Learning for Autonomous Driving31 Oct

Other references · 15

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016End to End Learning for Self-Driving Carscited by 1,000
  3. 2017End-to-end Driving via Conditional Imitation Learningcited by 479
  4. 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
  5. 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
  6. 2016Variational Lossy Autoencodercited by 175
  7. 2021SiT: Self-supervised vIsion Transformercited by 99
  8. 2018On Offline Evaluation of Vision-based Driving Modelscited by 62
  9. 2021Mind the Gap! A Study on the Transferability of Virtual vs Physical-world Testing of Autonomous Driving Systemscited by 36
  10. 2020Explaining Autonomous Driving by Learning End-to-End Visual Attentioncited by 25
  11. 2019Self-Driving Car Steering Angle Prediction Based on Image Recognitioncited by 14
  12. 2024HighwayLLM: Decision-Making and Navigation in Highway Driving with RL-Informed Language Modelcited by 9
3 more
  1. 2020Multi-modal Experts Network for Autonomous Drivingcited by 4
  2. 2019Self Driving RC Car using Behavioral Cloningcited by 2
  3. 2022CARNet: A Dynamic Autoencoder for Learning Latent Dynamics in Autonomous Driving Taskscited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2020Robust Behavioral Cloning for Autonomous Vehicles using End-to-End Imitation Learning
  2. 2020Driving Through Ghosts: Behavioral Cloning with False Positives
  3. 2026Imitation Learning for Autonomous Driving in CARLA
  4. 2026Diffusion-2BC: Hybrid Diffusion and Regression Training for Offline Behavior Cloning in Autonomous Driving
  5. 2026Learning from Human Driving: A Human-in-the-Loop Online Behavior Cloning Framework for Autonomous Driving
  6. 2023Controlling Steering with Energy-Based Models
  7. 2021Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving
  8. 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving