mlsanityData to 7 Oct 2026

Driving Through Ghosts: Behavioral Cloning with False Positives

arXiv 2008.12969 ↗First posted 29 Aug 2020cs.CV cs.LG cs.ROcited by 8

On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving

Abstract (arXiv)

Safe autonomous driving requires robust detection of other traffic participants. However, robust does not mean perfect, and safe systems typically minimize missed detections at the expense of a higher false positive rate. This results in conservative and yet potentially dangerous behavior such as avoiding imaginary obstacles. In the context of behavioral cloning, perceptual errors at training time can lead to learning difficulties or wrong policies, as expert demonstrations might be inconsistent with the perceived world state. In this work, we propose a behavioral cloning approach that can safely leverage imperfect perception without being conservative. Our core contribution is a novel representation of perceptual uncertainty for learning to plan. We propose a new probabilistic birds-eye-view semantic grid to encode the noisy output of object perception systems. We then leverage expert demonstrations to learn an imitative driving policy using this probabilistic representation. Using the CARLA simulator, we show that our approach can safely overcome critical false positives that would otherwise lead to catastrophic failures or conservative behavior.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 35 of its 58 references that are in the map. First posted on arXiv 29 Aug 2020.

Builds on

35 of 58 references.

Closest ancestors · 3

Same direction, newest first

  1. 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst7 Dec
  2. 2018Conditional Affordance Learning for Driving in Urban Environments18 Jun
  3. 2018End-to-end driving simulation via angle branched network19 May

Other references · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  5. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  6. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  7. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  8. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  9. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  10. 2016End to End Learning for Self-Driving Carscited by 1,000
  11. 2017End-to-end Driving via Conditional Imitation Learningcited by 479
  12. 2018An Algorithmic Perspective on Imitation Learningcited by 455
20 more
  1. 2019Learning by Cheatingcited by 361
  2. 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
  3. 2015DeepDriving: Learning Affordance for Direct Perception in Autonomous Drivingcited by 229
  4. 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
  5. 2017Playing for Benchmarkscited by 169
  6. 2019LaserNet: An Efficient Probabilistic 3D Object Detector for Autonomous Drivingcited by 133
  7. 2019A General Framework for Uncertainty Estimation in Deep Learningcited by 119
  8. 2019Imitation Learning from Imperfect Demonstrationcited by 112
  9. 2018Driving Policy Transfer via Modularity and Abstractioncited by 91
  10. 2018Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detectioncited by 82
  11. 2018Lightweight Probabilistic Deep Networkscited by 77
  12. 2018Deep Imitative Models for Flexible Inference, Planning, and Controlcited by 75
  13. 2019Does computer vision matter for action?cited by 64
  14. 2019Monocular Plan View Networks for Autonomous Drivingcited by 37
  15. 2019Uncertainty-Aware Driver Trajectory Prediction at Urban Intersectionscited by 26
  16. 2019Uncertainty-Aware Data Aggregation for Deep Imitation Learningcited by 19
  17. 2019Risk-Averse Planning Under Uncertaintycited by 11
  18. 2017ADAPT: Zero-Shot Adaptive Policy Transfer for Stochastic Dynamical Systemscited by 9
  19. 2020CARPAL: Confidence-Aware Intent Recognition for Parallel Autonomycited by 5
  20. 2017GP-ILQG: Data-driven Robust Optimal Control for Uncertain Nonlinear Dynamical Systemscited by 4

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 2; 2023: 1; 2024: 0; 2025: 1.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Closed-Loop Evaluation of Bird's-Eye-View Maps from Cross-View Transformers as Inputs to Behavior-Cloning Policies
  2. 2026Lost in Fog: Sensor Perturbations Expose Reasoning Fragility in Driving VLAs
  3. 2026Diffusion-2BC: Hybrid Diffusion and Regression Training for Offline Behavior Cloning in Autonomous Driving
  4. 2026Learning from Human Driving: A Human-in-the-Loop Online Behavior Cloning Framework for Autonomous Driving
  5. 2025From Imitation to Optimization: A Comparative Study of Offline Learning for Autonomous Driving
  6. 2025Does Knowledge About Perceptual Uncertainty Help an Agent in Automated Driving?
  7. 2026DriveZero: End-to-End Driving Beyond Human Demonstrations
  8. 2026Imitation Learning for Autonomous Driving in CARLA