Driving Through Ghosts: Behavioral Cloning with False Positives
On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving
Abstract (arXiv)
Safe autonomous driving requires robust detection of other traffic participants. However, robust does not mean perfect, and safe systems typically minimize missed detections at the expense of a higher false positive rate. This results in conservative and yet potentially dangerous behavior such as avoiding imaginary obstacles. In the context of behavioral cloning, perceptual errors at training time can lead to learning difficulties or wrong policies, as expert demonstrations might be inconsistent with the perceived world state. In this work, we propose a behavioral cloning approach that can safely leverage imperfect perception without being conservative. Our core contribution is a novel representation of perceptual uncertainty for learning to plan. We propose a new probabilistic birds-eye-view semantic grid to encode the noisy output of object perception systems. We then leverage expert demonstrations to learn an imitative driving policy using this probabilistic representation. Using the CARLA simulator, we show that our approach can safely overcome critical false positives that would otherwise lead to catastrophic failures or conservative behavior.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 35 of its 58 references that are in the map. First posted on arXiv 29 Aug 2020.
Builds on
35 of 58 references.
Closest ancestors · 3
Same direction, newest first
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst7 Dec
- 2018Conditional Affordance Learning for Driving in Urban Environments18 Jun
- 2018End-to-end driving simulation via angle branched network19 May
Other references · 32
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2018An Algorithmic Perspective on Imitation Learningcited by 455
20 more
- 2019Learning by Cheatingcited by 361
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
- 2015DeepDriving: Learning Affordance for Direct Perception in Autonomous Drivingcited by 229
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2017Playing for Benchmarkscited by 169
- 2019LaserNet: An Efficient Probabilistic 3D Object Detector for Autonomous Drivingcited by 133
- 2019A General Framework for Uncertainty Estimation in Deep Learningcited by 119
- 2019Imitation Learning from Imperfect Demonstrationcited by 112
- 2018Driving Policy Transfer via Modularity and Abstractioncited by 91
- 2018Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detectioncited by 82
- 2018Lightweight Probabilistic Deep Networkscited by 77
- 2018Deep Imitative Models for Flexible Inference, Planning, and Controlcited by 75
- 2019Does computer vision matter for action?cited by 64
- 2019Monocular Plan View Networks for Autonomous Drivingcited by 37
- 2019Uncertainty-Aware Driver Trajectory Prediction at Urban Intersectionscited by 26
- 2019Uncertainty-Aware Data Aggregation for Deep Imitation Learningcited by 19
- 2019Risk-Averse Planning Under Uncertaintycited by 11
- 2017ADAPT: Zero-Shot Adaptive Policy Transfer for Stochastic Dynamical Systemscited by 9
- 2020CARPAL: Confidence-Aware Intent Recognition for Parallel Autonomycited by 5
- 2017GP-ILQG: Data-driven Robust Optimal Control for Uncertain Nonlinear Dynamical Systemscited by 4
Built on by
Citing papers per year: 2021: 4; 2022: 2; 2023: 1; 2024: 0; 2025: 1.
8 papers.
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2023ADAPT: Action-aware Driving Caption Transformercited by 78
- 2021Imitation Learning: Progress, Taxonomies and Challengescited by 56
- 2021Exploring Imitation Learning for Autonomous Driving with Feedback Synthesizer and Differentiable Rasterizationcited by 22
- 2022Choices, Risks, and Reward Reports: Charting Public Policy for Reinforcement Learning Systemscited by 12
- 2021Diff-Net: Image Feature Difference based High-Definition Map Change Detection for Autonomous Drivingcited by 5
- 2022Conquering Ghosts: Relation Learning for Information Reliability Representation and End-to-End Robust Navigationcited by 3
- 2025Benchmarking Autonomous Driving Planners Across Leaderboards: A Unified CARLA-Based Evaluationcited by 0
- 2025Benchmarking Autonomous Driving Planners Across Leaderboards: A Unified CARLA-Based Evaluation26 Sep 2025
- 2023ADAPT: Action-aware Driving Caption Transformer1 Feb 2023
- 2022Conquering Ghosts: Relation Learning for Information Reliability Representation and End-to-End Robust Navigation14 Mar 2022
- 2022Choices, Risks, and Reward Reports: Charting Public Policy for Reinforcement Learning Systems11 Feb 2022
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Driving9 Sep 2021
- 2021Diff-Net: Image Feature Difference based High-Definition Map Change Detection for Autonomous Driving14 Jul 2021
- 2021Imitation Learning: Progress, Taxonomies and Challenges23 Jun 2021
- 2021Exploring Imitation Learning for Autonomous Driving with Feedback Synthesizer and Differentiable Rasterization2 Mar 2021
Similar, not cited
Close in wording, no citation either way
- 2026Closed-Loop Evaluation of Bird's-Eye-View Maps from Cross-View Transformers as Inputs to Behavior-Cloning Policies
- 2026Lost in Fog: Sensor Perturbations Expose Reasoning Fragility in Driving VLAs
- 2026Diffusion-2BC: Hybrid Diffusion and Regression Training for Offline Behavior Cloning in Autonomous Driving
- 2026Learning from Human Driving: A Human-in-the-Loop Online Behavior Cloning Framework for Autonomous Driving
- 2025From Imitation to Optimization: A Comparative Study of Offline Learning for Autonomous Driving
- 2025Does Knowledge About Perceptual Uncertainty Help an Agent in Automated Driving?
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrations
- 2026Imitation Learning for Autonomous Driving in CARLA