Collision Risk Estimation via Loss Prediction in End-to-End Autonomous Driving
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
Collision risk estimation and avoidance play central roles in the safety of autonomous driving (AD) systems. Recently emerged end-to-end AD systems gain collision avoidance ability by minimizing losses to penalize planning trajectories that are too close to other objects. Despite a significant collision rate during testing, most end-to-end planners do not explicitly quantify the collision risk in their outputs. To address this, we introduce RiskMonitor, an efficient plug-and-play module that interprets planning and motion tokens from state-of-the-art end-to-end planners to estimate collision risk. Inspired by loss prediction based uncertainty quantification, RiskMonitor predicts whether the collision loss -- commonly adopted to train end-to-end planners -- is positive along planned waypoints, framing collision risk estimation as a binary classification task. We evaluate RiskMonitor on the real-world nuScenes dataset (open-loop) and the neural-rendering based simulator, NeuroNCAP (closed-loop). Our token-driven method outperforms prediction-driven approaches, including deterministic rules, Gaussian mixture models, and Monte Carlo Dropout. When integrated with a simple braking policy, RiskMonitor improves collision avoidance ability by 66.5% in a closed-loop test on safety-critical scenarios. These results demonstrate that monitoring collision risk using plan and motion tokens enhances the safety of end-to-end AD without retraining it.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 35 of its 49 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
35 of 49 references.
Closest ancestors · 4
Same direction, newest first
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun
- 2023NeuRAD: Neural Rendering for Autonomous Driving26 Nov
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Driving19 Apr
Other references · 31
- 2017Attention Is All You Needcited by 59,932
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2019Learning Loss for Active Learningcited by 335
- 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 304
19 more
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
- 2021Learning to drive from a world on railscited by 114
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
- 2021DEUP: Direct Epistemic Uncertainty Predictioncited by 102
- 2021Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Taskscited by 100
- 2022Differentiable Raycasting for Self-supervised Occupancy Forecastingcited by 83
- 2024NeuroNCAP: Photorealistic Closed-loop Safety Testing for Autonomous Drivingcited by 61
- 2022StretchBEV: Stretching Future Instance Prediction Spatially and Temporallycited by 47
- 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
- 2018Probabilistic Prediction of Vehicle Semantic Intention and Motioncited by 31
- 2023Policy Pre-training for Autonomous Driving via Self-supervised Geometric Modelingcited by 25
- 2020Probabilistic End-to-End Vehicle Navigation in Complex Dynamic Environments with Multimodal Sensor Fusioncited by 23
- 2023URL: A Representation Learning Benchmark for Transferable Uncertainty Estimatescited by 17
- 2024Reliable Trajectory Prediction and Uncertainty Quantification with Conditioned Diffusion Modelscited by 13
- 2023Joint Out-of-Distribution Detection and Uncertainty Estimation for Trajectory Predictioncited by 10
- 2024Pretrained Visual Uncertaintiescited by 10
- 2021Vehicle Behavior Prediction and Generalization Using Imbalanced Learning Techniquescited by 7
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regressioncited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Auditing Latent-Space Monitors for Autonomous Drivingcited by 0
- 2026Auditing Latent-Space Monitors for Autonomous Driving24 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025Drive in Corridors: Enhancing the Safety of End-to-end Autonomous Driving via Corridor Learning and Planning
- 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving
- 2025Context-aware Risk Assessment and Its Application in Autonomous Driving
- 2021Don't Get Yourself into Trouble! Risk-aware Decision-Making for Autonomous Vehicles
- 2026Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving
- 2026Data-Driven Risk Fields for Safer End-to-End Autonomous Driving
- 2025Enhancing Autonomous Driving Safety with Collision Scenario Integration
- 2026Risk-Aware World Modeling with Flow-Guided Occupancy Evolution for Selective Trajectory Planning in Automated Driving