Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulation
Not on the map. Why?
Cited by 20 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the textitde facto evaluation environment, places the public in danger, and, due to the rare nature of accidents, will require billions of miles in order to statistically validate performance claims. We implement a simulation framework that can test an entire modern autonomous driving system, including, in particular, systems that employ deep-learning perception and control algorithms. Using adaptive importance-sampling methods to accelerate rare-event probability evaluation, we estimate the probability of an accident under a base distribution governing standard traffic behavior. We demonstrate our framework on a highway scenario, accelerating system evaluation by 2-20 times over naive Monte Carlo sampling methods and 10-300 mathsfP times (where mathsfP is the number of processors) over real-world testing.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 13; 2023: 13; 2024: 12; 2025: 9; 2026: 6.
76 papers.
Sort:
By area:
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 136
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradientscited by 95
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 65
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Drivingcited by 43
- 2024WcDT: World-centric Diffusion Transformer for Traffic Scene Generationcited by 31
- 2021Provably Efficient Black-Box Action Poisoning Attacks Against Reinforcement Learningcited by 29
- 2023Towards Knowledge-driven Autonomous Drivingcited by 29
- 2022V2XP-ASG: Generating Adversarial Scenes for Vehicle-to-Everything Perceptioncited by 28
- 2021Corner Case Generation and Analysis for Safety Assessment of Autonomous Vehiclescited by 27
38 more
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
- 2021Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehiclescited by 21
- 2021A Survey on Scenario-Based Testing for Automated Driving Systems in High-Fidelity Simulationcited by 21
- 2021CausalAF: Causal Autoregressive Flow for Safety-Critical Driving Scenario Generationcited by 20
- 2021Neural Network Guided Evolutionary Fuzzing for Finding Traffic Violations of Autonomous Vehiclescited by 19
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generationcited by 19
- 2021Gym-ANM: Reinforcement Learning Environments for Active Network Management Tasks in Electricity Distribution Systemscited by 18
- 2023Safety-Critical Scenario Generation Via Reinforcement Learning Based Editingcited by 16
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulatorscited by 13
- 2021Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Reviewcited by 12
- 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
- 2024Learning to Drive via Asymmetric Self-Playcited by 11
- 2022LEADER: Learning Attention over Driving Behaviors for Planning under Uncertaintycited by 9
- 2024Black Swan: Abductive and Defeasible Video Reasoning in Unpredictable Eventscited by 9
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systemscited by 8
- 2022Improving Adversarial Robustness by Contrastive Guided Diffusion Processcited by 8
- 2022Testing Rare Downstream Safety Violations via Upstream Adaptive Sampling of Perception Error Modelscited by 7
- 2021Achieving Efficiency in Black Box Simulation of Distribution Tails with Self-structuring Importance Samplerscited by 6
- 2021Gym-ANM: Open-source software to leverage reinforcement learning for power system management in research and educationcited by 6
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learningcited by 6
- 2024Diffusion-Based Failure Sampling for Evaluating Safety-Critical Autonomous Systemscited by 6
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?cited by 6
- 2021Neural-to-Tree Policy Distillation with Policy Improvement Criterioncited by 5
- 2021Assisted Robust Reward Designcited by 5
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happencited by 5
- 2025Calibrating Generative Models to Distributional Constraintscited by 5
- 2022Risk-Aware Scene Sampling for Dynamic Assurance of Autonomous Systemscited by 4
- 2022Self-Improving Safety Performance of Reinforcement Learning Based Driving with Black-Box Verification Algorithmscited by 4
- 2023Adaptive Failure Search Using Critical States from Domain Expertscited by 4
- 2021I Know You Can't See Me: Dynamic Occlusion-Aware Safety Validation of Strategic Planners for Autonomous Vehicles Using Hypergamescited by 3
- 2021Certifiable Deep Importance Sampling for Rare-Event Simulation of Black-Box Systemscited by 3
- 2021Querying Labelled Data with Scenario Programs for Sim-to-Real Validationcited by 3
- 2022Causal Scene BERT: Improving object detection by searching for challenging groups of datacited by 3
- 2023Model-based Validation as Probabilistic Inferencecited by 3
- 2023Stackelberg Driver Model for Continual Policy Improvement in Scenario-Based Closed-Loop Autonomous Drivingcited by 3
- 2024Importance Sampling-Guided Meta-Training for Intelligent Agents in Highly Interactive Environmentscited by 3
- 2021Scalable Safety-Critical Policy Evaluation with Accelerated Rare Event Samplingcited by 2
- 2021Probabilistic Metamodels for an Efficient Characterization of Complex Driving Scenarioscited by 2
50 most cited of 76 All 76 (JSON)
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026An Irreducible Quantum Advantage in Aligning World Models with Reality20 Aug 2026
- 2026Scenario Generation for Testing of Autonomous Driving Systems Using Real-World Failure Records30 Jun 2026
- 2026Revealing Safety-Critical Scenarios for UTM via Transformer30 Jun 2026
- 2026Is Your Trajectory Displacement Safe in Long-tail?15 Jun 2026
- 2026Training ML Models with Predictable Failures14 May 2026
- 2025Calibrating Generative Models to Distributional Constraints11 Oct 2025
- 2025Scalable Offline Metrics for Autonomous Driving9 Oct 2025
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulators5 Oct 2025
- 2025A Hierarchical Test Platform for Vision Language Model (VLM)-Integrated Real-World Autonomous Driving17 Jun 2025
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?23 May 2025
38 more
- 2025Scalable Importance Sampling in High Dimensions with Low-Rank Mixture Proposals19 May 2025
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2025Rare event modeling with self-regularized normalizing flows: what can we learn from a single failure?28 Feb 2025
- 2024Black Swan: Abductive and Defeasible Video Reasoning in Unpredictable Events7 Dec 2024
- 2024Online Poisoning Attack Against Reinforcement Learning under Black-box Environments1 Dec 2024
- 2024Foundation Models for Rapid Autonomy Validation22 Oct 2024
- 2024Learning to Drive via Asymmetric Self-Play26 Sep 2024
- 2024VCAT: Vulnerability-aware and Curiosity-driven Adversarial Training for Enhancing Autonomous Vehicle Robustness19 Sep 2024
- 2024Optimizing Falsification for Learning-Based Control Systems: A Multi-Fidelity Bayesian Approach12 Sep 2024
- 2024Importance Sampling-Guided Meta-Training for Intelligent Agents in Highly Interactive Environments22 Jul 2024
- 2024Diffusion-Based Failure Sampling for Evaluating Safety-Critical Autonomous Systems20 Jun 2024
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generation12 Apr 2024
- 2024WcDT: World-centric Diffusion Transformer for Traffic Scene Generation2 Apr 2024
- 2024Adaptive Splitting of Reusable Temporal Monitors for Rare Traffic Violations13 Mar 2024
- 2024Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learning29 Feb 2024
- 2023Towards Knowledge-driven Autonomous Driving7 Dec 2023
- 2023Rare Event Probability Learning by Normalizing Flows29 Oct 2023
- 2023Stackelberg Driver Model for Continual Policy Improvement in Scenario-Based Closed-Loop Autonomous Driving25 Sep 2023
- 2023Generating and Explaining Corner Cases Using Learnt Probabilistic Lane Graphs25 Aug 2023
- 2023Efficient Action Robust Reinforcement Learning with Probabilistic Policy Execution Uncertainty15 Jul 2023
- 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun 2023
- 2023Safety-Critical Scenario Generation Via Reinforcement Learning Based Editing25 Jun 2023
- 2023Model-based Validation as Probabilistic Inference17 May 2023
- 2023Synthetic Datasets for Autonomous Driving: A Survey24 Apr 2023
- 2023Adaptive Failure Search Using Critical States from Domain Experts1 Apr 2023
- 2023Specification-Guided Data Aggregation for Semantically Aware Imitation Learning29 Mar 2023
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning27 Feb 2023
- 2023Finding Needles in Haystack: Formal Generative Models for Efficient Massive Parallel Simulations3 Jan 2023
- 2022Self-Improving Safety Performance of Reinforcement Learning Based Driving with Black-Box Verification Algorithms29 Oct 2022
- 2022Exiting the Simulation: The Road to Robust and Resilient Autonomous Vehicles at Scale19 Oct 2022
- 2022Improving Adversarial Robustness by Contrastive Guided Diffusion Process18 Oct 2022
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving18 Oct 2022
- 2022RAP: Risk-Aware Prediction for Robust Planning4 Oct 2022
- 2022V2XP-ASG: Generating Adversarial Scenes for Vehicle-to-Everything Perception27 Sep 2022
- 2022LEADER: Learning Attention over Driving Behaviors for Planning under Uncertainty23 Sep 2022
- 2022Testing Rare Downstream Safety Violations via Upstream Adaptive Sampling of Perception Error Models20 Sep 2022
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehicles20 Jun 2022
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradients28 Apr 2022
50 newest of 76 All 76 (JSON)
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 136
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradientscited by 95
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 65
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Drivingcited by 43
- 2023Towards Knowledge-driven Autonomous Drivingcited by 29
- 2021Corner Case Generation and Analysis for Safety Assessment of Autonomous Vehiclescited by 27
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
- 2021Neural Network Guided Evolutionary Fuzzing for Finding Traffic Violations of Autonomous Vehiclescited by 19
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generationcited by 19
- 2024Learning to Drive via Asymmetric Self-Playcited by 11
- 2022LEADER: Learning Attention over Driving Behaviors for Planning under Uncertaintycited by 9
12 most cited of 18 All 18 (JSON)
- 2025Scalable Offline Metrics for Autonomous Driving9 Oct 2025
- 2024Learning to Drive via Asymmetric Self-Play26 Sep 2024
- 2024VCAT: Vulnerability-aware and Curiosity-driven Adversarial Training for Enhancing Autonomous Vehicle Robustness19 Sep 2024
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generation12 Apr 2024
- 2023Towards Knowledge-driven Autonomous Driving7 Dec 2023
- 2023Stackelberg Driver Model for Continual Policy Improvement in Scenario-Based Closed-Loop Autonomous Driving25 Sep 2023
- 2023End-to-end Autonomous Driving: Challenges and Frontiers29 Jun 2023
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning27 Feb 2023
- 2022Self-Improving Safety Performance of Reinforcement Learning Based Driving with Black-Box Verification Algorithms29 Oct 2022
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving18 Oct 2022
- 2022LEADER: Learning Attention over Driving Behaviors for Planning under Uncertainty23 Sep 2022
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehicles20 Jun 2022
12 newest of 18 All 18 (JSON)
- 2024WcDT: World-centric Diffusion Transformer for Traffic Scene Generationcited by 31
- 2022Improving Adversarial Robustness by Contrastive Guided Diffusion Processcited by 8
- 2024Diffusion-Based Failure Sampling for Evaluating Safety-Critical Autonomous Systemscited by 6
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2024Diffusion-Based Failure Sampling for Evaluating Safety-Critical Autonomous Systems20 Jun 2024
- 2024WcDT: World-centric Diffusion Transformer for Traffic Scene Generation2 Apr 2024
- 2022Improving Adversarial Robustness by Contrastive Guided Diffusion Process18 Oct 2022
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2021Provably Efficient Black-Box Action Poisoning Attacks Against Reinforcement Learningcited by 29
- 2022V2XP-ASG: Generating Adversarial Scenes for Vehicle-to-Everything Perceptioncited by 28
- 2021Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehiclescited by 21
- 2021A Survey on Scenario-Based Testing for Automated Driving Systems in High-Fidelity Simulationcited by 21
- 2021CausalAF: Causal Autoregressive Flow for Safety-Critical Driving Scenario Generationcited by 20
- 2021Gym-ANM: Reinforcement Learning Environments for Active Network Management Tasks in Electricity Distribution Systemscited by 18
- 2023Safety-Critical Scenario Generation Via Reinforcement Learning Based Editingcited by 16
- 2021Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Reviewcited by 12
- 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systemscited by 8
12 most cited of 49 All 49 (JSON)
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026Scenario Generation for Testing of Autonomous Driving Systems Using Real-World Failure Records30 Jun 2026
- 2026Revealing Safety-Critical Scenarios for UTM via Transformer30 Jun 2026
- 2026Is Your Trajectory Displacement Safe in Long-tail?15 Jun 2026
- 2026Training ML Models with Predictable Failures14 May 2026
- 2025Calibrating Generative Models to Distributional Constraints11 Oct 2025
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?23 May 2025
- 2025Scalable Importance Sampling in High Dimensions with Low-Rank Mixture Proposals19 May 2025
- 2025Rare event modeling with self-regularized normalizing flows: what can we learn from a single failure?28 Feb 2025
- 2024Online Poisoning Attack Against Reinforcement Learning under Black-box Environments1 Dec 2024
- 2024Foundation Models for Rapid Autonomy Validation22 Oct 2024
12 newest of 49 All 49 (JSON)