Adaptive Stress Testing for Autonomous Vehicles
Not on the map. Why?
Cited by 23 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
This paper presents a method for testing the decision making systems of autonomous vehicles. Our approach involves perturbing stochastic elements in the vehicle's environment until the vehicle is involved in a collision. Instead of applying direct Monte Carlo sampling to find collision scenarios, we formulate the problem as a Markov decision process and use reinforcement learning algorithms to find the most likely failure scenarios. This paper presents Monte Carlo Tree Search (MCTS) and Deep Reinforcement Learning (DRL) solutions that can scale to large environments. We show that DRL can find more likely failure scenarios than MCTS with fewer calls to the simulator. A simulation scenario involving a vehicle approaching a crosswalk is used to validate the framework. Our proposed approach is very general and can be easily applied to other scenarios given the appropriate models of the vehicle and the environment.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 10; 2023: 11; 2024: 12; 2025: 8; 2026: 14.
70 papers.
Sort:
By area:
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Corner Case Generation and Analysis for Safety Assessment of Autonomous Vehiclescited by 27
- 2021Neural Network Guided Evolutionary Fuzzing for Finding Traffic Violations of Autonomous Vehiclescited by 19
- 2022Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systemscited by 18
- 2022How Do We Fail? Stress Testing Perception in Autonomous Vehiclescited by 17
- 2021Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Reviewcited by 12
- 2021MDPFuzz: Testing Models Solving Markov Decision Processescited by 11
- 2024Learning to Drive via Asymmetric Self-Playcited by 11
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policiescited by 10
- 2024SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generationcited by 10
- 2024Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllerscited by 9
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systemscited by 8
38 more
- 2021Finding Failures in High-Fidelity Simulation using Adaptive Stress Testing and the Backward Algorithmcited by 7
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learningcited by 6
- 2021Assisted Robust Reward Designcited by 5
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happencited by 5
- 2021Building Safer Autonomous Agents by Leveraging Risky Driving Behavior Knowledgecited by 4
- 2022Self-Improving Safety Performance of Reinforcement Learning Based Driving with Black-Box Verification Algorithmscited by 4
- 2023Adaptive Failure Search Using Critical States from Domain Expertscited by 4
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curriculacited by 4
- 2021ARC: Adversarially Robust Control Policies for Autonomous Vehiclescited by 3
- 2021Certifiable Deep Importance Sampling for Rare-Event Simulation of Black-Box Systemscited by 3
- 2021Querying Labelled Data with Scenario Programs for Sim-to-Real Validationcited by 3
- 2022Causal Scene BERT: Improving object detection by searching for challenging groups of datacited by 3
- 2023Model-based Validation as Probabilistic Inferencecited by 3
- 2023Generating Transferable Adversarial Simulation Scenarios for Self-Driving via Neural Renderingcited by 3
- 2024ASTPrompter: Preference-Aligned Automated Language Model Red-Teaming to Generate Low-Perplexity Unsafe Promptscited by 3
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Reviewcited by 3
- 2025Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentionscited by 3
- 2026ICR-Drive: Instruction Counterfactual Robustness for End-to-End Language-Driven Autonomous Drivingcited by 3
- 2021Adaptive Stress Testing for Adversarial Learning in a Financial Environmentcited by 2
- 2022ECSAS: Exploring Critical Scenarios from Action Sequence in Autonomous Drivingcited by 2
- 2022A Deep Reinforcement Learning Approach to Rare Event Estimationcited by 2
- 2024Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learningcited by 2
- 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Studycited by 2
- 2024Rate-Informed Discovery via Bayesian Adaptive Multifidelity Samplingcited by 2
- 2024Exploring Critical Testing Scenarios for Decision-Making Policies: An LLM Approachcited by 2
- 2026Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Developmentcited by 2
- 2022Test Against High-Dimensional Uncertainties: Accelerated Evaluation of Autonomous Vehicles with Deep Importance Samplingcited by 1
- 2022An Active Learning Reliability Method for Systems with Partially Defined Performance Functionscited by 1
- 2023Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehiclescited by 1
- 2023Attacking Motion Planners Using Adversarial Perception Errorscited by 1
- 2023STEAM & MoSAFE: SOTIF Error-and-Failure Model & Analysis for AI-Enabled Driving Automationcited by 1
- 2024A novel framework for adaptive stress testing of autonomous vehicles in multi-lane roadscited by 1
- 2024LAMBDA: Covering the Multimodal Critical Scenarios for Automated Driving Systems by Search Space Quantizationcited by 1
- 2025Controllable Latent Diffusion for Traffic Simulationcited by 1
- 2025Post-Convergence Sim-to-Real Policy Transfer: A Principled Alternative to Cherry-Pickingcited by 1
- 2025RADE: Learning Risk-Adjustable Driving Environment via Multi-Agent Conditional Diffusioncited by 1
- 2025Leveraging Reward Models for Guiding Code Review Comment Generationcited by 1
- 2025Diffusion Models for Safety Validation of Autonomous Driving Systemscited by 1
50 most cited of 70 All 70 (JSON)
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026Adaptive Sequential Test Planning for Multi-Mechanism Reliability Qualification via Bayesian Monte Carlo Tree Search10 Aug 2026
- 2026Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels28 Jul 2026
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026Importance Sampling and PCA for Finding Failures in Commercial Autonomous Vehicles20 Jul 2026
- 2026Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development10 Jul 2026
- 2026CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generation5 Jul 2026
- 2026Scenario Generation for Testing of Autonomous Driving Systems Using Real-World Failure Records30 Jun 2026
- 2026SPHINX: First Explain, Then Explore16 Jun 2026
- 2026Planetary Exploration 3.0: A Roadmap for Software-Defined, Radically Adaptive Space Systems22 Apr 2026
- 2026From Particles to Perils: SVGD-Based Hazardous Scenario Generation for Autonomous Driving Systems Testing20 Apr 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
38 more
- 2026ICR-Drive: Instruction Counterfactual Robustness for End-to-End Language-Driven Autonomous Driving7 Apr 2026
- 2026Risk-Controllable Multi-View Diffusion for Driving Scenario Generation12 Mar 2026
- 2025ScenicProver: A Framework for Compositional Probabilistic Verification of Learning-Enabled Systems4 Nov 2025
- 2025Diffusion Models for Safety Validation of Autonomous Driving Systems10 Jun 2025
- 2025Leveraging Reward Models for Guiding Code Review Comment Generation4 Jun 2025
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
- 2025RADE: Learning Risk-Adjustable Driving Environment via Multi-Agent Conditional Diffusion6 May 2025
- 2025Post-Convergence Sim-to-Real Policy Transfer: A Principled Alternative to Cherry-Picking21 Apr 2025
- 2025Controllable Latent Diffusion for Traffic Simulation14 Mar 2025
- 2025Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentions7 Mar 2025
- 2024Exploring Critical Testing Scenarios for Decision-Making Policies: An LLM Approach9 Dec 2024
- 2024LAMBDA: Covering the Multimodal Critical Scenarios for Automated Driving Systems by Search Space Quantization30 Nov 2024
- 2024Rate-Informed Discovery via Bayesian Adaptive Multifidelity Sampling26 Nov 2024
- 2024Foundation Models for Rapid Autonomy Validation22 Oct 2024
- 2024Learning to Drive via Asymmetric Self-Play26 Sep 2024
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review21 Sep 2024
- 2024SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generation16 Sep 2024
- 2024ASTPrompter: Preference-Aligned Automated Language Model Red-Teaming to Generate Low-Perplexity Unsafe Prompts12 Jul 2024
- 2024Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllers21 May 2024
- 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Study20 Mar 2024
- 2024Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learning29 Feb 2024
- 2024A novel framework for adaptive stress testing of autonomous vehicles in multi-lane roads19 Feb 2024
- 2023STEAM & MoSAFE: SOTIF Error-and-Failure Model & Analysis for AI-Enabled Driving Automation15 Dec 2023
- 2023Attacking Motion Planners Using Adversarial Perception Errors21 Nov 2023
- 2023Generating Transferable Adversarial Simulation Scenarios for Self-Driving via Neural Rendering27 Sep 2023
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curricula25 Sep 2023
- 2023SAVME: Efficient Safety Validation for Autonomous Systems Using Meta-Learning21 Sep 2023
- 2023Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehicles1 Sep 2023
- 2023ReMAV: Reward Modeling of Autonomous Vehicles for Finding Likely Failure Events28 Aug 2023
- 2023Model-based Validation as Probabilistic Inference17 May 2023
- 2023Conveying Autonomous Robot Capabilities through Contrasting Behaviour Summaries1 Apr 2023
- 2023Adaptive Failure Search Using Critical States from Domain Experts1 Apr 2023
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning27 Feb 2023
- 2022Curiosity creates Diversity in Policy Search7 Dec 2022
- 2022A Deep Reinforcement Learning Approach to Rare Event Estimation22 Nov 2022
- 2022Self-Improving Safety Performance of Reinforcement Learning Based Driving with Black-Box Verification Algorithms29 Oct 2022
- 2022Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systems27 Oct 2022
- 2022An Active Learning Reliability Method for Systems with Partially Defined Performance Functions5 Oct 2022
50 newest of 70 All 70 (JSON)
- 2021Corner Case Generation and Analysis for Safety Assessment of Autonomous Vehiclescited by 27
- 2021Neural Network Guided Evolutionary Fuzzing for Finding Traffic Violations of Autonomous Vehiclescited by 19
- 2022How Do We Fail? Stress Testing Perception in Autonomous Vehiclescited by 17
- 2024Learning to Drive via Asymmetric Self-Playcited by 11
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policiescited by 10
- 2024SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generationcited by 10
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learningcited by 6
- 2021Building Safer Autonomous Agents by Leveraging Risky Driving Behavior Knowledgecited by 4
- 2022Self-Improving Safety Performance of Reinforcement Learning Based Driving with Black-Box Verification Algorithmscited by 4
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curriculacited by 4
- 2021ARC: Adversarially Robust Control Policies for Autonomous Vehiclescited by 3
- 2023Generating Transferable Adversarial Simulation Scenarios for Self-Driving via Neural Renderingcited by 3
12 most cited of 22 All 22 (JSON)
- 2026Importance Sampling and PCA for Finding Failures in Commercial Autonomous Vehicles20 Jul 2026
- 2026From Particles to Perils: SVGD-Based Hazardous Scenario Generation for Autonomous Driving Systems Testing20 Apr 2026
- 2026Risk-Controllable Multi-View Diffusion for Driving Scenario Generation12 Mar 2026
- 2025Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentions7 Mar 2025
- 2024Learning to Drive via Asymmetric Self-Play26 Sep 2024
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review21 Sep 2024
- 2024SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generation16 Sep 2024
- 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Study20 Mar 2024
- 2024A novel framework for adaptive stress testing of autonomous vehicles in multi-lane roads19 Feb 2024
- 2023Generating Transferable Adversarial Simulation Scenarios for Self-Driving via Neural Rendering27 Sep 2023
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curricula25 Sep 2023
- 2023Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehicles1 Sep 2023
12 newest of 22 All 22 (JSON)
- 2025Diffusion Models for Safety Validation of Autonomous Driving Systems10 Jun 2025
- 2025Controllable Latent Diffusion for Traffic Simulation14 Mar 2025
- 2026SPHINX: First Explain, Then Explorecited by 0
- 2026SPHINX: First Explain, Then Explore16 Jun 2026
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2022Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systemscited by 18
- 2021Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Reviewcited by 12
- 2021MDPFuzz: Testing Models Solving Markov Decision Processescited by 11
- 2024Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllerscited by 9
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systemscited by 8
- 2021Finding Failures in High-Fidelity Simulation using Adaptive Stress Testing and the Backward Algorithmcited by 7
- 2021Assisted Robust Reward Designcited by 5
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happencited by 5
- 2023Adaptive Failure Search Using Critical States from Domain Expertscited by 4
- 2021Certifiable Deep Importance Sampling for Rare-Event Simulation of Black-Box Systemscited by 3
- 2021Querying Labelled Data with Scenario Programs for Sim-to-Real Validationcited by 3
12 most cited of 42 All 42 (JSON)
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026Adaptive Sequential Test Planning for Multi-Mechanism Reliability Qualification via Bayesian Monte Carlo Tree Search10 Aug 2026
- 2026Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels28 Jul 2026
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development10 Jul 2026
- 2026CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generation5 Jul 2026
- 2026Scenario Generation for Testing of Autonomous Driving Systems Using Real-World Failure Records30 Jun 2026
- 2026Planetary Exploration 3.0: A Roadmap for Software-Defined, Radically Adaptive Space Systems22 Apr 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2025ScenicProver: A Framework for Compositional Probabilistic Verification of Learning-Enabled Systems4 Nov 2025
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
- 2025RADE: Learning Risk-Adjustable Driving Environment via Multi-Agent Conditional Diffusion6 May 2025
12 newest of 42 All 42 (JSON)