Adaptive Stress Testing with Reward Augmentation for Autonomous Vehicle Validation
Not on the map. Why?
Abstract (arXiv)
Determining possible failure scenarios is a critical step in the evaluation of autonomous vehicle systems. Real-world vehicle testing is commonly employed for autonomous vehicle validation, but the costs and time requirements are high. Consequently, simulation-driven methods such as Adaptive Stress Testing (AST) have been proposed to aid in validation. AST formulates the problem of finding the most likely failure scenarios as a Markov decision process, which can be solved using reinforcement learning. In practice, AST tends to find scenarios where failure is unavoidable and tends to repeatedly discover the same types of failures of a system. This work addresses these issues by encoding domain relevant information into the search procedure. With this modification, the AST method discovers a larger and more expressive subset of the failure space when compared to the original AST formulation. We show that our approach is able to identify useful failure scenarios of an autonomous vehicle policy.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 9; 2024: 6; 2025: 5; 2026: 3.
33 papers.
Sort:
By area:
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehiclescited by 21
- 2022Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systemscited by 18
- 2021Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Reviewcited by 12
- 2024Learning to Drive via Asymmetric Self-Playcited by 11
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policiescited by 10
- 2024Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllerscited by 9
- 2021Safety of the Intended Driving Behavior Using Rulebookscited by 8
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learningcited by 6
- 2022Risk-Driven Design of Perception Systemscited by 4
- 2023Adaptive Failure Search Using Critical States from Domain Expertscited by 4
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curriculacited by 4
21 more
- 2022Sample-Based Bounds for Coherent Risk Measures: Applications to Policy Synthesis and Verificationcited by 3
- 2023Model-based Validation as Probabilistic Inferencecited by 3
- 2023DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Datacited by 3
- 2022A Deep Reinforcement Learning Approach to Rare Event Estimationcited by 2
- 2024Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learningcited by 2
- 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Studycited by 2
- 2025AED: Automatic Discovery of Effective and Diverse Vulnerabilities for Autonomous Driving Policy with Large Language Modelscited by 2
- 2022Rationale-aware Autonomous Driving Policy utilizing Safety Force Field implemented on CARLA Simulatorcited by 1
- 2023Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehiclescited by 1
- 2023Attacking Motion Planners Using Adversarial Perception Errorscited by 1
- 2024A novel framework for adaptive stress testing of autonomous vehicles in multi-lane roadscited by 1
- 2024Generating Critical Scenarios for Testing Automated Driving Systemscited by 1
- 2025Characterizing the Robustness of Black-Box LLM Planners Under Perturbed Observations with Adaptive Stress Testingcited by 1
- 2023Conveying Autonomous Robot Capabilities through Contrasting Behaviour Summariescited by 0
- 2023ReMAV: Reward Modeling of Autonomous Vehicles for Finding Likely Failure Eventscited by 0
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0
- 2025Efficient Safety Testing of Autonomous Vehicles via Adaptive Search over Crash-Derived Scenarioscited by 0
- 2025Aircraft Collision Avoidance Systems: Technological Challenges and Solutions on the Path to Regulatory Acceptancecited by 0
- 2026Importance Sampling and PCA for Finding Failures in Commercial Autonomous Vehiclescited by 0
- 2026Adaptive Sequential Test Planning for Multi-Mechanism Reliability Qualification via Bayesian Monte Carlo Tree Searchcited by 0
- 2026Coverage Aware Active Evaluation for Failure Discovery with Paired Systemscited by 0
- 2026Coverage Aware Active Evaluation for Failure Discovery with Paired Systems13 Aug 2026
- 2026Adaptive Sequential Test Planning for Multi-Mechanism Reliability Qualification via Bayesian Monte Carlo Tree Search10 Aug 2026
- 2026Importance Sampling and PCA for Finding Failures in Commercial Autonomous Vehicles20 Jul 2026
- 2025Aircraft Collision Avoidance Systems: Technological Challenges and Solutions on the Path to Regulatory Acceptance23 Oct 2025
- 2025Efficient Safety Testing of Autonomous Vehicles via Adaptive Search over Crash-Derived Scenarios7 Aug 2025
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2025Characterizing the Robustness of Black-Box LLM Planners Under Perturbed Observations with Adaptive Stress Testing8 May 2025
- 2025AED: Automatic Discovery of Effective and Diverse Vulnerabilities for Autonomous Driving Policy with Large Language Models24 Mar 2025
- 2024Generating Critical Scenarios for Testing Automated Driving Systems3 Dec 2024
- 2024Learning to Drive via Asymmetric Self-Play26 Sep 2024
- 2024Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllers21 May 2024
- 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Study20 Mar 2024
21 more
- 2024Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learning29 Feb 2024
- 2024A novel framework for adaptive stress testing of autonomous vehicles in multi-lane roads19 Feb 2024
- 2023Attacking Motion Planners Using Adversarial Perception Errors21 Nov 2023
- 2023DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Data8 Oct 2023
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curricula25 Sep 2023
- 2023Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehicles1 Sep 2023
- 2023ReMAV: Reward Modeling of Autonomous Vehicles for Finding Likely Failure Events28 Aug 2023
- 2023Model-based Validation as Probabilistic Inference17 May 2023
- 2023Conveying Autonomous Robot Capabilities through Contrasting Behaviour Summaries1 Apr 2023
- 2023Adaptive Failure Search Using Critical States from Domain Experts1 Apr 2023
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning27 Feb 2023
- 2022A Deep Reinforcement Learning Approach to Rare Event Estimation22 Nov 2022
- 2022Rationale-aware Autonomous Driving Policy utilizing Safety Force Field implemented on CARLA Simulator18 Nov 2022
- 2022Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systems27 Oct 2022
- 2022Risk-Driven Design of Perception Systems21 May 2022
- 2022Sample-Based Bounds for Coherent Risk Measures: Applications to Policy Synthesis and Verification21 Apr 2022
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policies22 Dec 2021
- 2021Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Review16 Oct 2021
- 2021Safety of the Intended Driving Behavior Using Rulebooks10 May 2021
- 2021Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehicles12 Mar 2021
- 2021Explainability of deep vision-based autonomous driving systems: Review and challenges13 Jan 2021
- 2024Learning to Drive via Asymmetric Self-Playcited by 11
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policiescited by 10
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learningcited by 6
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curriculacited by 4
- 2023DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Datacited by 3
- 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Studycited by 2
- 2025AED: Automatic Discovery of Effective and Diverse Vulnerabilities for Autonomous Driving Policy with Large Language Modelscited by 2
- 2022Rationale-aware Autonomous Driving Policy utilizing Safety Force Field implemented on CARLA Simulatorcited by 1
- 2023Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehiclescited by 1
- 2024A novel framework for adaptive stress testing of autonomous vehicles in multi-lane roadscited by 1
- 2024Generating Critical Scenarios for Testing Automated Driving Systemscited by 1
- 2026Importance Sampling and PCA for Finding Failures in Commercial Autonomous Vehiclescited by 0
- 2026Importance Sampling and PCA for Finding Failures in Commercial Autonomous Vehicles20 Jul 2026
- 2025AED: Automatic Discovery of Effective and Diverse Vulnerabilities for Autonomous Driving Policy with Large Language Models24 Mar 2025
- 2024Generating Critical Scenarios for Testing Automated Driving Systems3 Dec 2024
- 2024Learning to Drive via Asymmetric Self-Play26 Sep 2024
- 2024Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Study20 Mar 2024
- 2024A novel framework for adaptive stress testing of autonomous vehicles in multi-lane roads19 Feb 2024
- 2023DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Data8 Oct 2023
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curricula25 Sep 2023
- 2023Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehicles1 Sep 2023
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning27 Feb 2023
- 2022Rationale-aware Autonomous Driving Policy utilizing Safety Force Field implemented on CARLA Simulator18 Nov 2022
- 2021Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policies22 Dec 2021
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Generating and Characterizing Scenarios for Safety Testing of Autonomous Vehiclescited by 21
- 2022Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systemscited by 18
- 2021Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Reviewcited by 12
- 2024Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllerscited by 9
- 2021Safety of the Intended Driving Behavior Using Rulebookscited by 8
- 2022Risk-Driven Design of Perception Systemscited by 4
- 2023Adaptive Failure Search Using Critical States from Domain Expertscited by 4
- 2022Sample-Based Bounds for Coherent Risk Measures: Applications to Policy Synthesis and Verificationcited by 3
- 2023Model-based Validation as Probabilistic Inferencecited by 3
- 2022A Deep Reinforcement Learning Approach to Rare Event Estimationcited by 2
- 2024Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learningcited by 2
12 most cited of 20 All 20 (JSON)
- 2026Coverage Aware Active Evaluation for Failure Discovery with Paired Systems13 Aug 2026
- 2026Adaptive Sequential Test Planning for Multi-Mechanism Reliability Qualification via Bayesian Monte Carlo Tree Search10 Aug 2026
- 2025Aircraft Collision Avoidance Systems: Technological Challenges and Solutions on the Path to Regulatory Acceptance23 Oct 2025
- 2025Efficient Safety Testing of Autonomous Vehicles via Adaptive Search over Crash-Derived Scenarios7 Aug 2025
- 2025Characterizing the Robustness of Black-Box LLM Planners Under Perturbed Observations with Adaptive Stress Testing8 May 2025
- 2024Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllers21 May 2024
- 2024Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learning29 Feb 2024
- 2023Attacking Motion Planners Using Adversarial Perception Errors21 Nov 2023
- 2023ReMAV: Reward Modeling of Autonomous Vehicles for Finding Likely Failure Events28 Aug 2023
- 2023Model-based Validation as Probabilistic Inference17 May 2023
- 2023Conveying Autonomous Robot Capabilities through Contrasting Behaviour Summaries1 Apr 2023
- 2023Adaptive Failure Search Using Critical States from Domain Experts1 Apr 2023
12 newest of 20 All 20 (JSON)