Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Review
Not on the map. Why?
Abstract (arXiv)
Scenario-based approaches have been receiving a huge amount of attention in research and engineering of automated driving systems. Due to the complexity and uncertainty of the driving environment, and the complexity of the driving task itself, the number of possible driving scenarios that an ADS or ADAS may encounter is virtually infinite. Therefore it is essential to be able to reason about the identification of scenarios and in particular critical ones that may impose unacceptable risk if not considered. Critical scenarios are particularly important to support design, verification and validation efforts, and as a basis for a safety case. In this paper, we present the results of a systematic literature review in the context of autonomous driving. The main contributions are: (i) introducing a comprehensive taxonomy for critical scenario identification methods; (ii) giving an overview of the state-of-the-art research based on the taxonomy encompassing 86 papers between 2017 and 2020; and (iii) identifying open issues and directions for further research. The provided taxonomy comprises three main perspectives encompassing the problem definition (the why), the solution (the methods to derive scenarios), and the assessment of the established scenarios. In addition, we discuss open research issues considering the perspectives of coverage, practicability, and scenario space explosion.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 31 of its 178 references that are in the map. First posted on arXiv 16 Oct 2021.
Builds on
31 of 178 references.
References · 31
- 2018A Tutorial on Bayesian Optimizationcited by 744
- 2017Deep Reinforcement Learning: An Overviewcited by 333
- 2017DeepXplore: Automated Whitebox Testing of Deep Learning Systemscited by 311
- 2017DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Carscited by 251
- 2016Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?cited by 194
- 2017On a Formal Model of Safe and Scalable Self-driving Carscited by 131
- 2017Augmented Reality Meets Computer Vision : Efficient Data Generation for Urban Driving Scenescited by 122
- 2018Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulationcited by 77
- 2019Adaptive Stress Testing for Autonomous Vehiclescited by 71
- 2020A Survey of Algorithms for Black-Box Safety Validation of Cyber-Physical Systemscited by 71
- 2018Scenarios for Development, Test and Validation of Automated Vehiclescited by 48
- 2016Accelerated Evaluation of Automated Vehicles Safety in Lane Change Scenarios Based on Importance Sampling Techniquescited by 45
19 more
- 2019Liability, Ethics, and Culture-Aware Behavior Specification using Rulebookscited by 43
- 2019Towards Corner Case Detection for Autonomous Drivingcited by 39
- 2019Adaptive Stress Testing with Reward Augmentation for Autonomous Vehicle Validationcited by 33
- 2017Compositional Falsification of Cyber-Physical Systems with Machine Learning Componentscited by 32
- 2018Simulation-based Adversarial Test Generation for Autonomous Vehicles with Machine Learning Componentscited by 29
- 2016Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Explorationcited by 26
- 2019Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodologycited by 25
- 2020Training Adversarial Agents to Exploit Weaknesses in Deep Control Policiescited by 24
- 2019Requirements-driven Test Generation for Autonomous Vehicles with Machine Learning Componentscited by 18
- 2019ML-based Fault Injection for Autonomous Vehicles: A Case for Bayesian Fault Injectioncited by 16
- 2020Fundamental Considerations around Scenario-Based Testing for Automated Drivingcited by 15
- 2019Efficient Autonomy Validation in Simulation with Adaptive Stress Testingcited by 13
- 2019Testing Scenario Library Generation for Connected and Automated Vehicles, Part II: Case Studiescited by 10
- 2018Using control synthesis to generate corner cases: A case study on autonomous drivingcited by 6
- 2019Performance Boundary Identification for the Evaluation of Automated Vehicles using Gaussian Process Classificationcited by 5
- 2019An Agency-Directed Approach to Test Generation for Simulation-based Autonomous Vehicle Verificationcited by 5
- 2020Safety Challenges for Autonomous Vehicles in the Absence of Connectivitycited by 5
- 2017Sequential Experimentation to Efficiently Test Automated Vehiclescited by 4
- 2019Architecting Safety Supervisors for High Levels of Automated Drivingcited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 2; 2024: 3; 2025: 0; 2026: 1.
12 papers.
- 2021A Survey on Scenario-Based Testing for Automated Driving Systems in High-Fidelity Simulationcited by 21
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generationcited by 19
- 2022Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verificationcited by 14
- 2022Space, Time, and Interaction: A Taxonomy of Corner Cases in Trajectory Datasets for Automated Drivingcited by 7
- 2024A-BDD: Leveraging Data Augmentations for Safe Autonomous Driving in Adverse Weather and Lightingcited by 3
- 2022ECSAS: Exploring Critical Scenarios from Action Sequence in Autonomous Drivingcited by 2
- 2022Learning Critical Scenarios in Feedback Control Systems for Automated Drivingcited by 1
- 2023Attacking Motion Planners Using Adversarial Perception Errorscited by 1
- 2024Generating Critical Scenarios for Testing Automated Driving Systemscited by 1
- 2022A Real-time Critical-scenario-generation Framework for Testing Autonomous Driving Systemcited by 0
- 2023Vectorized Scenario Description and Motion Prediction for Scenario-Based Testingcited by 0
- 2026Declarative Scenario-based Testing with RoadLogiccited by 0
- 2026Declarative Scenario-based Testing with RoadLogic10 Mar 2026
- 2024Generating Critical Scenarios for Testing Automated Driving Systems3 Dec 2024
- 2024A-BDD: Leveraging Data Augmentations for Safe Autonomous Driving in Adverse Weather and Lighting12 Aug 2024
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generation12 Apr 2024
- 2023Attacking Motion Planners Using Adversarial Perception Errors21 Nov 2023
- 2023Vectorized Scenario Description and Motion Prediction for Scenario-Based Testing2 Feb 2023
- 2022Space, Time, and Interaction: A Taxonomy of Corner Cases in Trajectory Datasets for Automated Driving17 Oct 2022
- 2022Learning Critical Scenarios in Feedback Control Systems for Automated Driving26 Sep 2022
- 2022ECSAS: Exploring Critical Scenarios from Action Sequence in Autonomous Driving21 Sep 2022
- 2022Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification3 Jun 2022
- 2022A Real-time Critical-scenario-generation Framework for Testing Autonomous Driving System2 Jun 2022
- 2021A Survey on Scenario-Based Testing for Automated Driving Systems in High-Fidelity Simulation2 Dec 2021