A Survey on Safety-Critical Driving Scenario Generation -- A Methodological Perspective
Not on the map. Why?
Cited by 37 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Autonomous driving systems have witnessed a significant development during the past years thanks to the advance in machine learning-enabled sensing and decision-making algorithms. One critical challenge for their massive deployment in the real world is their safety evaluation. Most existing driving systems are still trained and evaluated on naturalistic scenarios collected from daily life or heuristically-generated adversarial ones. However, the large population of cars, in general, leads to an extremely low collision rate, indicating that the safety-critical scenarios are rare in the collected real-world data. Thus, methods to artificially generate scenarios become crucial to measure the risk and reduce the cost. In this survey, we focus on the algorithms of safety-critical scenario generation in autonomous driving. We first provide a comprehensive taxonomy of existing algorithms by dividing them into three categories: data-driven generation, adversarial generation, and knowledge-based generation. Then, we discuss useful tools for scenario generation, including simulation platforms and packages. Finally, we extend our discussion to five main challenges of current works -- fidelity, efficiency, diversity, transferability, controllability -- and research opportunities lighted up by these challenges.
Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Feb 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 14; 2024: 22; 2025: 35; 2026: 28.
100 papers.
Sort:
By area:
- 2023CAT: Closed-loop Adversarial Training for Safe End-to-End Drivingcited by 52
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
- 2023SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversariescited by 36
- 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspectivecited by 34
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Drivingcited by 30
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2024Causal Composition Diffusion Model for Closed-loop Traffic Generationcited by 22
- 2024AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusioncited by 20
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generationcited by 19
- 2023CoBEV: Elevating Roadside 3D Object Detection with Depth and Height Complementaritycited by 18
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failurescited by 17
38 more
- 2023Safety-aware Causal Representation for Trustworthy Offline Reinforcement Learning in Autonomous Drivingcited by 16
- 2025LLM-attacker: Enhancing Closed-loop Adversarial Scenario Generation for Autonomous Driving with Large Language Modelscited by 16
- 2023Dynamically Conservative Self-Driving Planner for Long-Tail Casescited by 13
- 2024FREA: Feasibility-Guided Generation of Safety-Critical Scenarios with Reasonable Adversarialitycited by 13
- 2025Robust Gymnasium: A Unified Modular Benchmark for Robust Reinforcement Learningcited by 12
- 2025CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Modelscited by 11
- 2024UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarioscited by 10
- 2024A Comprehensive Survey on Inverse Constrained Reinforcement Learning: Definitions, Progress and Challengescited by 10
- 2024SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generationcited by 10
- 2025LD-Scene: LLM-Guided Diffusion for Controllable Generation of Adversarial Safety-Critical Driving Scenarioscited by 9
- 2024Trustworthy Human-AI Collaboration: Reinforcement Learning with Human Feedback and Physics Knowledge for Safe Autonomous Drivingcited by 8
- 2025From Words to Collisions: LLM-Guided Evaluation and Adversarial Generation of Safety-Critical Driving Scenarioscited by 8
- 2023A Scenario-Based Functional Testing Approach to Improving DNN Performancecited by 7
- 2025DriveGen: Towards Infinite Diverse Traffic Scenarios with Large Modelscited by 7
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Modelscited by 7
- 2023From Model-Based to Data-Driven Simulation: Challenges and Trends in Autonomous Drivingcited by 6
- 2023Kinematics-aware Trajectory Generation and Prediction with Latent Stochastic Differential Modelingcited by 5
- 2025AGENTS-LLM: Augmentative GENeration of Challenging Traffic Scenarios with an Agentic LLM Frameworkcited by 5
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curriculacited by 4
- 2024DynamicPAE: Generating Scene-Aware Physical Adversarial Examples in Real-Timecited by 4
- 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulationcited by 4
- 2025AgentSGEN: Multi-Agent LLM in the Loop for Semantic Collaboration and GENeration of Synthetic Datacited by 4
- 2023Stackelberg Driver Model for Continual Policy Improvement in Scenario-Based Closed-Loop Autonomous Drivingcited by 3
- 2024Scenario-Based Curriculum Generation for Multi-Agent Autonomous Drivingcited by 3
- 2024Feasibility Consistent Representation Learning for Safe Reinforcement Learningcited by 3
- 2024Importance Sampling-Guided Meta-Training for Intelligent Agents in Highly Interactive Environmentscited by 3
- 2025HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generationcited by 3
- 2025Safety-Critical Traffic Simulation with Guided Latent Diffusion Modelcited by 3
- 2025Generative AI for Autonomous Driving: A Reviewcited by 3
- 2025RealDrive: Retrieval-Augmented Driving with Diffusion Modelscited by 3
- 2025AirTrafficGen: Configurable Air Traffic Scenario Generation with Large Language Modelscited by 3
- 2025Generative AI for Testing of Autonomous Driving Systems: A Surveycited by 3
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2025Controllable Collision Scenario Generation via Collision Pattern Predictioncited by 3
- 2026ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Drivingcited by 3
- 2026CounterScene: Counterfactual Causal Reasoning in Generative World Models for Safety-Critical Closed-Loop Evaluationcited by 3
- 2024ScenEval: A Benchmark for Scenario-Based Evaluation of Code Generationcited by 2
- 2024Dance of the ADS: Orchestrating Failures through Historically-Informed Scenario Fuzzingcited by 2
50 most cited of 100 All 100 (JSON)
- 2026Evaluating Physical Consistency and Plausibility in Generative Scenario Models for Autonomous Driving1 Oct 2026
- 2026REARL: A Closed-loop Autonomous Driving Simulation Enhancement Framework with Real Traffic Data and Large Language Models17 Sep 2026
- 2026PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving8 Sep 2026
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation4 Sep 2026
- 2026A Closed-Loop Evaluation of Capability Loss and Recovery in Compressed Driving Policies1 Sep 2026
- 2026Open-Source Autonomous Driving System Analysis and Multi-Disciplinary Hardware-in-the-Loop Research Paradigm with Reinforcement-Learning Testing and Large Language Models31 Aug 2026
- 2026Video2Track: From Real-World Interaction Videos to Steerable Adversarial Closed-Track Testing for Automated Driving Systems12 Aug 2026
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment5 Aug 2026
- 2026WM-Cov: Test Adequacy for Interactive World-Model-Style Autonomous Driving Simulation31 Jul 2026
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026Chat2Scenic: An Iterative RAG-Based Framework for Scenario Generation in Autonomous Driving15 Jul 2026
38 more
- 2026Robust 4D Driving Scene Reconstruction from Imperfect Visual Priors7 Jul 2026
- 2026CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generation5 Jul 2026
- 2026From Driving Videos to Simulatable Scenarios20 Jun 2026
- 2026AI Sandboxes: A Threat Model, Taxonomy, and Measurement Framework16 Jun 2026
- 2026ScenePilot: Controllable Boundary-Driven Critical Scenario Generation for Autonomous Driving20 May 2026
- 2026Learning Responsibility-Attributed Adversarial Scenarios for Testing Autonomous Vehicles13 May 2026
- 2026Conditional Flow-VAE for Safety-Critical Traffic Scenario Generation6 May 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026CounterScene: Counterfactual Causal Reasoning in Generative World Models for Safety-Critical Closed-Loop Evaluation22 Mar 2026
- 2026ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Driving16 Mar 2026
- 2026Emergency Lane-Change Simulation: A Behavioral Guidance Approach for Risky Scenario Generation8 Mar 2026
- 2026On the Strengths and Weaknesses of Data for Open-set Embodied Assistance5 Mar 2026
- 2026SaFeR: Safety-Critical Scenario Generation for Autonomous Driving Test via Feasibility-Constrained Token Resampling4 Mar 2026
- 2026AnchorDrive: LLM Scenario Rollout with Anchor-Guided Diffusion Regeneration for Safety-Critical Scenario Generation3 Mar 2026
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures1 Mar 2026
- 2026X-Blocks: Linguistic Building Blocks of Natural Language Explanations for Automated Vehicles2 Feb 2026
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directions9 Dec 2025
- 2025VLM as Strategist: Adaptive Generation of Safety-critical Testing Scenarios via Guided Diffusion2 Dec 2025
- 2025SocialDriveGen: Generating Diverse Traffic Scenarios with Controllable Social Interactions1 Dec 2025
- 2025Controllable risk scenario generation from human crash data for autonomous vehicle testing27 Nov 2025
- 2025SCOUT: A Lightweight Framework for Scenario Coverage Assessment in Autonomous Driving28 Oct 2025
- 2025Controllable Collision Scenario Generation via Collision Pattern Prediction14 Oct 2025
- 2025Falsification-driven reinforcement learning for maritime motion planning8 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025Generative AI for Testing of Autonomous Driving Systems: A Survey27 Aug 2025
- 2025DiCriTest: Testing Scenario Generation for Decision-Making Agents Considering Diversity and Criticality15 Aug 2025
- 2025AirTrafficGen: Configurable Air Traffic Scenario Generation with Large Language Models4 Aug 2025
- 2025Comparing Normalizing Flows with Kernel Density Estimation in Estimating Risk of Automated Driving Systems30 Jul 2025
- 2025Red-Team Multi-Agent Reinforcement Learning for Emergency Braking Scenario21 Jul 2025
- 2025AGENTS-LLM: Augmentative GENeration of Challenging Traffic Scenarios with an Agentic LLM Framework18 Jul 2025
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysis13 Jun 2025
- 2025RealDrive: Retrieval-Augmented Driving with Diffusion Models30 May 2025
- 2025From Failures to Fixes: LLM-Driven Scenario Repair for Self-Evolving Autonomous Driving28 May 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2025LD-Scene: LLM-Guided Diffusion for Controllable Generation of Adversarial Safety-Critical Driving Scenarios16 May 2025
- 2025AgentSGEN: Multi-Agent LLM in the Loop for Semantic Collaboration and GENeration of Synthetic Data7 May 2025
- 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulation6 May 2025
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models2 May 2025
50 newest of 100 All 100 (JSON)
- 2023CAT: Closed-loop Adversarial Training for Safe End-to-End Drivingcited by 52
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
- 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspectivecited by 34
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generationcited by 19
- 2023Safety-aware Causal Representation for Trustworthy Offline Reinforcement Learning in Autonomous Drivingcited by 16
- 2025LLM-attacker: Enhancing Closed-loop Adversarial Scenario Generation for Autonomous Driving with Large Language Modelscited by 16
- 2024SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generationcited by 10
- 2024Trustworthy Human-AI Collaboration: Reinforcement Learning with Human Feedback and Physics Knowledge for Safe Autonomous Drivingcited by 8
- 2025From Words to Collisions: LLM-Guided Evaluation and Adversarial Generation of Safety-Critical Driving Scenarioscited by 8
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curriculacited by 4
- 2023Stackelberg Driver Model for Continual Policy Improvement in Scenario-Based Closed-Loop Autonomous Drivingcited by 3
- 2025HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generationcited by 3
12 most cited of 28 All 28 (JSON)
- 2026REARL: A Closed-loop Autonomous Driving Simulation Enhancement Framework with Real Traffic Data and Large Language Models17 Sep 2026
- 2026PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving8 Sep 2026
- 2026A Closed-Loop Evaluation of Capability Loss and Recovery in Compressed Driving Policies1 Sep 2026
- 2026Open-Source Autonomous Driving System Analysis and Multi-Disciplinary Hardware-in-the-Loop Research Paradigm with Reinforcement-Learning Testing and Large Language Models31 Aug 2026
- 2026Video2Track: From Real-World Interaction Videos to Steerable Adversarial Closed-Track Testing for Automated Driving Systems12 Aug 2026
- 2026From Driving Videos to Simulatable Scenarios20 Jun 2026
- 2026ScenePilot: Controllable Boundary-Driven Critical Scenario Generation for Autonomous Driving20 May 2026
- 2026Learning Responsibility-Attributed Adversarial Scenarios for Testing Autonomous Vehicles13 May 2026
- 2026ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Driving16 Mar 2026
- 2026SaFeR: Safety-Critical Scenario Generation for Autonomous Driving Test via Feasibility-Constrained Token Resampling4 Mar 2026
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directions9 Dec 2025
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysis13 Jun 2025
12 newest of 28 All 28 (JSON)
- 2023SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversariescited by 36
- 2024Causal Composition Diffusion Model for Closed-loop Traffic Generationcited by 22
- 2024AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusioncited by 20
- 2025LD-Scene: LLM-Guided Diffusion for Controllable Generation of Adversarial Safety-Critical Driving Scenarioscited by 9
- 2025Safety-Critical Traffic Simulation with Guided Latent Diffusion Modelcited by 3
- 2025Controllable Latent Diffusion for Traffic Simulationcited by 1
- 2025VLM as Strategist: Adaptive Generation of Safety-critical Testing Scenarios via Guided Diffusioncited by 0
- 2026AnchorDrive: LLM Scenario Rollout with Anchor-Guided Diffusion Regeneration for Safety-Critical Scenario Generationcited by 0
- 2026One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulationcited by 0
- 2026One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation4 Sep 2026
- 2026AnchorDrive: LLM Scenario Rollout with Anchor-Guided Diffusion Regeneration for Safety-Critical Scenario Generation3 Mar 2026
- 2025VLM as Strategist: Adaptive Generation of Safety-critical Testing Scenarios via Guided Diffusion2 Dec 2025
- 2025LD-Scene: LLM-Guided Diffusion for Controllable Generation of Adversarial Safety-Critical Driving Scenarios16 May 2025
- 2025Safety-Critical Traffic Simulation with Guided Latent Diffusion Model1 May 2025
- 2025Controllable Latent Diffusion for Traffic Simulation14 Mar 2025
- 2024Causal Composition Diffusion Model for Closed-loop Traffic Generation23 Dec 2024
- 2024AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusion11 Oct 2024
- 2023SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries31 Dec 2023
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2026CounterScene: Counterfactual Causal Reasoning in Generative World Models for Safety-Critical Closed-Loop Evaluationcited by 3
- 2026Robust 4D Driving Scene Reconstruction from Imperfect Visual Priorscited by 0
- 2026WM-Cov: Test Adequacy for Interactive World-Model-Style Autonomous Driving Simulationcited by 0
- 2026WM-Cov: Test Adequacy for Interactive World-Model-Style Autonomous Driving Simulation31 Jul 2026
- 2026Robust 4D Driving Scene Reconstruction from Imperfect Visual Priors7 Jul 2026
- 2026CounterScene: Counterfactual Causal Reasoning in Generative World Models for Safety-Critical Closed-Loop Evaluation22 Mar 2026
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Drivingcited by 30
- 2025CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Modelscited by 11
- 2025SCOUT: A Lightweight Framework for Scenario Coverage Assessment in Autonomous Drivingcited by 0
- 2025SCOUT: A Lightweight Framework for Scenario Coverage Assessment in Autonomous Driving28 Oct 2025
- 2025CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Models21 Feb 2025
- 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Driving10 Dec 2024
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Modelscited by 7
- 2025RealDrive: Retrieval-Augmented Driving with Diffusion Modelscited by 3
- 2026Chat2Scenic: An Iterative RAG-Based Framework for Scenario Generation in Autonomous Drivingcited by 1
- 2026Chat2Scenic: An Iterative RAG-Based Framework for Scenario Generation in Autonomous Driving15 Jul 2026
- 2025RealDrive: Retrieval-Augmented Driving with Diffusion Models30 May 2025
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models2 May 2025
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2023CoBEV: Elevating Roadside 3D Object Detection with Depth and Height Complementaritycited by 18
- 2023Dynamically Conservative Self-Driving Planner for Long-Tail Casescited by 13
- 2024FREA: Feasibility-Guided Generation of Safety-Critical Scenarios with Reasonable Adversarialitycited by 13
- 2025Robust Gymnasium: A Unified Modular Benchmark for Robust Reinforcement Learningcited by 12
- 2024UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarioscited by 10
- 2024A Comprehensive Survey on Inverse Constrained Reinforcement Learning: Definitions, Progress and Challengescited by 10
- 2023A Scenario-Based Functional Testing Approach to Improving DNN Performancecited by 7
- 2025DriveGen: Towards Infinite Diverse Traffic Scenarios with Large Modelscited by 7
- 2023From Model-Based to Data-Driven Simulation: Challenges and Trends in Autonomous Drivingcited by 6
- 2023Kinematics-aware Trajectory Generation and Prediction with Latent Stochastic Differential Modelingcited by 5
12 most cited of 49 All 49 (JSON)
- 2026Evaluating Physical Consistency and Plausibility in Generative Scenario Models for Autonomous Driving1 Oct 2026
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment5 Aug 2026
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generation5 Jul 2026
- 2026AI Sandboxes: A Threat Model, Taxonomy, and Measurement Framework16 Jun 2026
- 2026Conditional Flow-VAE for Safety-Critical Traffic Scenario Generation6 May 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026Emergency Lane-Change Simulation: A Behavioral Guidance Approach for Risky Scenario Generation8 Mar 2026
- 2026On the Strengths and Weaknesses of Data for Open-set Embodied Assistance5 Mar 2026
- 2026X-Blocks: Linguistic Building Blocks of Natural Language Explanations for Automated Vehicles2 Feb 2026
- 2025SocialDriveGen: Generating Diverse Traffic Scenarios with Controllable Social Interactions1 Dec 2025
12 newest of 49 All 49 (JSON)