CaDRE: Controllable and Diverse Generation of Safety-Critical Driving Scenarios using Real-World Trajectories
On the map: End-to-end autonomous driving → Adversarial scenarios and safety testing
Abstract (arXiv)
Simulation is an indispensable tool in the development and testing of autonomous vehicles (AVs), offering an efficient and safe alternative to road testing. An outstanding challenge with simulation-based testing is the generation of safety-critical scenarios, which are essential to ensure that AVs can handle rare but potentially fatal situations. This paper addresses this challenge by introducing a novel framework, CaDRE, to generate realistic, diverse, and controllable safety-critical scenarios. Our approach optimizes for both the quality and diversity of scenarios by employing a unique formulation and algorithm that integrates real-world scenarios, domain knowledge, and black-box optimization. We validate the effectiveness of our framework through extensive testing in three representative types of traffic scenarios. The results demonstrate superior performance in generating diverse and high-quality scenarios with greater sample efficiency than existing reinforcement learning (RL) and sampling-based methods.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Adversarial scenarios and safety testing, one of 9 directions in End-to-end autonomous driving. Builds on 45 of its 59 references that are in the map. First posted on arXiv 19 Mar 2024.
Builds on
45 of 59 references.
Closest ancestors · 2
Same direction, newest first
- 2023CAT: Closed-loop Adversarial Training for Safe End-to-End Driving19 Oct
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehicles20 Jun
Other references · 43
- 2023GPT-4 Technical Reportcited by 18,396
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
- 2015Illuminating search spaces by mapping elitescited by 425
- 2016The CMA Evolution Strategy: A Tutorialcited by 377
- 2014Robots that can adapt like animalscited by 204
- 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 193
- 2022Guided Conditional Diffusion for Controllable Traffic Simulationcited by 190
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Researchcited by 160
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 137
- 2023Language-Guided Traffic Simulation via Scene-Level Diffusioncited by 111
- 2022TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarioscited by 106
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradientscited by 96
31 more
- 2023Language Conditioned Traffic Generationcited by 87
- 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 84
- 2019Covariance Matrix Adaptation for the Rapid Illumination of Behavior Spacecited by 78
- 2021Differentiable Quality Diversitycited by 72
- 2023ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modelingcited by 60
- 2020Multimodal Safety-Critical Scenarios Generation for Decision-Making Algorithms Evaluationcited by 55
- 2022AdvDO: Realistic Adversarial Attacks for Trajectory Predictioncited by 49
- 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarioscited by 46
- 2017Stein Variational Policy Gradientcited by 44
- 2023Creative Robot Tool Use with Large Language Modelscited by 43
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 36
- 2022Generalizing Goal-Conditioned Reinforcement Learning with Variational Causal Reasoningcited by 34
- 2023pyribs: A Bare-Bones Python Library for Quality Diversity Optimizationcited by 30
- 2022Robust Reinforcement Learning as a Stackelberg Game via Adaptively-Regularized Adversarial Trainingcited by 28
- 2022Curriculum Reinforcement Learning using Optimal Transport via Gradual Domain Adaptationcited by 28
- 2023What Went Wrong? Closing the Sim-to-Real Gap via Differentiable Causal Discoverycited by 27
- 2023Learning Realistic Traffic Agents in Closed-loopcited by 24
- 2020A Quality Diversity Approach to Automatically Generating Human-Robot Interaction Scenarios in Shared Autonomycited by 20
- 2019CMTS: Conditional Multiple Trajectory Synthesizer for Generating Safety-critical Driving Scenarioscited by 19
- 2022Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curriculacited by 17
- 2020MAP-Elites enables Powerful Stepping Stones and Diversity for Modular Roboticscited by 11
- 2022Automatic Acquisition of a Repertoire of Diverse Grasping Trajectories through Behavior Shaping and Novelty Searchcited by 9
- 2023SafeShift: Safety-Informed Distribution Shifts for Robust Trajectory Prediction in Autonomous Drivingcited by 9
- 2023Surrogate Assisted Generation of Human-Robot Interaction Scenarioscited by 8
- 2022Group Distributionally Robust Reinforcement Learning with Hierarchical Latent Variablescited by 7
- 2018A New Multi-vehicle Trajectory Generator to Simulate Vehicle-to-Vehicle Encounterscited by 5
- 2021Seeking Quality Diversity in Evolutionary Co-design of Morphology and Control of Soft Tensegrity Modular Robotscited by 5
- 2024Speeding up 6-DoF Grasp Sampling with Quality-Diversitycited by 4
- 2024Workspace Optimization Techniques to Improve Prediction of Human Motion During Human-Robot Collaborationcited by 3
- 2021Scalable Safety-Critical Policy Evaluation with Accelerated Rare Event Samplingcited by 2
- 2022Efficient Learning of Locomotion Skills through the Discovery of Diverse Environmental Trajectory Generator Priorscited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 3; 2026: 4.
11 papers.
- 2024SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generationcited by 10
- 2026VILTA: A VLM-in-the-Loop Adversary for Enhancing Driving Policy Robustnesscited by 6
- 2025CrashAgent: Crash Scenario Generation via Multi-modal Reasoningcited by 5
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Reviewcited by 3
- 2025Controllable Collision Scenario Generation via Collision Pattern Predictioncited by 3
- 2024Edge Case Detection in Automated Driving: Methods, Challenges, and Future Directionscited by 2
- 2024Algorithmic Scenario Generation as Quality Diversity Optimizationcited by 1
- 2025Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarioscited by 1
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Trafficcited by 0
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generationcited by 0
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generationcited by 0
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026VILTA: A VLM-in-the-Loop Adversary for Enhancing Driving Policy Robustness19 Jan 2026
- 2025Controllable Collision Scenario Generation via Collision Pattern Prediction14 Oct 2025
- 2025CrashAgent: Crash Scenario Generation via Multi-modal Reasoning23 May 2025
- 2025Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarios31 Mar 2025
- 2024Edge Case Detection in Automated Driving: Methods, Challenges, and Future Directions11 Oct 2024
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review21 Sep 2024
- 2024SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generation16 Sep 2024
- 2024Algorithmic Scenario Generation as Quality Diversity Optimization7 Sep 2024
Similar, not cited
Close in wording, no citation either way
- 2024Generating Critical Scenarios for Testing Automated Driving Systems
- 2023Continual Driving Policy Optimization with Closed-Loop Individualized Curricula
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning
- 2024Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generation
- 2026SaFeR: Safety-Critical Scenario Generation for Autonomous Driving Test via Feasibility-Constrained Token Resampling
- 2022Exiting the Simulation: The Road to Robust and Resilient Autonomous Vehicles at Scale
- 2025VLM as Strategist: Adaptive Generation of Safety-critical Testing Scenarios via Guided Diffusion
- 2026ScenePilot: Controllable Boundary-Driven Critical Scenario Generation for Autonomous Driving