Teach-to-Crash: A Closed-Loop Student-Teacher LLM Framework for Collision-Inducing Test Scenario Generation
Not on the map. Why?
Abstract (arXiv)
Validating Autonomous Driving Systems (ADS) in simulation requires testing architectures that can discover rare, safety-critical failures while generating scenarios that are executable, diverse, and useful for downstream failure analysis. We introduce Teach-to-Crash, a closed-loop testing framework that combines a constrained ego-centric scenario representation, stagnation-aware search control, and a dual-LLM architecture for adaptive failure discovery. A high-reasoning Teacher LLM acts as an adaptive search controller, while a low-reasoning Student LLM emits simulator-executable scenarios in a strict JSON schema. The Teacher intervenes only when rolling collision rate and time-to-collision metrics stagnate, providing strategic guidance to redirect the search. In a CARLA case study with two experimental setups that vary the ego vehicle's speed policy, Teach-to-Crash achieves the highest Collision Hit Rate (90.79%), the shortest mean Time-to-Collision (18.31 s), and a competitive Collision Discovery Rate (136.21). PAFOT attains a higher mean CDR (179.44), but with substantially larger variance. Teach-to-Crash also yields the highest diversity (0.547) and, averaged across both setups on the CARLA Traffic Manager controller, the highest avoidability-based usefulness proxy (60.04%) among the compared methods. These results, within the evaluated CARLA scope, provide evidence that closed-loop dual-LLM reasoning can steer adversarial simulation-based testing over a constrained executable program space, generating failures that are frequent, structurally diverse, and assessed as more frequently avoidable.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 43 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
14 of 43 references.
References · 14
- 2022Guided Conditional Diffusion for Controllable Traffic Simulationcited by 189
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 136
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehiclescited by 92
- 2018Scenic: A Language for Scenario Specification and Scene Generationcited by 79
- 2020Adversarial Evaluation of Autonomous Vehicles in Lane-Change Scenarioscited by 42
- 2019Failure-Scenario Maker for Rule-Based Agent using Multi-agent Adversarial Reinforcement Learning and its Application to Autonomous Drivingcited by 36
- 2024ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObilitycited by 34
- 2017Compositional Falsification of Cyber-Physical Systems with Machine Learning Componentscited by 31
- 2020Training Adversarial Agents to Exploit Weaknesses in Deep Control Policiescited by 24
- 2024Revisiting OPRO: The Limitations of Small-Scale LLMs as Optimizerscited by 14
- 2023TARGET: Automated Scenario Generation from Traffic Rules for Testing Autonomous Vehicles via Validated LLM-Guided Knowledge Extractioncited by 9
- 2023Reinforcement Learning Informed Evolutionary Search for Autonomous Systems Testingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models
- 2025From Words to Collisions: LLM-Guided Evaluation and Adversarial Generation of Safety-Critical Driving Scenarios
- 2024Generating Critical Scenarios for Testing Automated Driving Systems
- 2026Learning Responsibility-Attributed Adversarial Scenarios for Testing Autonomous Vehicles
- 2023SAFR-AV: Safety Analysis of Autonomous Vehicles using Real World Data -- An end-to-end solution for real world data driven scenario-based testing for pre-certification of AV stacks
- 2026CrashDiffuser: VLM-Guided Collision Intent Reasoning for Fine-Grained Safety-Critical Traffic Scenario Generation
- 2026From Particles to Perils: SVGD-Based Hazardous Scenario Generation for Autonomous Driving Systems Testing
- 2026WM-Cov: Test Adequacy for Interactive World-Model-Style Autonomous Driving Simulation