AnchorDrive: LLM Scenario Rollout with Anchor-Guided Diffusion Regeneration for Safety-Critical Scenario Generation
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Autonomous driving systems require comprehensive evaluation in safety-critical scenarios to ensure safety and robustness. However, such scenarios are rare and difficult to collect from real-world driving data, necessitating simulation-based synthesis. Yet, existing methods often exhibit limitations in both controllability and realism. From a capability perspective, LLMs excel at controllable generation guided by natural language instructions, while diffusion models are better suited for producing trajectories consistent with realistic driving distributions. Leveraging their complementary strengths, we propose AnchorDrive, a two-stage safety-critical scenario generation framework. In the first stage, we deploy an LLM as a driver agent within a closed-loop simulation, which reasons and iteratively outputs control commands under natural language constraints; a plan assessor reviews these commands and provides corrective feedback, enabling semantically controllable scenario generation. In the second stage, the LLM extracts key anchor points from the first-stage trajectories as guidance objectives, which jointly with other guidance terms steer the diffusion model to regenerate complete trajectories with improved realism while preserving user-specified intent. Experiments on the highD dataset demonstrate that AnchorDrive achieves superior overall performance in criticality, realism, and controllability, validating its effectiveness for generating controllable and realistic safety-critical scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 37 of its 49 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
37 of 49 references.
Closest ancestors · 5
Same direction, newest first
- 2025LD-Scene: LLM-Guided Diffusion for Controllable Generation of Adversarial Safety-Critical Driving Scenarios16 May
- 2023SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries31 Dec
- 2023Language-Guided Traffic Simulation via Scene-Level Diffusion10 Jun
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion4 Apr
- 2022Guided Conditional Diffusion for Controllable Traffic Simulation31 Oct
Other references · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2023GPT-4 Technical Reportcited by 18,132
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2022Video Diffusion Modelscited by 2,280
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
20 more
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 210
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 204
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Modelscited by 158
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 136
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2022A Survey on Safety-Critical Driving Scenario Generation -- A Methodological Perspectivecited by 100
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradientscited by 95
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehiclescited by 92
- 2023Language Conditioned Traffic Generationcited by 86
- 2020Learning to Collide: An Adaptive Safety-Critical Scenarios Generating Methodcited by 74
- 2024AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learningcited by 40
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
- 2024Versatile Behavior Diffusion for Generalized Traffic Agent Simulationcited by 30
- 2023Rethinking Closed-loop Training for Autonomous Drivingcited by 29
- 2019CMTS: Conditional Multiple Trajectory Synthesizer for Generating Safety-critical Driving Scenarioscited by 19
- 2024Large Language Models for Human-like Autonomous Driving: A Surveycited by 14
- 2019Efficient Autonomy Validation in Simulation with Adaptive Stress Testingcited by 13
- 2024Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarioscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025VLM as Strategist: Adaptive Generation of Safety-critical Testing Scenarios via Guided Diffusion
- 2026PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving
- 2026ScenePilot: Controllable Boundary-Driven Critical Scenario Generation for Autonomous Driving
- 2025BridgeDrive: Diffusion Bridge Policy for Closed-Loop Trajectory Planning in Autonomous Driving
- 2026One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation
- 2025Do LLM Modules Generalize? A Study on Motion Generation for Autonomous Driving
- 2026AlignDrive: Aligned Lateral-Longitudinal Planning for End-to-End Autonomous Driving
- 2024Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Models