mlsanityData to 14 Oct 2026

Causal Composition Diffusion Model for Closed-loop Traffic Generation

arXiv 2412.17920 ↗First posted 23 Dec 2024cs.AI cs.LG cs.ROcited by 22

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Simulation is critical for safety evaluation in autonomous driving, particularly in capturing complex interactive behaviors. However, generating realistic and controllable traffic scenarios in long-tail situations remains a significant challenge. Existing generative models suffer from the conflicting objective between user-defined controllability and realism constraints, which is amplified in safety-critical contexts. In this work, we introduce the Causal Compositional Diffusion Model (CCDiff), a structure-guided diffusion framework to address these challenges. We first formulate the learning of controllable and realistic closed-loop simulation as a constrained optimization problem. Then, CCDiff maximizes controllability while adhering to realism by automatically identifying and injecting causal structures directly into the diffusion process, providing structured guidance to enhance both realism and controllability. Through rigorous evaluations on benchmark datasets and in a closed-loop simulator, CCDiff demonstrates substantial gains over state-of-the-art approaches in generating realistic and user-preferred trajectories. Our results show CCDiff's effectiveness in extracting and leveraging causal structures, showing improved closed-loop performance based on key metrics such as collision rate, off-road rate, FDE, and comfort.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 38 of its 54 references that are in the map. First posted on arXiv 23 Dec 2024.

Builds on

38 of 54 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout5 Dec
  2. 2024AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusion11 Oct
  3. 2023Language-Guided Traffic Simulation via Scene-Level Diffusion10 Jun
  4. 2022Is Conditional Generative Modeling all you need for Decision-Making?28 Nov
  5. 2022Guided Conditional Diffusion for Controllable Traffic Simulation31 Oct

Other references · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2022Classifier-Free Diffusion Guidancecited by 5,847
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  5. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  6. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  7. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
  8. 2017Constrained Policy Optimizationcited by 983
  9. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 537
  10. 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 482
  11. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
  12. 2020Differentiable Causal Discovery from Interventional Datacited by 218
21 more
  1. 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 213
  2. 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 193
  3. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
  4. 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 139
  5. 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 137
  6. 2022A Survey on Safety-Critical Driving Scenario Generation -- A Methodological Perspectivecited by 105
  7. 2023Language Conditioned Traffic Generationcited by 87
  8. 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 84
  9. 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
  10. 2021SimNet: Learning Reactive Self-driving Simulations from Real-world Observationscited by 77
  11. 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligencecited by 58
  12. 2023Scenario Diffusion: Controllable Driving Scenario Generation With Diffusioncited by 47
  13. 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarioscited by 46
  14. 2021Human Trajectory Prediction via Counterfactual Analysiscited by 42
  15. 2021Learning Neural Causal Models with Active Interventionscited by 40
  16. 2021Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspectivecited by 40
  17. 2021CausalAF: Causal Autoregressive Flow for Safety-Critical Driving Scenario Generationcited by 20
  18. 2022CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationshipscited by 18
  19. 2021Causal Multi-Agent Reinforcement Learning: Review and Open Problemscited by 16
  20. 2023Gradient Shaping for Multi-Constraint Safe Reinforcement Learningcited by 10
  21. 2024Realistic Extreme Behavior Generation for Improved AV Testingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 12.

22 papers.

Sort:

By area:

  1. 2025Generative Trajectory Stitching through Diffusion Compositioncited by 41
  2. 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 38
  3. 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Surveycited by 29
  4. 2025Multi-Modal Manipulation via Multi-Modal Policy Consensuscited by 13
  5. 2025WaymoQA: A Multi-View Visual Question Answering Dataset for Safety-Critical Reasoning in Autonomous Drivingcited by 9
  6. 2026VILTA: A VLM-in-the-Loop Adversary for Enhancing Driving Policy Robustnesscited by 6
  7. 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulationcited by 4
  8. 2026CounterScene: Counterfactual Causal Reasoning in Generative World Models for Safety-Critical Closed-Loop Evaluationcited by 4
  9. 2026VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector Graphscited by 2
  10. 2025Learning from Risk: LLM-Guided Generation of Safety-Critical Scenarios with Prior Knowledgecited by 1
  11. 2025CAPE: Context-Aware Diffusion Policy Via Proximal Mode Expansion for Collision Avoidancecited by 1
  12. 2026A Generalizable Physics-guided Causal Model for Trajectory Prediction in Autonomous Drivingcited by 1
10 more
  1. 2025Drive As You Like: Multi-Head Diffusion with Reinforcement Learning for Personalized Drivingcited by 0
  2. 2025A Trajectory Generator for High-Density Traffic and Diverse Agent-Interaction Scenarioscited by 0
  3. 2026Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehiclescited by 0
  4. 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Trafficcited by 0
  5. 2026DeCoR: Design and Control Co-Optimization for Urban Streets Using Reinforcement Learningcited by 0
  6. 2026Sparse Compositional Flow Matching by geometric assembly from motion primitivescited by 0
  7. 2026Clinically-Grounded Counterfactual Reasoning for Medical Video Diagnosiscited by 0
  8. 2026RiskFlow: Fast and Faithful Safety-Critical Traffic Scenario Generationcited by 0
  9. 2026CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generationcited by 0
  10. 2026How Can Driving World Models Do Counterfactual Prediction?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Controllable Latent Diffusion for Traffic Simulation
  2. 2026Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation
  3. 2026One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation
  4. 2024Versatile Behavior Diffusion for Generalized Traffic Agent Simulation
  5. 2025BridgeDrive: Diffusion Bridge Policy for Closed-Loop Trajectory Planning in Autonomous Driving
  6. 2026ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation
  7. 2025Optimization-Guided Diffusion for Interactive Scene Generation
  8. 2024Data-driven Diffusion Models for Enhancing Safety in Autonomous Vehicle Traffic Simulations