TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarios
Not on the map. Why?
Cited by 31 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Diverse and realistic traffic scenarios are crucial for evaluating the AI safety of autonomous driving systems in simulation. This work introduces a data-driven method called TrafficGen for traffic scenario generation. It learns from the fragmented human driving data collected in the real world and then can generate realistic traffic scenarios. TrafficGen is an autoregressive generative model with an encoder-decoder architecture. In each autoregressive iteration, it first encodes the current traffic context with the attention mechanism and then decodes a vehicle's initial state followed by generating its long trajectory. We evaluate the trained model in terms of vehicle placement and trajectories and show substantial improvements over baselines. TrafficGen can be also used to augment existing traffic scenarios, by adding new vehicles and extending the fragmented trajectories. We further demonstrate that importing the generated scenarios into a simulator as interactive training environments improves the performance and the safety of driving policy learned from reinforcement learning. More project resource is available at https://metadriverse.github.io/trafficgen
Key facts. Cited by 106 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Oct 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 19; 2024: 35; 2025: 31; 2026: 21.
106 papers.
Sort:
By area:
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Drivingcited by 93
- 2023Language Conditioned Traffic Generationcited by 87
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 54
- 2023Scenario Diffusion: Controllable Driving Scenario Generation With Diffusioncited by 47
- 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarioscited by 46
38 more
- 2024Solving Motion Planning Tasks with a Scalable Generative Modelcited by 40
- 2024Generative Artificial Intelligence: A Systematic Review and Applicationscited by 37
- 2024SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Predictioncited by 34
- 2024DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulationcited by 34
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 32
- 2023Data-driven Traffic Simulation: A Comprehensive Reviewcited by 29
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 28
- 2023DriveSceneGen: Generating Diverse and Realistic Driving Scenarios from Scratchcited by 27
- 2024Improving Agent Behaviors with RL Fine-tuning for Autonomous Drivingcited by 27
- 2023Multiverse Transformer: 1st Place Solution for Waymo Open Sim Agents Challenge 2023cited by 25
- 2023Learning Realistic Traffic Agents in Closed-loopcited by 24
- 2023SceneDM: Scene-level Multi-agent Trajectory Generation with Consistent Diffusion Modelscited by 24
- 2025Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistencycited by 22
- 2023Reinforcement Learning with Human Feedback for Realistic Traffic Simulationcited by 21
- 2024Promptable Closed-loop Traffic Simulationcited by 20
- 2024AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusioncited by 20
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Modelcited by 20
- 2024Language-Driven Interactive Traffic Trajectory Generationcited by 19
- 2025Compositional Generative Model of Unbounded 4D Citiescited by 17
- 2023Generating Driving Scenes with Diffusioncited by 16
- 2023Safety-Critical Scenario Generation Via Reinforcement Learning Based Editingcited by 16
- 2025Generative Models in Decision Making: A Surveycited by 15
- 2024Traffic Scene Generation from Natural Language Description for Autonomous Vehicles with Large Language Modelcited by 14
- 2024Extrapolated Urban View Synthesis Benchmarkcited by 13
- 2025CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Modelscited by 12
- 2025Generating Multimodal Driving Scenes via Next-Scene Predictioncited by 12
- 2025Decoupled Diffusion Sparks Adaptive Scene Generationcited by 12
- 2024CaDRE: Controllable and Diverse Generation of Safety-Critical Driving Scenarios using Real-World Trajectoriescited by 11
- 2024UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarioscited by 10
- 2024World Models: The Safety Perspectivecited by 9
- 2025Enhancing Autonomous Driving Safety with Collision Scenario Integrationcited by 9
- 2024Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Modelscited by 8
- 2023Prospective Role of Foundation Models in Advancing Autonomous Vehiclescited by 7
- 2024Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancementcited by 7
- 2025DriveGen: Towards Infinite Diverse Traffic Scenarios with Large Modelscited by 7
- 2025Continuous Locomotive Crowd Behavior Generationcited by 7
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Modelscited by 7
- 2024Reviving Life on the Edge: Joint Score-Based Graph Generation of Rich Edge Attributescited by 6
50 most cited of 106 All 106 (JSON)
- 2026Lamarck's Driving School: Discovering Autonomous Driving Training Strategies through Evolutionary Competition8 Oct 2026
- 2026How corner is a corner case? Percentile control for highway scenario generation4 Oct 2026
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation4 Sep 2026
- 2026BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation23 Aug 2026
- 2026Video2Track: From Real-World Interaction Videos to Steerable Adversarial Closed-Track Testing for Automated Driving Systems12 Aug 2026
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment5 Aug 2026
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generation5 Jul 2026
- 2026ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation1 Jul 2026
- 2026What Probing Reveals about Autonomous Driving: Linking Internal Prediction Errors to Ego Planning30 Jun 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
38 more
- 2026Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation25 Jun 2026
- 2026From Driving Videos to Simulatable Scenarios20 Jun 2026
- 2026SPHINX: First Explain, Then Explore16 Jun 2026
- 2026Improving Crash Frequency Prediction from Simulated Traffic Conflicts Using Machine Learning Based Microsimulation10 Jun 2026
- 2026Conditional Flow-VAE for Safety-Critical Traffic Scenario Generation6 May 2026
- 2026ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generation18 Apr 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector Graphs18 Mar 2026
- 2026Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving26 Feb 2026
- 2025SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restoration25 Dec 2025
- 2025Optimization-Guided Diffusion for Interactive Scene Generation8 Dec 2025
- 2025SocialDriveGen: Generating Diverse Traffic Scenarios with Controllable Social Interactions1 Dec 2025
- 2025Controllable risk scenario generation from human crash data for autonomous vehicle testing27 Nov 2025
- 2025A Trajectory Generator for High-Density Traffic and Diverse Agent-Interaction Scenarios3 Oct 2025
- 2025Path Diffuser: Diffusion Model for Data-Driven Traffic Simulator29 Sep 2025
- 2025LSD-3D: Large-Scale 3D Driving Scene Generation with Geometry Grounding26 Aug 2025
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles20 Aug 2025
- 2025ForeSight: Multi-View Streaming Joint Object Detection and Trajectory Forecasting9 Aug 2025
- 2025AirTrafficGen: Configurable Air Traffic Scenario Generation with Large Language Models4 Aug 2025
- 2025Diverse and Adaptive Behavior Curriculum for Autonomous Driving: A Student-Teacher Framework with Multi-Agent RL25 Jul 2025
- 2025SceneStreamer: Continuous Scenario Generation as Next Token Group Prediction29 Jun 2025
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Model27 Jun 2025
- 2025Long-term Traffic Simulation with Interleaved Autoregressive Motion and Scenario Generation20 Jun 2025
- 2025Realistic Urban Traffic Generator using Decentralized Federated Learning for the SUMO simulator9 Jun 2025
- 2025Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistency9 Jun 2025
- 2025Automatic Curriculum Learning for Driving Scenarios: Towards Robust and Efficient Reinforcement Learning13 May 2025
- 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulation6 May 2025
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models2 May 2025
- 2025Decoupled Diffusion Sparks Adaptive Scene Generation14 Apr 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environments28 Mar 2025
- 2025AccidentSim: Generating Vehicle Collision Videos with Physically Realistic Collision Trajectories from Real-World Accident Reports26 Mar 2025
- 2025Generating Multimodal Driving Scenes via Next-Scene Prediction19 Mar 2025
- 2025Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentions7 Mar 2025
- 2025Enhancing Autonomous Driving Safety with Collision Scenario Integration5 Mar 2025
- 2025DriveGen: Towards Infinite Diverse Traffic Scenarios with Large Models4 Mar 2025
- 2025Generative Models in Decision Making: A Survey24 Feb 2025
- 2025CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Models21 Feb 2025
50 newest of 106 All 106 (JSON)
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 32
- 2024Improving Agent Behaviors with RL Fine-tuning for Autonomous Drivingcited by 27
- 2025Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistencycited by 22
- 2024Traffic Scene Generation from Natural Language Description for Autonomous Vehicles with Large Language Modelcited by 14
- 2024CaDRE: Controllable and Diverse Generation of Safety-Critical Driving Scenarios using Real-World Trajectoriescited by 11
- 2025Enhancing Autonomous Driving Safety with Collision Scenario Integrationcited by 9
- 2024Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Modelscited by 8
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehiclescited by 5
- 2024Conversational Code Generation: a Case Study of Designing a Dialogue System for Generating Driving Scenarios for Testing Autonomous Vehiclescited by 4
- 2025Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentionscited by 4
12 most cited of 23 All 23 (JSON)
- 2026Video2Track: From Real-World Interaction Videos to Steerable Adversarial Closed-Track Testing for Automated Driving Systems12 Aug 2026
- 2026What Probing Reveals about Autonomous Driving: Linking Internal Prediction Errors to Ego Planning30 Jun 2026
- 2026From Driving Videos to Simulatable Scenarios20 Jun 2026
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles20 Aug 2025
- 2025Diverse and Adaptive Behavior Curriculum for Autonomous Driving: A Student-Teacher Framework with Multi-Agent RL25 Jul 2025
- 2025Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistency9 Jun 2025
- 2025Automatic Curriculum Learning for Driving Scenarios: Towards Robust and Efficient Reinforcement Learning13 May 2025
- 2025Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentions7 Mar 2025
- 2025Enhancing Autonomous Driving Safety with Collision Scenario Integration5 Mar 2025
- 2024Analyzing Closed-loop Training Techniques for Realistic Traffic Agent Models in Autonomous Highway Driving Simulations21 Oct 2024
- 2024Conversational Code Generation: a Case Study of Designing a Dialogue System for Generating Driving Scenarios for Testing Autonomous Vehicles13 Oct 2024
- 2024Improving Agent Behaviors with RL Fine-tuning for Autonomous Driving26 Sep 2024
12 newest of 23 All 23 (JSON)
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 28
- 2023SceneDM: Scene-level Multi-agent Trajectory Generation with Consistent Diffusion Modelscited by 24
- 2024AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusioncited by 20
- 2024ADM: Accelerated Diffusion Model via Estimated Priors for Robust Motion Prediction under Uncertaintiescited by 2
- 2025Optimization-Guided Diffusion for Interactive Scene Generationcited by 2
- 2025Path Diffuser: Diffusion Model for Data-Driven Traffic Simulatorcited by 0
- 2026Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generationcited by 0
- 2026One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulationcited by 0
- 2026One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation4 Sep 2026
- 2026Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation25 Jun 2026
- 2025Optimization-Guided Diffusion for Interactive Scene Generation8 Dec 2025
- 2025Path Diffuser: Diffusion Model for Data-Driven Traffic Simulator29 Sep 2025
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environments28 Mar 2025
- 2024AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusion11 Oct 2024
- 2024ADM: Accelerated Diffusion Model via Estimated Priors for Robust Motion Prediction under Uncertainties1 May 2024
- 2023SceneDM: Scene-level Multi-agent Trajectory Generation with Consistent Diffusion Models27 Nov 2023
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Modelcited by 20
- 2024World Models: The Safety Perspectivecited by 9
- 2025AccidentSim: Generating Vehicle Collision Videos with Physically Realistic Collision Trajectories from Real-World Accident Reportscited by 2
- 2026VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector Graphscited by 2
- 2026Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Drivingcited by 1
- 2026VectorWorld: Efficient Streaming World Model via Diffusion Flow on Vector Graphs18 Mar 2026
- 2026Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving26 Feb 2026
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Model27 Jun 2025
- 2025AccidentSim: Generating Vehicle Collision Videos with Physically Realistic Collision Trajectories from Real-World Accident Reports26 Mar 2025
- 2025A Survey of World Models for Autonomous Driving20 Jan 2025
- 2024World Models: The Safety Perspective12 Nov 2024
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar 2024
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2023Language Conditioned Traffic Generationcited by 87
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 54
- 2023Scenario Diffusion: Controllable Driving Scenario Generation With Diffusioncited by 47
- 2024Solving Motion Planning Tasks with a Scalable Generative Modelcited by 40
- 2024Generative Artificial Intelligence: A Systematic Review and Applicationscited by 37
- 2024SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Predictioncited by 34
- 2024DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulationcited by 34
- 2023Data-driven Traffic Simulation: A Comprehensive Reviewcited by 29
- 2023DriveSceneGen: Generating Diverse and Realistic Driving Scenarios from Scratchcited by 27
12 most cited of 61 All 61 (JSON)
- 2026Lamarck's Driving School: Discovering Autonomous Driving Training Strategies through Evolutionary Competition8 Oct 2026
- 2026How corner is a corner case? Percentile control for highway scenario generation4 Oct 2026
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation23 Aug 2026
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment5 Aug 2026
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026CCFM: Collision-Constrained Flow Matching for Safety-Critical Scenario Generation5 Jul 2026
- 2026ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation1 Jul 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Improving Crash Frequency Prediction from Simulated Traffic Conflicts Using Machine Learning Based Microsimulation10 Jun 2026
- 2026Conditional Flow-VAE for Safety-Critical Traffic Scenario Generation6 May 2026
- 2026ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generation18 Apr 2026
12 newest of 61 All 61 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Prior
- 2024Data-driven Diffusion Models for Enhancing Safety in Autonomous Vehicle Traffic Simulations
- 2025Learning from Risk: LLM-Guided Generation of Safety-Critical Scenarios with Prior Knowledge
- 2025Generative AI for Autonomous Driving: A Review
- 2024Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors
- 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
- 2025Generative Modeling for Adversarial Lane-Change Scenarios ↗
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Driving