mlsanityData to 7 Oct 2026

TSDiT: Traffic Scene Diffusion Models With Transformers

arXiv 2405.02289 ↗First posted 21 Dec 2023cs.ROcited by 1

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

In this paper, we introduce a novel approach to trajectory generation for autonomous driving, combining the strengths of Diffusion models and Transformers. First, we use the historical trajectory data for efficient preprocessing and generate action latent using a diffusion model with DiT(Diffusion with Transformers) Blocks to increase scene diversity and stochasticity of agent actions. Then, we combine action latent, historical trajectories and HD Map features and put them into different transformer blocks. Finally, we use a trajectory decoder to generate future trajectories of agents in the traffic scene. The method exhibits superior performance in generating smooth turning trajectories, enhancing the model's capability to fit complex steering patterns. The experimental results demonstrate the effectiveness of our method in producing realistic and diverse trajectories, showcasing its potential for application in autonomous vehicle navigation systems.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 10 of its 11 references that are in the map. First posted on arXiv 21 Dec 2023.

Builds on

10 of 11 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Language-Guided Traffic Simulation via Scene-Level Diffusion10 Jun
  2. 2022Guided Conditional Diffusion for Controllable Traffic Simulation31 Oct

Other references · 8

  1. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  3. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
  4. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  5. 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
  6. 2023The Waymo Open Sim Agents Challengecited by 86
  7. 2023Multiverse Transformer: 1st Place Solution for Waymo Open Sim Agents Challenge 2023cited by 25
  8. 2023Generating Driving Scenes with Diffusioncited by 16

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024WcDT: World-centric Diffusion Transformer for Traffic Scene Generation
  2. 2025TransDiffuser: Diverse Trajectory Generation with Decorrelated Multi-modal Representation for End-to-end Autonomous Driving
  3. 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting
  4. 2025Path Diffuser: Diffusion Model for Data-Driven Traffic Simulator
  5. 2024Diffusion-Based Environment-Aware Trajectory Prediction
  6. 2023SceneDM: Scene-level Multi-agent Trajectory Generation with Consistent Diffusion Models
  7. 2023Scenario Diffusion: Controllable Driving Scenario Generation With Diffusion
  8. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving