mlsanityData to 7 Oct 2026

Intention-aware Denoising Diffusion Model for Trajectory Prediction

arXiv 2403.09190 ↗First posted 14 Mar 2024cs.CV cs.AIcited by 11

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Trajectory prediction is an essential component in autonomous driving, particularly for collision avoidance systems. Considering the inherent uncertainty of the task, numerous studies have utilized generative models to produce multiple plausible future trajectories for each agent. However, most of them suffer from restricted representation ability or unstable training issues. To overcome these limitations, we propose utilizing the diffusion model to generate the distribution of future trajectories. Two cruxes are to be settled to realize such an idea. First, the diversity of intention is intertwined with the uncertain surroundings, making the true distribution hard to parameterize. Second, the diffusion process is time-consuming during the inference phase, rendering it unrealistic to implement in a real-time driving system. We propose an Intention-aware denoising Diffusion Model (IDM), which tackles the above two problems. We decouple the original uncertainty into intention uncertainty and action uncertainty and model them with two dependent diffusion processes. To decrease the inference time, we reduce the variable dimensions in the intention-aware diffusion process and restrict the initial distribution of the action-aware diffusion process, which leads to fewer diffusion steps. To validate our approach, we conduct experiments on the Stanford Drone Dataset (SDD) and ETH/UCY dataset. Our methods achieve state-of-the-art results, with an FDE of 13.83 pixels on the SDD dataset and 0.36 meters on the ETH/UCY dataset. Compared with the original diffusion model, IDM reduces inference time by two-thirds. Interestingly, our experiments further reveal that introducing intention information is beneficial in modeling the diffusion process of fewer steps.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 59 of its 102 references that are in the map. First posted on arXiv 14 Mar 2024.

Builds on

59 of 102 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Leapfrog Diffusion Model for Stochastic Trajectory Prediction20 Mar

Other references · 58

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  6. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  7. 2022Video Diffusion Modelscited by 2,280
  8. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  9. 2016Generative Adversarial Imitation Learningcited by 1,576
  10. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  11. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  12. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
38 more
  1. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  2. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  3. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  4. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
  5. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  6. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
  7. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  8. 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
  9. 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
  10. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  11. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
  12. 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
  13. 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
  14. 2019Human Motion Trajectory Prediction: A Surveycited by 231
  15. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
  16. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  17. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
  18. 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 166
  19. 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
  20. 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
  21. 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 104
  22. 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
  23. 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
  24. 2017Imitating Driver Behavior with Generative Adversarial Networkscited by 92
  25. 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
  26. 2019Conditional Generative Neural System for Probabilistic Trajectory Predictioncited by 76
  27. 2022Human Trajectory Prediction via Neural Social Physicscited by 66
  28. 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
  29. 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 63
  30. 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
  31. 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
  32. 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
  33. 2020Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimationcited by 57
  34. 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
  35. 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
  36. 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
  37. 2021Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspectivecited by 40
  38. 2019Analyzing the Variety Loss in the Context of Probabilistic Trajectory Predictioncited by 30

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 4.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following
  2. 2024Diffusion-Based Environment-Aware Trajectory Prediction
  3. 2025DiffRefiner: Coarse to Fine Trajectory Planning via Diffusion Refinement with Semantic Interaction for End to End Autonomous Driving
  4. 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting
  5. 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction
  6. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving
  7. 2025LAP: Fast LAtent Diffusion Planner for Autonomous Driving
  8. 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction