Intention-aware Denoising Diffusion Model for Trajectory Prediction
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Trajectory prediction is an essential component in autonomous driving, particularly for collision avoidance systems. Considering the inherent uncertainty of the task, numerous studies have utilized generative models to produce multiple plausible future trajectories for each agent. However, most of them suffer from restricted representation ability or unstable training issues. To overcome these limitations, we propose utilizing the diffusion model to generate the distribution of future trajectories. Two cruxes are to be settled to realize such an idea. First, the diversity of intention is intertwined with the uncertain surroundings, making the true distribution hard to parameterize. Second, the diffusion process is time-consuming during the inference phase, rendering it unrealistic to implement in a real-time driving system. We propose an Intention-aware denoising Diffusion Model (IDM), which tackles the above two problems. We decouple the original uncertainty into intention uncertainty and action uncertainty and model them with two dependent diffusion processes. To decrease the inference time, we reduce the variable dimensions in the intention-aware diffusion process and restrict the initial distribution of the action-aware diffusion process, which leads to fewer diffusion steps. To validate our approach, we conduct experiments on the Stanford Drone Dataset (SDD) and ETH/UCY dataset. Our methods achieve state-of-the-art results, with an FDE of 13.83 pixels on the SDD dataset and 0.36 meters on the ETH/UCY dataset. Compared with the original diffusion model, IDM reduces inference time by two-thirds. Interestingly, our experiments further reveal that introducing intention information is beneficial in modeling the diffusion process of fewer steps.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 59 of its 102 references that are in the map. First posted on arXiv 14 Mar 2024.
Builds on
59 of 102 references.
Closest ancestors · 1
Same direction, newest first
Other references · 58
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Generative Adversarial Networkscited by 5,603
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2022Video Diffusion Modelscited by 2,280
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
38 more
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2022Flexible Diffusion Modeling of Long Videoscited by 294
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 166
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
- 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 104
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2017Imitating Driver Behavior with Generative Adversarial Networkscited by 92
- 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
- 2019Conditional Generative Neural System for Probabilistic Trajectory Predictioncited by 76
- 2022Human Trajectory Prediction via Neural Social Physicscited by 66
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 63
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
- 2020Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimationcited by 57
- 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
- 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2021Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspectivecited by 40
- 2019Analyzing the Variety Loss in the Context of Probabilistic Trajectory Predictioncited by 30
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 4.
11 papers.
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 66
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Modelscited by 5
- 2024Dynamic High-Order Control Barrier Functions with Diffuser for Safety-Critical Trajectory Planning at Signal-Free Intersectionscited by 4
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Predictioncited by 3
- 2024ADM: Accelerated Diffusion Model via Estimated Priors for Robust Motion Prediction under Uncertaintiescited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2025Agentic Satellite-Augmented Low-Altitude Economy and Terrestrial Networks: A Survey on Generative Approachescited by 2
- 2025DiffMOD: Progressive Diffusion Point Denoising for Moving Object Detection in Remote Sensingcited by 0
- 2026Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generationcited by 0
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematicscited by 0
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Drivingcited by 0
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Driving16 Aug 2026
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics28 Jul 2026
- 2026Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation25 Jun 2026
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction11 Apr 2026
- 2025Agentic Satellite-Augmented Low-Altitude Economy and Terrestrial Networks: A Survey on Generative Approaches19 Jul 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Models1 May 2025
- 2025DiffMOD: Progressive Diffusion Point Denoising for Moving Object Detection in Remote Sensing14 Apr 2025
- 2024Dynamic High-Order Control Barrier Functions with Diffuser for Safety-Critical Trajectory Planning at Signal-Free Intersections29 Nov 2024
- 2024ADM: Accelerated Diffusion Model via Estimated Priors for Robust Motion Prediction under Uncertainties1 May 2024
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Data29 Apr 2024
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following
- 2024Diffusion-Based Environment-Aware Trajectory Prediction
- 2025DiffRefiner: Coarse to Fine Trajectory Planning via Diffusion Refinement with Semantic Interaction for End to End Autonomous Driving
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving
- 2025LAP: Fast LAtent Diffusion Planner for Autonomous Driving
- 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction