mlsanityData to 7 Oct 2026

DICE: Diverse Diffusion Model with Scoring for Trajectory Prediction

arXiv 2310.14570 ↗First posted 23 Oct 2023cs.CV cs.ROcited by 18

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Road user trajectory prediction in dynamic environments is a challenging but crucial task for various applications, such as autonomous driving. One of the main challenges in this domain is the multimodal nature of future trajectories stemming from the unknown yet diverse intentions of the agents. Diffusion models have shown to be very effective in capturing such stochasticity in prediction tasks. However, these models involve many computationally expensive denoising steps and sampling operations that make them a less desirable option for real-time safety-critical applications. To this end, we present a novel framework that leverages diffusion models for predicting future trajectories in a computationally efficient manner. To minimize the computational bottlenecks in iterative sampling, we employ an efficient sampling mechanism that allows us to maximize the number of sampled trajectories for improved accuracy while maintaining inference time in real time. Moreover, we propose a scoring mechanism to select the most plausible trajectories by assigning relative ranks. We show the effectiveness of our approach by conducting empirical evaluations on common pedestrian (UCY/ETH) and autonomous driving (nuScenes) benchmark datasets on which our model achieves state-of-the-art performance on several subsets and metrics.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 52 of its 64 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

52 of 64 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion4 Apr
  2. 2023Leapfrog Diffusion Model for Stochastic Trajectory Prediction20 Mar

Other references · 50

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  7. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  8. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  9. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  10. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  11. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  12. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
38 more
  1. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  2. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  3. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  4. 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
  5. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
  6. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
  7. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
  8. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
  9. 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
  10. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  11. 2022Diffusion Probabilistic Modeling for Video Generationcited by 237
  12. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
  13. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  14. 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 210
  15. 2017Social Attention: Modeling Attention in Human Crowdscited by 185
  16. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
  17. 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
  18. 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
  19. 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
  20. 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
  21. 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
  22. 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
  23. 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
  24. 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
  25. 2020Diverse and Admissible Trajectory Forecasting through Multimodal Context Understandingcited by 68
  26. 2020Recursive Social Behavior Graph for Trajectory Predictioncited by 66
  27. 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
  28. 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
  29. 2017Towards Deeper Understanding of Variational Autoencoding Modelscited by 56
  30. 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
  31. 2017Soft + Hardwired Attention: An LSTM Framework for Human Trajectory Prediction and Abnormal Event Detectioncited by 42
  32. 2020Bifold and Semantic Reasoning for Pedestrian Behavior Predictioncited by 31
  33. 2020Reciprocal Learning Networks for Human Trajectory Predictioncited by 30
  34. 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
  35. 2020Probabilistic Multi-modal Trajectory Prediction with Lane Attention for Autonomous Vehiclescited by 28
  36. 2022PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learningcited by 23
  37. 2022LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Predictioncited by 19
  38. 2023Uncertainty-Aware Pedestrian Trajectory Prediction via Distributional Diffusioncited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 11; 2026: 2.

18 papers.

Sort:

By area:

  1. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  2. 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rolloutcited by 47
  3. 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Modelcited by 20
  4. 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Drivingcited by 17
  5. 2024Curb Your Attention: Causal Attention Gating for Robust Trajectory Prediction in Autonomous Drivingcited by 9
  6. 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrationscited by 5
  7. 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Modelscited by 5
  8. 2025Generative AI for Autonomous Driving: A Reviewcited by 3
  9. 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasetscited by 2
  10. 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
  11. 2025EP-Diffuser: An Efficient Diffusion Model for Traffic Scene Generation and Prediction via Polynomial Representationscited by 1
  12. 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Predictioncited by 1
6 more
  1. 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Predictioncited by 1
  2. 2025Reverberation: Learning the Latencies Before Forecasting Trajectoriescited by 1
  3. 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0
  4. 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Modelcited by 0
  5. 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsalscited by 0
  6. 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddingscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting
  2. 2024ADM: Accelerated Diffusion Model via Estimated Priors for Robust Motion Prediction under Uncertainties
  3. 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction
  4. 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction
  5. 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Prediction
  6. 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Prediction
  7. 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following
  8. 2025Diverse Controllable Diffusion Policy with Signal Temporal Logic