DICE: Diverse Diffusion Model with Scoring for Trajectory Prediction
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Road user trajectory prediction in dynamic environments is a challenging but crucial task for various applications, such as autonomous driving. One of the main challenges in this domain is the multimodal nature of future trajectories stemming from the unknown yet diverse intentions of the agents. Diffusion models have shown to be very effective in capturing such stochasticity in prediction tasks. However, these models involve many computationally expensive denoising steps and sampling operations that make them a less desirable option for real-time safety-critical applications. To this end, we present a novel framework that leverages diffusion models for predicting future trajectories in a computationally efficient manner. To minimize the computational bottlenecks in iterative sampling, we employ an efficient sampling mechanism that allows us to maximize the number of sampled trajectories for improved accuracy while maintaining inference time in real time. Moreover, we propose a scoring mechanism to select the most plausible trajectories by assigning relative ranks. We show the effectiveness of our approach by conducting empirical evaluations on common pedestrian (UCY/ETH) and autonomous driving (nuScenes) benchmark datasets on which our model achieves state-of-the-art performance on several subsets and metrics.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 52 of its 64 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
52 of 64 references.
Closest ancestors · 2
Same direction, newest first
- 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion4 Apr
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Prediction20 Mar
Other references · 50
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
38 more
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2022Diffusion Probabilistic Modeling for Video Generationcited by 237
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 210
- 2017Social Attention: Modeling Attention in Human Crowdscited by 185
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
- 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
- 2020Diverse and Admissible Trajectory Forecasting through Multimodal Context Understandingcited by 68
- 2020Recursive Social Behavior Graph for Trajectory Predictioncited by 66
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
- 2017Towards Deeper Understanding of Variational Autoencoding Modelscited by 56
- 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
- 2017Soft + Hardwired Attention: An LSTM Framework for Human Trajectory Prediction and Abnormal Event Detectioncited by 42
- 2020Bifold and Semantic Reasoning for Pedestrian Behavior Predictioncited by 31
- 2020Reciprocal Learning Networks for Human Trajectory Predictioncited by 30
- 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
- 2020Probabilistic Multi-modal Trajectory Prediction with Lane Attention for Autonomous Vehiclescited by 28
- 2022PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learningcited by 23
- 2022LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Predictioncited by 19
- 2023Uncertainty-Aware Pedestrian Trajectory Prediction via Distributional Diffusioncited by 13
Built on by
Citing papers per year: 2024: 5; 2025: 11; 2026: 2.
18 papers.
Sort:
By area:
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rolloutcited by 47
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Modelcited by 20
- 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Drivingcited by 17
- 2024Curb Your Attention: Causal Attention Gating for Robust Trajectory Prediction in Autonomous Drivingcited by 9
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrationscited by 5
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Modelscited by 5
- 2025Generative AI for Autonomous Driving: A Reviewcited by 3
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasetscited by 2
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
- 2025EP-Diffuser: An Efficient Diffusion Model for Traffic Scene Generation and Prediction via Polynomial Representationscited by 1
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Predictioncited by 1
6 more
- 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Predictioncited by 1
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectoriescited by 1
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Modelcited by 0
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsalscited by 0
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddingscited by 0
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Prediction2 Nov 2025
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model22 Sep 2025
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction10 Aug 2025
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction6 Aug 2025
- 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Driving5 Jul 2025
- 2025SceneDiffuser++: City-Scale Traffic Simulation via a Generative World Model27 Jun 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Models1 May 2025
6 more
- 2025EP-Diffuser: An Efficient Diffusion Model for Traffic Scene Generation and Prediction via Polynomial Representations7 Apr 2025
- 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout5 Dec 2024
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations3 Dec 2024
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving22 Nov 2024
- 2024Curb Your Attention: Causal Attention Gating for Robust Trajectory Prediction in Autonomous Driving23 Sep 2024
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasets1 May 2024
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rolloutcited by 47
- 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Drivingcited by 17
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Modelscited by 5
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
- 2025EP-Diffuser: An Efficient Diffusion Model for Traffic Scene Generation and Prediction via Polynomial Representationscited by 1
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Predictioncited by 1
- 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Predictioncited by 1
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Modelcited by 0
- 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Prediction2 Nov 2025
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model22 Sep 2025
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction10 Aug 2025
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction6 Aug 2025
- 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Driving5 Jul 2025
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Models1 May 2025
- 2025EP-Diffuser: An Efficient Diffusion Model for Traffic Scene Generation and Prediction via Polynomial Representations7 Apr 2025
- 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout5 Dec 2024
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving22 Nov 2024
- 2024Curb Your Attention: Causal Attention Gating for Robust Trajectory Prediction in Autonomous Drivingcited by 9
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrationscited by 5
- 2025Generative AI for Autonomous Driving: A Reviewcited by 3
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasetscited by 2
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectoriescited by 1
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsalscited by 0
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddingscited by 0
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsals12 May 2026
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations3 Dec 2024
- 2024Curb Your Attention: Causal Attention Gating for Robust Trajectory Prediction in Autonomous Driving23 Sep 2024
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasets1 May 2024
Similar, not cited
Close in wording, no citation either way
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting
- 2024ADM: Accelerated Diffusion Model via Estimated Priors for Robust Motion Prediction under Uncertainties
- 2024TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction
- 2023GDTS: Goal-Guided Diffusion Model with Tree Sampling for Multi-Modal Pedestrian Trajectory Prediction
- 2025Diffusion^2: Dual Diffusion Model with Uncertainty-Aware Adaptive Noise for Momentary Trajectory Prediction
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following
- 2025Diverse Controllable Diffusion Policy with Signal Temporal Logic