TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Accurate prediction of human or vehicle trajectories with good diversity that captures their stochastic nature is an essential task for many applications. However, many trajectory prediction models produce unreasonable trajectory samples that focus on improving diversity or accuracy while neglecting other key requirements, such as collision avoidance with the surrounding environment. In this work, we propose TrajDiffuse, a planning-based trajectory prediction method using a novel guided conditional diffusion model. We form the trajectory prediction problem as a denoising impaint task and design a map-based guidance term for the diffusion process. TrajDiffuse is able to generate trajectory predictions that match or exceed the accuracy and diversity of the SOTA, while adhering almost perfectly to environmental constraints. We demonstrate the utility of our model through experiments on the nuScenes and PFSD datasets and provide an extensive benchmark analysis against the SOTA methods.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 27 of its 36 references that are in the map. First posted on arXiv 14 Oct 2024.
Builds on
27 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Prediction20 Mar
- 2022Diffusion Policies as an Expressive Policy Class for Offline Reinforcement Learning12 Aug
Other references · 25
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2023Consistency Modelscited by 1,822
- 2018Group Normalizationcited by 1,524
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
13 more
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2022Understanding Diffusion Models: A Unified Perspectivecited by 340
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 337
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 229
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 213
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 167
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2019Mish: A Self Regularized Non-Monotonic Activation Functioncited by 141
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025ECAM: A Contrastive Learning Approach to Avoid Environmental Collision in Trajectory Forecastingcited by 2
- 2026ECTraj: Enhanced Consistency Training for Multi-Agent Trajectory Predictioncited by 0
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Predictioncited by 0
- 2026JPPD: Joint Prediction_Planning Diffusion with Differentiable Safety Guidance for Dynamic Obstacle Avoidance in Intelligent Transportation Systemscited by 0
- 2026JPPD: Joint Prediction_Planning Diffusion with Differentiable Safety Guidance for Dynamic Obstacle Avoidance in Intelligent Transportation Systems14 Jun 2026
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Prediction12 May 2026
- 2026ECTraj: Enhanced Consistency Training for Multi-Agent Trajectory Prediction9 May 2026
- 2025ECAM: A Contrastive Learning Approach to Avoid Environmental Collision in Trajectory Forecasting11 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Prediction
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting
- 2025One Fits All: General Mobility Trajectory Modeling via Masked Conditional Diffusion
- 2024Diffusion-Based Environment-Aware Trajectory Prediction
- 2026DiffuSearch: How Hybrid Trajectory Planning Benefits from Aligned Objectives in Diffusion and Action Space
- 2025DiffRefiner: Coarse to Fine Trajectory Planning via Diffusion Refinement with Semantic Interaction for End to End Autonomous Driving
- 2026Bridging Predictive Uncertainty and Safe Action: Sample-Conditioned Differentiable Planning for Autonomous Driving