mlsanityData to 7 Oct 2026

Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Prediction

arXiv 2501.06035 ↗First posted 10 Jan 2025cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Probabilistic human motion prediction aims to forecast multiple possible future movements from past observations. While current approaches report high diversity and realism, they often generate motions with undetected limb stretching and jitter. To address this, we introduce SkeletonDiffusion, a latent diffusion model that embeds an explicit inductive bias on the human body within its architecture and training. Our model is trained with a novel nonisotropic Gaussian diffusion formulation that aligns with the natural kinematic structure of the human skeleton. Results show that our approach outperforms conventional isotropic alternatives, consistently generating realistic predictions while avoiding artifacts such as limb distortion. Additionally, we identify a limitation in commonly used diversity metrics, which may inadvertently favor models that produce inconsistent limb lengths within the same sequence. SkeletonDiffusion sets a new benchmark on real-world datasets, outperforming various baselines across multiple evaluation metrics. Visit our project page at https://ceveloper.github.io/publications/skeletondiffusion/ .

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 70 of its 95 references that are in the map. First posted on arXiv 10 Jan 2025.

Builds on

70 of 95 references.

References · 70

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2017Graph Attention Networkscited by 8,854
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  9. 2019Root Mean Square Layer Normalizationcited by 1,425
  10. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  11. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  12. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
38 more
  1. 2021Score-based Generative Modeling in Latent Spacecited by 634
  2. 2017On human motion prediction using recurrent neural networkscited by 336
  3. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
  4. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  5. 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 251
  6. 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
  7. 2019Human Motion Trajectory Prediction: A Surveycited by 231
  8. 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
  9. 2023SE(3) diffusion model with application to protein backbone generationcited by 214
  10. 2020Long-term Human Motion Prediction with Scene Contextcited by 191
  11. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 184
  12. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  13. 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
  14. 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 164
  15. 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
  16. 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
  17. 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
  18. 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
  19. 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimizationcited by 115
  20. 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
  21. 2022Soft Diffusion: Score Matching for General Corruptionscited by 101
  22. 2021MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Predictioncited by 100
  23. 2022Accelerating Diffusion Models via Early Stop of the Diffusion Processcited by 100
  24. 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 99
  25. 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 97
  26. 2022Blurring Diffusion Modelscited by 89
  27. 2017The Pose Knows: Video Forecasting by Generating Pose Futurescited by 88
  28. 2018MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamicscited by 86
  29. 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
  30. 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
  31. 2019Diverse Trajectory Forecasting with Determinantal Point Processescited by 80
  32. 2017DeLiGAN : Generative Adversarial Networks for Diverse and Limited Datacited by 77
  33. 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
  34. 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
  35. 2022Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Predictioncited by 66
  36. 2018Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objectivecited by 56
  37. 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
  38. 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 8.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model
  2. 2023Can We Use Diffusion Probabilistic Models for 3D Motion Prediction?
  3. 2023Realistic Human Motion Generation with Cross-Diffusion Models
  4. 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation
  5. 2026EquiFusion: Kinematics-Agnostic Human Motion Prediction via Equivariant Latent Diffusion
  6. 2024MacDiff: Unified Skeleton Modeling with Masked Conditional Diffusion
  7. 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Prediction
  8. 2024Multi-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Prediction