Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Prediction
Not on the map. Why?
Abstract (arXiv)
Probabilistic human motion prediction aims to forecast multiple possible future movements from past observations. While current approaches report high diversity and realism, they often generate motions with undetected limb stretching and jitter. To address this, we introduce SkeletonDiffusion, a latent diffusion model that embeds an explicit inductive bias on the human body within its architecture and training. Our model is trained with a novel nonisotropic Gaussian diffusion formulation that aligns with the natural kinematic structure of the human skeleton. Results show that our approach outperforms conventional isotropic alternatives, consistently generating realistic predictions while avoiding artifacts such as limb distortion. Additionally, we identify a limitation in commonly used diversity metrics, which may inadvertently favor models that produce inconsistent limb lengths within the same sequence. SkeletonDiffusion sets a new benchmark on real-world datasets, outperforming various baselines across multiple evaluation metrics. Visit our project page at https://ceveloper.github.io/publications/skeletondiffusion/ .
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 70 of its 95 references that are in the map. First posted on arXiv 10 Jan 2025.
Builds on
70 of 95 references.
References · 70
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
38 more
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2017On human motion prediction using recurrent neural networkscited by 336
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 251
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
- 2023SE(3) diffusion model with application to protein backbone generationcited by 214
- 2020Long-term Human Motion Prediction with Scene Contextcited by 191
- 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 184
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
- 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 164
- 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
- 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
- 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
- 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
- 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimizationcited by 115
- 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
- 2022Soft Diffusion: Score Matching for General Corruptionscited by 101
- 2021MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Predictioncited by 100
- 2022Accelerating Diffusion Models via Early Stop of the Diffusion Processcited by 100
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 99
- 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 97
- 2022Blurring Diffusion Modelscited by 89
- 2017The Pose Knows: Video Forecasting by Generating Pose Futurescited by 88
- 2018MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamicscited by 86
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
- 2019Diverse Trajectory Forecasting with Determinantal Point Processescited by 80
- 2017DeLiGAN : Generative Adversarial Networks for Diverse and Limited Datacited by 77
- 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2022Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Predictioncited by 66
- 2018Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objectivecited by 56
- 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 8.
12 papers.
- 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Modelscited by 35
- 2025CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flowcited by 4
- 2025TwoSquared: 4D Generation from 2D Image Pairscited by 3
- 2026Ordered Diffusion for 3D Human Registrationcited by 1
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniquescited by 0
- 2026SimpliHuMoN: Simplifying Human Motion Predictioncited by 0
- 2026KHMP: Frequency-Domain Kalman Refinement for High-Fidelity Human Motion Predictioncited by 0
- 2026Capturing Uncertainty in Human Motion for Representation Learning in Soccercited by 0
- 2026SPARC: Single-Pass Scaling for Motion Forecasting with Conformal Bayesian Last Layerscited by 0
- 2026Multi-Person Human Motion Forecasting in Complex Scenescited by 0
- 2026From Where to How: Continuous 4D Interaction Forecasting from Egocentric Videocited by 0
- 2026Skeletons in Flow: Graph Structured Flow Matching for Human Motion Predictioncited by 0
- 2026Skeletons in Flow: Graph Structured Flow Matching for Human Motion Prediction26 Sep 2026
- 2026From Where to How: Continuous 4D Interaction Forecasting from Egocentric Video8 Sep 2026
- 2026Multi-Person Human Motion Forecasting in Complex Scenes27 Aug 2026
- 2026SPARC: Single-Pass Scaling for Motion Forecasting with Conformal Bayesian Last Layers21 Aug 2026
- 2026Capturing Uncertainty in Human Motion for Representation Learning in Soccer11 Aug 2026
- 2026Ordered Diffusion for 3D Human Registration6 Aug 2026
- 2026KHMP: Frequency-Domain Kalman Refinement for High-Fidelity Human Motion Prediction22 Mar 2026
- 2026SimpliHuMoN: Simplifying Human Motion Prediction4 Mar 2026
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Models13 Aug 2025
- 2025CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flow19 May 2025
- 2025TwoSquared: 4D Generation from 2D Image Pairs17 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Model
- 2023Can We Use Diffusion Probabilistic Models for 3D Motion Prediction?
- 2023Realistic Human Motion Generation with Cross-Diffusion Models
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation
- 2026EquiFusion: Kinematics-Agnostic Human Motion Prediction via Equivariant Latent Diffusion
- 2024MacDiff: Unified Skeleton Modeling with Masked Conditional Diffusion
- 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Prediction
- 2024Multi-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Prediction