Learning Human Motion Prediction via Stochastic Differential Equations
Not on the map. Why?
Abstract (arXiv)
Human motion understanding and prediction is an integral aspect in our pursuit of machine intelligence and human-machine interaction systems. Current methods typically pursue a kinematics modeling approach, relying heavily upon prior anatomical knowledge and constraints. However, such an approach is hard to generalize to different skeletal model representations, and also tends to be inadequate in accounting for the dynamic range and complexity of motion, thus hindering predictive accuracy. In this work, we propose a novel approach in modeling the motion prediction problem based on stochastic differential equations and path integrals. The motion profile of each skeletal joint is formulated as a basic stochastic variable and modeled with the Langevin equation. We develop a strategy of employing GANs to simulate path integrals that amounts to optimizing over possible future paths. We conduct experiments in two large benchmark datasets, Human 3.6M and CMU MoCap. It is highlighted that our approach achieves a 12.48% accuracy improvement over current state-of-the-art methods in average.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 11 of its 38 references that are in the map. First posted on arXiv 21 Dec 2021.
Builds on
11 of 38 references.
References · 11
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2017On human motion prediction using recurrent neural networkscited by 336
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
- 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
- 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
- 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
- 2019Graph Adversarial Training: Dynamically Regularizing Based on Graph Structurecited by 93
- 2020Dynamic GCN: Context-enriched Topology Learning for Skeleton-based Action Recognitioncited by 82
- 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
- 2021Aggregated Multi-GANs for Controlled 3D Human Motion Predictioncited by 23
- 2020Dynamic Future Net: Diversified Human Motion Generationcited by 14
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 2; 2025: 1; 2026: 2.
11 papers.
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchorscited by 34
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Spacecited by 32
- 20223D Human Motion Prediction: A Surveycited by 30
- 2022Learning Constrained Dynamic Correlations in Spatiotemporal Graphs for Motion Predictioncited by 7
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 4
- 2025HVIS: A Human-like Vision and Inference System for Human Motion Predictioncited by 3
- 2024Towards Practical Human Motion Prediction with LiDAR Point Cloudscited by 2
- 2023Motion-DVAE: Unsupervised learning for fast human motion denoisingcited by 1
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editingcited by 1
- 2023Personalized Pose Forecastingcited by 0
- 2024AdvMT: Adversarial Motion Transformer for Long-term Human Motion Predictioncited by 0
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing17 Aug 2026
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning29 May 2026
- 2025HVIS: A Human-like Vision and Inference System for Human Motion Prediction24 Feb 2025
- 2024Towards Practical Human Motion Prediction with LiDAR Point Clouds15 Aug 2024
- 2024AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction10 Jan 2024
- 2023Personalized Pose Forecasting6 Dec 2023
- 2023Motion-DVAE: Unsupervised learning for fast human motion denoising9 Jun 2023
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors9 Feb 2023
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Space15 Jul 2022
- 2022Learning Constrained Dynamic Correlations in Spatiotemporal Graphs for Motion Prediction4 Apr 2022
- 20223D Human Motion Prediction: A Survey3 Mar 2022