3D Human Motion Prediction: A Survey
Not on the map. Why?
Abstract (arXiv)
3D human motion prediction, predicting future poses from a given sequence, is an issue of great significance and challenge in computer vision and machine intelligence, which can help machines in understanding human behaviors. Due to the increasing development and understanding of Deep Neural Networks (DNNs) and the availability of large-scale human motion datasets, the human motion prediction has been remarkably advanced with a surge of interest among academia and industrial community. In this context, a comprehensive survey on 3D human motion prediction is conducted for the purpose of retrospecting and analyzing relevant works from existing released literature. In addition, a pertinent taxonomy is constructed to categorize these existing approaches for 3D human motion prediction. In this survey, relevant methods are categorized into three categories: human pose representation, network structure design, and textitprediction target. We systematically review all relevant journal and conference papers in the field of human motion prediction since 2015, which are presented in detail based on proposed categorizations in this survey. Furthermore, the outline for the public benchmark datasets, evaluation criteria, and performance comparisons are respectively presented in this paper. The limitations of the state-of-the-art methods are discussed as well, hoping for paving the way for future explorations.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 42 of its 114 references that are in the map. First posted on arXiv 3 Mar 2022.
Builds on
42 of 114 references.
References · 42
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
- 2017On human motion prediction using recurrent neural networkscited by 336
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2014Recurrent Neural Network Regularizationcited by 189
- 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 184
- 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
- 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 164
30 more
- 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
- 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
- 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
- 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
- 2017Deep representation learning for human motion prediction and classificationcited by 97
- 2020A Survey on Generative Adversarial Networks: Variants, Applications, and Trainingcited by 97
- 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
- 2018Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Drivingcited by 90
- 2018A Neural Temporal Model for Human Motion Predictioncited by 87
- 2019Context-aware Human Motion Predictioncited by 83
- 2019Machine Learning at the Network Edge: A Surveycited by 83
- 2017Learning Human Motion Models for Long-term Predictionscited by 67
- 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
- 2021Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformerscited by 46
- 2018Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamiccited by 41
- 2021Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Predictioncited by 36
- 2021Multi-level Motion Attention for Human Motion Predictioncited by 35
- 2019Human Motion Prediction via Learning Local Structure Representations and Temporal Dependenciescited by 34
- 2020MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistencycited by 31
- 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Predictioncited by 30
- 2021Aggregated Multi-GANs for Controlled 3D Human Motion Predictioncited by 23
- 2019PVRED: A Position-Velocity Recurrent Encoder-Decoder for Human Motion Predictioncited by 20
- 2022Motion Prediction via Joint Dependency Modeling in Phase Spacecited by 16
- 2020Multitask Non-Autoregressive Model for Human Motion Predictioncited by 15
- 2021Learning Human Motion Prediction via Stochastic Differential Equationscited by 11
- 2021Learning Multiscale Correlations for Human Motion Predictioncited by 9
- 2020Adversarial Refinement Network for Human Motion Predictioncited by 3
- 2021Probabilistic Human Motion Prediction via A Bayesian Neural Networkcited by 2
- 2017Classification-based RNN machine translation using GRUscited by 1
- 2018Streaming Voice Query Recognition using Causal Convolutional Recurrent Neural Networkscited by 1
Built on by
Citing papers per year: 2022: 3; 2023: 6; 2024: 6; 2025: 10; 2026: 5.
30 papers.
Sort:
By area:
- 2023Human Motion Generation: A Surveycited by 95
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Predictioncited by 12
- 2023A Survey on Deep Learning Techniques for Action Anticipationcited by 11
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Modelscited by 11
- 2024Human Action Anticipation: A Surveycited by 8
- 2025Text-driven Motion Generation: Overview, Challenges and Directionscited by 8
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
- 2024Multi-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Predictioncited by 6
- 20253D Human Interaction Generation: A Surveycited by 6
- 2024Context-based Interpretable Spatio-Temporal Graph Convolutional Network for Human Motion Forecastingcited by 5
- 2024Self-Supervised Skeleton-Based Action Representation Learning: A Benchmark and Beyondcited by 5
18 more
- 2022DMMGAN: Diverse Multi Motion Prediction of 3D Human Joints using Attention-Based Generative Adverserial Networkcited by 4
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 4
- 2023Leveraging Driver Field-of-View for Multimodal Ego-Trajectory Predictioncited by 2
- 2023Recent Advances in Deterministic Human Motion Prediction: A Reviewcited by 1
- 2024Fooling Neural Networks for Motion Forecasting via Adversarial Attackscited by 1
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forwardcited by 1
- 2025GraphEnet: Event-driven Human Pose Estimation with a Graph Neural Networkcited by 1
- 2025MMCM: Multimodality-aware Metric using Clustering-based Modes for Probabilistic Human Motion Predictioncited by 1
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editingcited by 1
- 2022STPOTR: Simultaneous Human Trajectory and Pose Prediction Using a Non-Autoregressive Transformer for Robot Following Aheadcited by 0
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehiclecited by 0
- 2023Personalized Pose Forecastingcited by 0
- 2024AdvMT: Adversarial Motion Transformer for Long-term Human Motion Predictioncited by 0
- 2025A Real-Time Human Action Recognition Model for Assisted Livingcited by 0
- 2025Pattern-Guided Diffusion Modelscited by 0
- 2026MoPO: Incorporating Motion Prior for Occluded Human Mesh Recoverycited by 0
- 2026Scene-aware Prediction of Diverse Human Movement Goalscited by 0
- 2026KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Humcited by 0
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing17 Aug 2026
- 2026KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum16 Aug 2026
- 2026Scene-aware Prediction of Diverse Human Movement Goals29 Jun 2026
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning29 May 2026
- 2026MoPO: Incorporating Motion Prior for Occluded Human Mesh Recovery11 May 2026
- 2025Pattern-Guided Diffusion Models15 Dec 2025
- 2025MMCM: Multimodality-aware Metric using Clustering-based Modes for Probabilistic Human Motion Prediction19 Nov 2025
- 2025GraphEnet: Event-driven Human Pose Estimation with a Graph Neural Network9 Oct 2025
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarks7 Jul 2025
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forward31 May 2025
- 2025Text-driven Motion Generation: Overview, Challenges and Directions14 May 2025
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Models7 Apr 2025
18 more
- 2025A Real-Time Human Action Recognition Model for Assisted Living18 Mar 2025
- 20253D Human Interaction Generation: A Survey17 Mar 2025
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Prediction10 Jan 2025
- 2024Human Action Anticipation: A Survey17 Oct 2024
- 2024Self-Supervised Skeleton-Based Action Representation Learning: A Benchmark and Beyond5 Jun 2024
- 2024Multi-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Prediction29 May 2024
- 2024Fooling Neural Networks for Motion Forecasting via Adversarial Attacks7 Mar 2024
- 2024Context-based Interpretable Spatio-Temporal Graph Convolutional Network for Human Motion Forecasting21 Feb 2024
- 2024AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction10 Jan 2024
- 2023Leveraging Driver Field-of-View for Multimodal Ego-Trajectory Prediction13 Dec 2023
- 2023Recent Advances in Deterministic Human Motion Prediction: A Review11 Dec 2023
- 2023Personalized Pose Forecasting6 Dec 2023
- 2023A Survey on Deep Learning Techniques for Action Anticipation29 Sep 2023
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
- 2023Human Motion Generation: A Survey20 Jul 2023
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction25 Nov 2022
- 2022STPOTR: Simultaneous Human Trajectory and Pose Prediction Using a Non-Autoregressive Transformer for Robot Following Ahead15 Sep 2022
- 2022DMMGAN: Diverse Multi Motion Prediction of 3D Human Joints using Attention-Based Generative Adverserial Network13 Sep 2022
- 2023Human Motion Generation: A Surveycited by 95
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Predictioncited by 12
- 2023A Survey on Deep Learning Techniques for Action Anticipationcited by 11
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Modelscited by 11
- 2024Human Action Anticipation: A Surveycited by 8
- 2025Text-driven Motion Generation: Overview, Challenges and Directionscited by 8
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarkscited by 8
- 20253D Human Interaction Generation: A Surveycited by 6
- 2024Context-based Interpretable Spatio-Temporal Graph Convolutional Network for Human Motion Forecastingcited by 5
- 2024Self-Supervised Skeleton-Based Action Representation Learning: A Benchmark and Beyondcited by 5
- 2022DMMGAN: Diverse Multi Motion Prediction of 3D Human Joints using Attention-Based Generative Adverserial Networkcited by 4
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learningcited by 4
12 most cited of 27 All 27 (JSON)
- 2026Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing17 Aug 2026
- 2026KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum16 Aug 2026
- 2026Scene-aware Prediction of Diverse Human Movement Goals29 Jun 2026
- 2026Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning29 May 2026
- 2026MoPO: Incorporating Motion Prior for Occluded Human Mesh Recovery11 May 2026
- 2025MMCM: Multimodality-aware Metric using Clustering-based Modes for Probabilistic Human Motion Prediction19 Nov 2025
- 2025GraphEnet: Event-driven Human Pose Estimation with a Graph Neural Network9 Oct 2025
- 2025Motion Generation: A Survey of Generative Approaches and Benchmarks7 Jul 2025
- 2025Multimodal Generative AI with Autoregressive LLMs for Human Motion Understanding and Generation: A Way Forward31 May 2025
- 2025Text-driven Motion Generation: Overview, Challenges and Directions14 May 2025
- 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Models7 Apr 2025
- 2025A Real-Time Human Action Recognition Model for Assisted Living18 Mar 2025
12 newest of 27 All 27 (JSON)