Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction
Not on the map. Why?
Abstract (arXiv)
This paper presents a high-quality human motion prediction method that accurately predicts future human poses given observed ones. Our method is based on the observation that a good initial guess of the future poses is very helpful in improving the forecasting accuracy. This motivates us to propose a novel two-stage prediction framework, including an init-prediction network that just computes the good guess and then a formal-prediction network that predicts the target future poses based on the guess. More importantly, we extend this idea further and design a multi-stage prediction framework where each stage predicts initial guess for the next stage, which brings more performance gain. To fulfill the prediction task at each stage, we propose a network comprising Spatial Dense Graph Convolutional Networks (S-DGCN) and Temporal Dense Graph Convolutional Networks (T-DGCN). Alternatively executing the two networks helps extract spatiotemporal features over the global receptive field of the whole pose sequence. All the above design choices cooperating together make our method outperform previous approaches by large margins: 6%-7% on Human3.6M, 5%-10% on CMU-MoCap, and 13%-16% on 3DPW.
Key facts. Cited by 66 papers in the map (data through 14 Oct 2026). Builds on 27 of its 47 references that are in the map. First posted on arXiv 30 Mar 2022.
Builds on
27 of 47 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
- 2017On human motion prediction using recurrent neural networkscited by 338
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 165
- 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
- 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
- 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
- 2021MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Predictioncited by 100
- 2017Deep representation learning for human motion prediction and classificationcited by 98
15 more
- 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
- 2018A Neural Temporal Model for Human Motion Predictioncited by 87
- 2019Context-aware Human Motion Predictioncited by 84
- 2021Space-Time-Separable Graph Convolutional Network for Pose Forecastingcited by 84
- 2017Learning Human Motion Models for Long-term Predictionscited by 67
- 2018Action-Agnostic Human Pose Forecastingcited by 56
- 2019Symbiotic Graph Neural Networks for 3D Skeleton-based Human Action Recognition and Motion Predictioncited by 50
- 2019Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Predictioncited by 47
- 2019Modeling Human Motion with Quaternion-based Neural Networkscited by 45
- 2018Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamiccited by 41
- 2019Human Motion Prediction via Learning Local Structure Representations and Temporal Dependenciescited by 34
- 2021Dual Graph Convolutional Networks with Transformer and Curriculum Learning for Image Captioningcited by 27
- 2020Multitask Non-Autoregressive Model for Human Motion Predictioncited by 16
- 2020Motion Prediction Using Temporal Inception Modulecited by 10
- 2019TrajectoryNet: a new spatio-temporal feature learning network for human motion predictioncited by 5
Built on by
Citing papers per year: 2022: 5; 2023: 26; 2024: 15; 2025: 14; 2026: 6.
66 papers.
Sort:
By area:
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 100
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2022Interaction Transformer for Human Reaction Generationcited by 42
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Spacecited by 32
- 2024Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioningcited by 30
- 2023Interactive Humanoid: Online Full-Body Motion Reaction Synthesis with Social Affordance Canonicalization and Forecastingcited by 27
- 2023CoMusion: Towards Consistent Stochastic Human Motion Prediction via Motion Diffusioncited by 21
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Predictioncited by 21
- 2023Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Predictioncited by 20
- 2024PhysReaction: Physically Plausible Real-Time Humanoid Reaction Synthesis via Forward Dynamics Guided 4D Imitationcited by 18
- 2024HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxescited by 17
38 more
- 2024Progressive Pretext Task Learning for Human Trajectory Predictioncited by 16
- 2025The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimationcited by 16
- 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrumscited by 14
- 2023Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion Interpolationcited by 12
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Predictioncited by 12
- 2023Toward Reliable Human Pose Forecasting with Uncertaintycited by 11
- 2023Dynamic Dense Graph Convolutional Network for Skeleton-based Human Motion Predictioncited by 11
- 2023GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Predictioncited by 10
- 2023Spatio-Temporal Branching for Motion Prediction using Motion Incrementscited by 9
- 2025StickMotion: Generating 3D Human Motions by Drawing a Stickmancited by 9
- 2023Best Practices for 2-Body Pose Forecastingcited by 8
- 2023Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Posescited by 7
- 2024Context-based Interpretable Spatio-Temporal Graph Convolutional Network for Human Motion Forecastingcited by 6
- 2024Multimodal Sense-Informed Prediction of 3D Human Motionscited by 6
- 20253D Skeleton-Based Action Recognition: A Reviewcited by 6
- 2024GazeMotion: Gaze-guided Human Motion Forecastingcited by 5
- 2022Overlooked Poses Actually Make Sense: Distilling Privileged Knowledge for Human Motion Predictioncited by 4
- 2023DeFeeNet: Consecutive 3D Human Motion Prediction with Deviation Feedbackcited by 4
- 2023Towards Accurate Human Motion Prediction via Iterative Refinementcited by 4
- 2023A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesiscited by 4
- 2023Orientation-Aware Leg Movement Learning for Action-Driven Human Motion Predictioncited by 4
- 2025Efficient Multi-Person Motion Prediction by Lightweight Spatial and Temporal Interactionscited by 4
- 2023The MI-Motion Dataset and Benchmark for 3D Multi-Person Motion Predictioncited by 3
- 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learningcited by 3
- 2023Meta-Auxiliary Learning for Adaptive Human Pose Predictioncited by 2
- 2023Remembering What Is Important: A Factorised Multi-Head Retrieval and Auxiliary Memory Stabilisation Scheme for Human Motion Predictioncited by 2
- 2024HaHeAE: Learning Generalisable Joint Representations of Human Hand and Head Movements in Extended Realitycited by 2
- 2025HUMOF: Human Motion Forecasting in Interactive Social Scenescited by 2
- 2023Graph-Guided MLP-Mixer for Skeleton-Based Human Motion Predictioncited by 1
- 2023Multi-Graph Convolution Network for Pose Forecastingcited by 1
- 2023Persistent-Transient Duality: A Multi-mechanism Approach for Modeling Human-Object Interactioncited by 1
- 2023Learning Snippet-to-Motion Progression for Skeleton-based Human Motion Predictioncited by 1
- 2023GaitMorph: Transforming Gait by Optimally Transporting Discrete Codescited by 1
- 2023Recent Advances in Deterministic Human Motion Prediction: A Reviewcited by 1
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recoverycited by 1
- 2024Off-the-shelf ChatGPT is a Good Few-shot Human Motion Predictorcited by 1
- 2024Spatio-Temporal Multi-Subgraph GCN for 3D Human Motion Predictioncited by 1
- 2025UPTor: Unified 3D Human Pose Dynamics and Trajectory Prediction for Human-Robot Interactioncited by 1
50 most cited of 66 All 66 (JSON)
- 2026Multi-Person Human Motion Forecasting in Complex Scenes27 Aug 2026
- 2026Capturing Uncertainty in Human Motion for Representation Learning in Soccer11 Aug 2026
- 2026DrawMotion: Generating 3D Human Motions by Freehand Drawing20 May 2026
- 2026B'ezier Degradation Modeling for LiDAR-based Human Motion Capture19 May 2026
- 2026Vision-Based Safe Human-Robot Collaboration with Uncertainty Guarantees16 Apr 2026
- 2026Int3DNet: Scene-Motion Cross Attention Network for 3D Intention Prediction in Mixed Reality9 Mar 2026
- 2025Scriboora: Rethinking Human Pose Forecasting19 Nov 2025
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario12 Sep 2025
- 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learning14 Aug 2025
- 2025Efficient Multi-Person Motion Prediction by Lightweight Spatial and Temporal Interactions13 Jul 2025
- 2025GGMotion: Group Graph Dynamics-Kinematics Networks for Human Motion Prediction10 Jul 2025
38 more
- 2025Temporal Continual Learning with Prior Compensation for Human Motion Prediction5 Jul 2025
- 2025HUMOF: Human Motion Forecasting in Interactive Social Scenes4 Jun 2025
- 20253D Skeleton-Based Action Recognition: A Review1 Jun 2025
- 2025UPTor: Unified 3D Human Pose Dynamics and Trajectory Prediction for Human-Robot Interaction20 May 2025
- 2025Multi-Resolution Haar Network: Enhancing human motion prediction via Haar transform19 May 2025
- 2025The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimation11 Apr 2025
- 2025StickMotion: Generating 3D Human Motions by Drawing a Stickman5 Mar 2025
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Prediction10 Jan 2025
- 2024Spatio-Temporal Multi-Subgraph GCN for 3D Human Motion Prediction31 Dec 2024
- 2024Multi-Scale Incremental Modeling for Enhanced Human Motion Prediction in Human-Robot Collaboration16 Dec 2024
- 2024UnityGraph: Unified Learning of Spatio-temporal features for Multi-person Motion Prediction6 Nov 2024
- 2024Relation Learning and Aggregate-attention for Multi-person Motion Prediction6 Nov 2024
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Prediction4 Nov 2024
- 2024HaHeAE: Learning Generalisable Joint Representations of Human Hand and Head Movements in Extended Reality21 Oct 2024
- 2024Progressive Pretext Task Learning for Human Trajectory Prediction16 Jul 2024
- 2024HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxes2 Jul 2024
- 2024Off-the-shelf ChatGPT is a Good Few-shot Human Motion Predictor24 May 2024
- 2024Multimodal Sense-Informed Prediction of 3D Human Motions5 May 2024
- 2024Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioning8 Apr 2024
- 2024PhysReaction: Physically Plausible Real-Time Humanoid Reaction Synthesis via Forward Dynamics Guided 4D Imitation1 Apr 2024
- 2024GazeMotion: Gaze-guided Human Motion Forecasting14 Mar 2024
- 2024Context-based Interpretable Spatio-Temporal Graph Convolutional Network for Human Motion Forecasting21 Feb 2024
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recovery25 Jan 2024
- 2023GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction19 Dec 2023
- 2023Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses19 Dec 2023
- 2023Interactive Humanoid: Online Full-Body Motion Reaction Synthesis with Social Affordance Canonicalization and Forecasting14 Dec 2023
- 2023Recent Advances in Deterministic Human Motion Prediction: A Review11 Dec 2023
- 2023Personalized Pose Forecasting6 Dec 2023
- 2023Dynamic Dense Graph Convolutional Network for Skeleton-based Human Motion Prediction29 Nov 2023
- 2023Orientation-Aware Leg Movement Learning for Action-Driven Human Motion Prediction23 Oct 2023
- 2023Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Prediction17 Aug 2023
- 2023A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesis14 Aug 2023
- 2023Spatio-Temporal Branching for Motion Prediction using Motion Increments2 Aug 2023
- 2023GaitMorph: Transforming Gait by Optimally Transporting Discrete Codes27 Jul 2023
- 2023Learning Snippet-to-Motion Progression for Skeleton-based Human Motion Prediction26 Jul 2023
- 2023Persistent-Transient Duality: A Multi-mechanism Approach for Modeling Human-Object Interaction24 Jul 2023
- 2023The MI-Motion Dataset and Benchmark for 3D Multi-Person Motion Prediction23 Jun 2023
- 2023CoMusion: Towards Consistent Stochastic Human Motion Prediction via Motion Diffusion21 May 2023
50 newest of 66 All 66 (JSON)
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 100
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2022Interaction Transformer for Human Reaction Generationcited by 42
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Spacecited by 32
- 2024Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioningcited by 30
- 2023Interactive Humanoid: Online Full-Body Motion Reaction Synthesis with Social Affordance Canonicalization and Forecastingcited by 27
- 2023CoMusion: Towards Consistent Stochastic Human Motion Prediction via Motion Diffusioncited by 21
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Predictioncited by 21
- 2023Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Predictioncited by 20
- 2024PhysReaction: Physically Plausible Real-Time Humanoid Reaction Synthesis via Forward Dynamics Guided 4D Imitationcited by 18
- 2024HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxescited by 17
- 2024Progressive Pretext Task Learning for Human Trajectory Predictioncited by 16
12 most cited of 64 All 64 (JSON)
- 2026Multi-Person Human Motion Forecasting in Complex Scenes27 Aug 2026
- 2026Capturing Uncertainty in Human Motion for Representation Learning in Soccer11 Aug 2026
- 2026DrawMotion: Generating 3D Human Motions by Freehand Drawing20 May 2026
- 2026B'ezier Degradation Modeling for LiDAR-based Human Motion Capture19 May 2026
- 2026Vision-Based Safe Human-Robot Collaboration with Uncertainty Guarantees16 Apr 2026
- 2026Int3DNet: Scene-Motion Cross Attention Network for 3D Intention Prediction in Mixed Reality9 Mar 2026
- 2025Scriboora: Rethinking Human Pose Forecasting19 Nov 2025
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario12 Sep 2025
- 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learning14 Aug 2025
- 2025Efficient Multi-Person Motion Prediction by Lightweight Spatial and Temporal Interactions13 Jul 2025
- 2025GGMotion: Group Graph Dynamics-Kinematics Networks for Human Motion Prediction10 Jul 2025
12 newest of 64 All 64 (JSON)