Spatio-Temporal Branching for Motion Prediction using Motion Increments
Not on the map. Why?
Abstract (arXiv)
Human motion prediction (HMP) has emerged as a popular research topic due to its diverse applications, but it remains a challenging task due to the stochastic and aperiodic nature of future poses. Traditional methods rely on hand-crafted features and machine learning techniques, which often struggle to model the complex dynamics of human motion. Recent deep learning-based methods have achieved success by learning spatio-temporal representations of motion, but these models often overlook the reliability of motion data. Additionally, the temporal and spatial dependencies of skeleton nodes are distinct. The temporal relationship captures motion information over time, while the spatial relationship describes body structure and the relationships between different nodes. In this paper, we propose a novel spatio-temporal branching network using incremental information for HMP, which decouples the learning of temporal-domain and spatial-domain features, extracts more motion information, and achieves complementary cross-domain knowledge learning through knowledge distillation. Our approach effectively reduces noise interference and provides more expressive information for characterizing motion by separately extracting temporal and spatial features. We evaluate our approach on standard HMP benchmarks and outperform state-of-the-art methods in terms of prediction accuracy.
Key facts. Cited by 9 papers in the map (data through 13 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 2 Aug 2023.
Builds on
26 of 51 references.
References · 26
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,326
- 2017Convolutional Sequence to Sequence Learningcited by 552
- 2017On human motion prediction using recurrent neural networkscited by 337
- 2013Direct and Indirect Effectscited by 277
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
- 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 164
- 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
- 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
- 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
- 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
14 more
- 2021MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Predictioncited by 100
- 2017Deep representation learning for human motion prediction and classificationcited by 98
- 2018A Neural Temporal Model for Human Motion Predictioncited by 87
- 2019Ego-Pose Estimation and Forecasting as Real-Time PD Controlcited by 87
- 2021Space-Time-Separable Graph Convolutional Network for Pose Forecastingcited by 84
- 2019Context-aware Human Motion Predictioncited by 83
- 20203D Point Cloud Processing and Learning for Autonomous Drivingcited by 68
- 2022Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Predictioncited by 66
- 2021Video Prediction Recalling Long-term Motion Context via Memory Alignment Learningcited by 62
- 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
- 2022Spatio-Temporal Gating-Adjacency GCN for Human Motion Predictioncited by 48
- 2022Skeleton-Parted Graph Scattering Networks for 3D Human Motion Predictioncited by 29
- 2023Self-supervised Action Representation Learning from Partial Spatio-Temporal Skeleton Sequencescited by 25
- 2022Robust Local Preserving and Global Aligning Network for Adversarial Domain Adaptationcited by 8
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 2.
9 papers.
- 2023Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximizationcited by 24
- 2024Not All Frequencies Are Created Equal:Towards a Dynamic Fusion of Frequencies in Time-Series Forecastingcited by 6
- 2024Towards Practical Human Motion Prediction with LiDAR Point Cloudscited by 2
- 2023Recent Advances in Deterministic Human Motion Prediction: A Reviewcited by 1
- 2024Spatio-Temporal Multi-Subgraph GCN for 3D Human Motion Predictioncited by 1
- 2025Beyond All-to-All: Causal-Aligned Transformer with Dynamic Structure Learning for Multivariate Time Series Forecastingcited by 1
- 2024Multi-Scale Incremental Modeling for Enhanced Human Motion Prediction in Human-Robot Collaborationcited by 0
- 2024Temporal Dynamics Decoupling with Inverse Processing for Enhancing Human Motion Predictioncited by 0
- 2025Enhancing Human Motion Prediction via Multi-range Decoupling Decoding with Gating-adjusting Aggregationcited by 0
- 2025Beyond All-to-All: Causal-Aligned Transformer with Dynamic Structure Learning for Multivariate Time Series Forecasting22 May 2025
- 2025Enhancing Human Motion Prediction via Multi-range Decoupling Decoding with Gating-adjusting Aggregation30 Mar 2025
- 2024Spatio-Temporal Multi-Subgraph GCN for 3D Human Motion Prediction31 Dec 2024
- 2024Temporal Dynamics Decoupling with Inverse Processing for Enhancing Human Motion Prediction31 Dec 2024
- 2024Multi-Scale Incremental Modeling for Enhanced Human Motion Prediction in Human-Robot Collaboration16 Dec 2024
- 2024Towards Practical Human Motion Prediction with LiDAR Point Clouds15 Aug 2024
- 2024Not All Frequencies Are Created Equal:Towards a Dynamic Fusion of Frequencies in Time-Series Forecasting17 Jul 2024
- 2023Recent Advances in Deterministic Human Motion Prediction: A Review11 Dec 2023
- 2023Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximization7 Aug 2023