Development of Human Motion Prediction Strategy using Inception Residual Block
Not on the map. Why?
Abstract (arXiv)
Human Motion Prediction is a crucial task in computer vision and robotics. It has versatile application potentials such as in the area of human-robot interactions, human action tracking for airport security systems, autonomous car navigation, computer gaming to name a few. However, predicting human motion based on past actions is an extremely challenging task due to the difficulties in detecting spatial and temporal features correctly. To detect temporal features in human poses, we propose an Inception Residual Block(IRB), due to its inherent capability of processing multiple kernels to capture salient features. Here, we propose to use multiple 1-D Convolution Neural Network (CNN) with different kernel sizes and input sequence lengths and concatenate them to get proper embedding. As kernels strides over different receptive fields, they detect smaller and bigger salient features at multiple temporal scales. Our main contribution is to propose a residual connection between input and the output of the inception block to have a continuity between the previously observed pose and the next predicted pose. With this proposed architecture, it learns prior knowledge much better about human poses and we achieve much higher prediction accuracy as detailed in the paper. Subsequently, we further propose to feed the output of the inception residual block as an input to the Graph Convolution Neural Network (GCN) due to its better spatial feature learning capability. We perform a parametric analysis for better designing of our model and subsequently, we evaluate our approach on the Human 3.6M dataset and compare our short-term as well as long-term predictions with the state of the art papers, where our model outperforms most of the pose results, the detailed reasons of which have been elaborated in the paper.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 9 Aug 2021.
Builds on
27 of 51 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2014Going Deeper with Convolutionscited by 4,231
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
- 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
- 2017On human motion prediction using recurrent neural networkscited by 336
15 more
- 2015Skip-Thought Vectorscited by 321
- 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 251
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2018Human Action Recognition and Prediction: A Surveycited by 226
- 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
- 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
- 2017Deep representation learning for human motion prediction and classificationcited by 97
- 2017Geometric Matrix Completion with Recurrent Multi-Graph Neural Networkscited by 88
- 2018Memory Attention Networks for Skeleton-based Action Recognitioncited by 36
- 2018Exploiting Semantics in Neural Machine Translation with Graph Convolutional Networkscited by 30
- 2020Motion Prediction Using Temporal Inception Modulecited by 10
- 2021A context-aware pedestrian trajectory prediction framework for automated vehiclescited by 10
- 2018Context-Aware Pedestrian Motion Prediction In Urban Intersectionscited by 1
- 2018A Probabilistic Semi-Supervised Approach to Multi-Task Human Activity Modelingcited by 1
Built on by
Not cited yet.