Motion Guided 3D Pose Estimation from Videos
Not on the map. Why?
Abstract (arXiv)
We propose a new loss function, called motion loss, for the problem of monocular 3D Human pose estimation from 2D pose. In computing motion loss, a simple yet effective representation for keypoint motion, called pairwise motion encoding, is introduced. We design a new graph convolutional network architecture, U-shaped GCN (UGCN). It captures both short-term and long-term motion information to fully leverage the additional supervision from the motion loss. We experiment training UGCN with the motion loss on two large scale benchmarks: Human3.6M and MPI-INF-3DHP. Our model surpasses other state-of-the-art models by a large margin. It also demonstrates strong capacity in producing smooth 3D sequences and recovering keypoint motion.
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 18; 2023: 17; 2024: 16; 2025: 13; 2026: 3.
85 papers.
Sort:
By area:
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 99
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2021Exploiting Temporal Contexts with Strided Transformer for 3D Human Pose Estimationcited by 94
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 91
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 81
- 2022P-STMO: Pre-Trained Spatial Temporal Many-to-One Model for 3D Human Pose Estimationcited by 80
- 2021Scene-aware Generative Network for Human Motion Synthesiscited by 70
38 more
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Networkcited by 62
- 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
- 2021Conditional Directed Graph Convolution for 3D Human Pose Estimationcited by 52
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 46
- 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformerscited by 33
- 2024KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimationcited by 33
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Modelcited by 29
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videoscited by 27
- 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localizationcited by 25
- 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimationcited by 23
- 2022GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimationcited by 21
- 20223D Vision with Transformers: A Surveycited by 21
- 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimationcited by 19
- 2021Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimationcited by 18
- 2021VoteHMR: Occlusion-Aware Voting Network for Robust 3D Human Mesh Recovery from Partial Point Cloudscited by 18
- 2022Light-weight spatio-temporal graphs for segmentation and ejection fraction prediction in cardiac ultrasoundcited by 15
- 2022Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Priorcited by 15
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimationcited by 15
- 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movementscited by 15
- 2025AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movementscited by 14
- 2021Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Networkcited by 13
- 2021Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videoscited by 13
- 2023PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimationcited by 12
- 2021FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstructioncited by 11
- 2022CrossFormer: Cross Spatio-Temporal Transformer for 3D Human Pose Estimationcited by 11
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimationcited by 11
- 2024Deep learning for 3D human pose estimation and mesh recovery: A surveycited by 11
- 2024Lifting Motion to the 3D World via 2D Diffusioncited by 11
- 2023HSTFormer: Hierarchical Spatial-Temporal Transformers for 3D Human Pose Estimationcited by 9
- 2022IVT: An End-to-End Instance-guided Video Transformer for 3D Pose Estimationcited by 6
- 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Surveycited by 6
- 2023ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimationcited by 6
- 2024HumMUSS: Human Motion Understanding using State Space Modelscited by 6
- 2021Motion Projection Consistency Based 3D Human Pose Estimation with Virtual Bones from Monocular Videoscited by 5
- 2024GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correctioncited by 5
50 most cited of 85 All 85 (JSON)
- 2026Unsupervised 3D Human Pose Estimation via Conditional Multi-view Ancestral Sampling15 May 2026
- 2026AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusion20 Apr 2026
- 2026GazeD: Context-Aware Diffusion for Accurate 3D Gaze Estimation19 Jan 2026
- 2025HGFreNet: Hop-hybrid GraphFomer for 3D Human Pose Estimation with Trajectory Consistency in Frequency Domain3 Nov 2025
- 2025Bimanual 3D Hand Motion and Articulation Forecasting in Everyday Images7 Oct 2025
- 2025Shape-from-Template with Generalised Camera19 Aug 2025
- 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learning14 Aug 2025
- 2025IMPA-HGAE:Intra-Meta-Path Augmented Heterogeneous Graph Autoencoder7 Jun 2025
- 2025Learning Pyramid-structured Long-range Dependencies for 3D Human Pose Estimation3 Jun 2025
- 2025Spectral Compression Transformer with Line Pose Graph for Monocular 3D Human Pose Estimation27 May 2025
- 2025PoseBench3D: A Cross-Dataset Analysis Framework for 3D Human Pose Estimation via Pose Lifting Networks16 May 2025
- 20253D Human Pose Estimation via Spatial Graph Order Attention and Temporal Body Aware Transformer2 May 2025
38 more
- 2025Dual-stream Transformer-GCN Model with Contextualized Representations Learning for Monocular 3D Human Pose Estimation2 Apr 2025
- 2025AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movements10 Mar 2025
- 2025DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion23 Feb 2025
- 2025L3D-Pose: Lifting Pose for 3D Avatars from a Single Camera in the Wild2 Jan 2025
- 2024Lifting Motion to the 3D World via 2D Diffusion27 Nov 2024
- 2024GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correction11 Nov 2024
- 2024LangPose: Language-Aligned Motion for Robust 3D Human Pose Estimation31 Aug 2024
- 20243D-UGCN: A Unified Graph Convolutional Network for Robust 3D Human Pose Estimation from Monocular RGB Images23 Jul 2024
- 2024STGFormer: Spatio-Temporal GraphFormer for 3D Human Pose Estimation in Video14 Jul 2024
- 2024Graph and Skipped Transformer: Exploiting Spatial and Temporal Modeling Capacities for Efficient 3D Human Pose Estimation3 Jul 2024
- 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimation27 May 2024
- 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movements20 May 2024
- 2024Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Training30 Apr 2024
- 2024HumMUSS: Human Motion Understanding using State Space Models16 Apr 2024
- 2024An Animation-based Augmentation Approach for Action Recognition from Discontinuous Video10 Apr 2024
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos5 Apr 2024
- 2024KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimation31 Mar 2024
- 2024Deep learning for 3D human pose estimation and mesh recovery: A survey29 Feb 2024
- 2024Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers30 Jan 2024
- 2024D3PRefiner: A Diffusion-based Denoise Method for 3D Human Pose Refinement8 Jan 2024
- 2023Pose-based Tremor Type and Level Analysis for Parkinson's Disease from Video21 Dec 2023
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Input11 Dec 2023
- 2023ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation11 Dec 2023
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation20 Nov 2023
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation6 Nov 2023
- 2023MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Network25 Oct 2023
- 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Survey19 Oct 2023
- 2023Refined Temporal Pyramidal Compression-and-Amplification Transformer for 3D Human Pose Estimation4 Sep 2023
- 2023PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimation18 Aug 2023
- 2023Iterative Graph Filtering Network for 3D Human Pose Estimation29 Jul 2023
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video12 Jul 2023
- 2023MPM: A Unified 2D-3D Human Pose Representation via Masked Pose Modeling29 Jun 2023
- 2023ConvFormer: Parameter Reduction in Transformer Models for 3D Human Pose Estimation by Leveraging Dynamic Multi-Headed Convolutional Attention4 Apr 2023
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimation30 Mar 2023
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregation21 Mar 2023
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimation3 Feb 2023
- 2023HSTFormer: Hierarchical Spatial-Temporal Transformers for 3D Human Pose Estimation18 Jan 2023
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Model6 Dec 2022
50 newest of 85 All 85 (JSON)
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 99
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2021Exploiting Temporal Contexts with Strided Transformer for 3D Human Pose Estimationcited by 94
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 91
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 81
- 2022P-STMO: Pre-Trained Spatial Temporal Many-to-One Model for 3D Human Pose Estimationcited by 80
- 2021Scene-aware Generative Network for Human Motion Synthesiscited by 70
12 most cited of 82 All 82 (JSON)
- 2026AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusion20 Apr 2026
- 2026GazeD: Context-Aware Diffusion for Accurate 3D Gaze Estimation19 Jan 2026
- 2025HGFreNet: Hop-hybrid GraphFomer for 3D Human Pose Estimation with Trajectory Consistency in Frequency Domain3 Nov 2025
- 2025Bimanual 3D Hand Motion and Articulation Forecasting in Everyday Images7 Oct 2025
- 2025Shape-from-Template with Generalised Camera19 Aug 2025
- 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learning14 Aug 2025
- 2025IMPA-HGAE:Intra-Meta-Path Augmented Heterogeneous Graph Autoencoder7 Jun 2025
- 2025Learning Pyramid-structured Long-range Dependencies for 3D Human Pose Estimation3 Jun 2025
- 2025Spectral Compression Transformer with Line Pose Graph for Monocular 3D Human Pose Estimation27 May 2025
- 2025PoseBench3D: A Cross-Dataset Analysis Framework for 3D Human Pose Estimation via Pose Lifting Networks16 May 2025
- 20253D Human Pose Estimation via Spatial Graph Order Attention and Temporal Body Aware Transformer2 May 2025
- 2025Dual-stream Transformer-GCN Model with Contextualized Representations Learning for Monocular 3D Human Pose Estimation2 Apr 2025
12 newest of 82 All 82 (JSON)