Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Various deep learning techniques have been proposed to solve the single-view 2D-to-3D pose estimation problem. While the average prediction accuracy has been improved significantly over the years, the performance on hard poses with depth ambiguity, self-occlusion, and complex or rare poses is still far from satisfactory. In this work, we target these hard poses and present a novel skeletal GNN learning solution. To be specific, we propose a hop-aware hierarchical channel-squeezing fusion layer to effectively extract relevant information from neighboring nodes while suppressing undesired noises in GNN learning. In addition, we propose a temporal-aware dynamic graph construction procedure that is robust and effective for 3D pose estimation. Experimental results on the Human3.6M dataset show that our solution achieves 10.3% average prediction accuracy improvement and greatly improves on hard poses over state-of-the-art techniques. We further apply the proposed technique on the skeleton-based action recognition task and also achieve state-of-the-art performance. Our code is available at https://github.com/ailingzengzzz/Skeletal-GNN.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). Builds on 36 of its 50 references that are in the map. First posted on arXiv 16 Aug 2021.
Builds on
36 of 50 references.
References · 36
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
- 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 442
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
24 more
- 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 401
- 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
- 2020Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognitioncited by 339
- 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
- 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
- 2019Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognitioncited by 135
- 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
- 20182D/3D Pose Estimation and Action Recognition using Multitask Deep Learningcited by 103
- 2019Skeleton-Based Action Recognition with Multi-Stream Adaptive Graph Convolutional Networkscited by 103
- 2020SRNet: Improving Generalization in 3D Human Pose Estimation with a Split-and-Recombine Approachcited by 94
- 2017Exploiting temporal information for 3D pose estimationcited by 89
- 2020Dynamic GCN: Context-enriched Topology Learning for Skeleton-based Action Recognitioncited by 82
- 2020Spatial Temporal Transformer Network for Skeleton-based Action Recognitioncited by 76
- 2019Learning Graph Convolutional Network for Skeleton-based Human Action Recognition by Neural Searchingcited by 70
- 2017Not All Pixels Are Equal: Difficulty-aware Semantic Segmentation via Deep Layer Cascadecited by 53
- 2019Trajectory Space Factorization for Deep Video-Based 3D Human Pose Estimationcited by 30
- 2018OriNet: A Fully Convolutional Network for 3D Human Pose Estimationcited by 28
- 2020Mix Dimension in Poincar'e Geometry for 3D Skeleton-based Action Recognitioncited by 14
- 20183D Human Pose Estimation with Relational Networkscited by 10
- 2019Generalizing Monocular 3D Human Pose Estimation in the Wildcited by 6
- 2020Hop-Hop Relation-aware Graph Neural Networkscited by 5
- 2020LookHops: light multi-order convolution and pooling for graph classificationcited by 5
- 2019A Unified Deep Framework for Joint 3D Pose Estimation and Action Recognition from a Single RGB Cameracited by 4
- 2019Rethinking the Number of Channels for the Convolutional Neural Networkcited by 1
Built on by
Citing papers per year: 2021: 4; 2022: 14; 2023: 21; 2024: 13; 2025: 7; 2026: 3.
62 papers.
Sort:
By area:
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
- 2022P-STMO: Pre-Trained Spatial Temporal Many-to-One Model for 3D Human Pose Estimationcited by 80
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2023Learning Discriminative Representations for Skeleton Based Action Recognitioncited by 62
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fieldscited by 57
- 2023SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modelingcited by 54
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 46
- 2024SkateFormer: Skeletal-Temporal Transformer for Human Action Recognitioncited by 46
- 2022STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognitioncited by 43
38 more
- 2022DeciWatch: A Simple Baseline for 10x Efficient 2D and 3D Pose Estimationcited by 29
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videoscited by 27
- 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controlscited by 24
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimationcited by 23
- 20222D Human Pose Estimation: A Surveycited by 21
- 2022GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimationcited by 21
- 2022Cross-Modal Learning with 3D Deformable Attention for Action Recognitioncited by 20
- 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimationcited by 19
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimationcited by 15
- 2022Skeleton-based Action Recognition via Temporal-Channel Aggregationcited by 13
- 2022Leveraging Spatio-Temporal Dependency for Skeleton-Based Action Recognitioncited by 13
- 2024Attention-Propagation Network for Egocentric Heatmap to 3D Pose Liftingcited by 13
- 2021Hierarchical Graph Networks for 3D Human Pose Estimationcited by 11
- 2023Regular Splitting Graph Network for 3D Human Pose Estimationcited by 11
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimationcited by 11
- 2023HSTFormer: Hierarchical Spatial-Temporal Transformers for 3D Human Pose Estimationcited by 9
- 2023ActionPrompt: Action-Guided 3D Human Pose Estimation With Text and Pose Promptingcited by 8
- 2023HopFIR: Hop-wise GraphFormer with Intragroup Joint Refinement for 3D Human Pose Estimationcited by 7
- 2023Lightweight Super-Resolution Head for Human Pose Estimationcited by 7
- 2022NIMBLE: A Non-rigid Hand Model with Bones and Musclescited by 6
- 2023HTNet: Human Topology Aware Network for 3D Human Pose Estimationcited by 6
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimationcited by 6
- 2023TSGCNeXt: Dynamic-Static Multi-Graph Convolution for Efficient Skeleton-Based Action Recognition with Long-term Learning Potentialcited by 5
- 2022Towards To-a-T Spatio-Temporal Focus for Skeleton-Based Action Recognitioncited by 4
- 2023GATOR: Graph-Aware Transformer with Motion-Disentangled Regression for Human Mesh Recovery from a 2D Posecited by 4
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Inputcited by 4
- 2026FMPose3D: monocular 3D pose estimation via flow matchingcited by 3
- 20233D Human Pose Lifting with Grid Convolutioncited by 2
- 2024Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimationcited by 2
- 2024SkelFormer: Markerless 3D Pose and Shape Estimation using Skeletal Transformerscited by 2
- 2024STGFormer: Spatio-Temporal GraphFormer for 3D Human Pose Estimation in Videocited by 2
- 2025NanoHTNet: Nano Human Topology Network for Efficient 3D Human Pose Estimationcited by 2
- 2023Iterative Graph Filtering Network for 3D Human Pose Estimationcited by 1
- 2023Spatio-temporal MLP-graph network for 3D human pose estimationcited by 1
- 2023SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentationcited by 1
- 2024Full-Body Motion Reconstruction with Sparse Sensing from Graph Perspectivecited by 1
- 2024Multi-hop graph transformer network for 3D human pose estimationcited by 1
- 2024Graph and Skipped Transformer: Exploiting Spatial and Temporal Modeling Capacities for Efficient 3D Human Pose Estimationcited by 1
50 most cited of 62 All 62 (JSON)
- 2026DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimation5 Jun 2026
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation10 Mar 2026
- 2026FMPose3D: monocular 3D pose estimation via flow matching5 Feb 2026
- 2025PoseMoE: Mixture-of-Experts Network for Monocular 3D Human Pose Estimation18 Dec 2025
- 2025Adaptive graph Kolmogorov-Arnold network for 3D human pose estimation11 Nov 2025
- 2025HGFreNet: Hop-hybrid GraphFomer for 3D Human Pose Estimation with Trajectory Consistency in Frequency Domain3 Nov 2025
- 2025PoseGRAF: Geometric-Reinforced Adaptive Fusion for Monocular 3D Human Pose Estimation17 Jun 2025
- 2025Learning Pyramid-structured Long-range Dependencies for 3D Human Pose Estimation3 Jun 2025
- 2025Rodrigues Network for Learning Robot Actions3 Jun 2025
- 2025NanoHTNet: Nano Human Topology Network for Efficient 3D Human Pose Estimation27 Jan 2025
- 2024Synchronized and Fine-Grained Head for Skeleton-Based Ambiguous Action Recognition19 Dec 2024
- 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls30 Jul 2024
38 more
- 2024Flexible graph convolutional network for 3D human pose estimation26 Jul 2024
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimation15 Jul 2024
- 2024STGFormer: Spatio-Temporal GraphFormer for 3D Human Pose Estimation in Video14 Jul 2024
- 2024Graph and Skipped Transformer: Exploiting Spatial and Temporal Modeling Capacities for Efficient 3D Human Pose Estimation3 Jul 2024
- 2024Multi-hop graph transformer network for 3D human pose estimation5 May 2024
- 2024SkelFormer: Markerless 3D Pose and Shape Estimation using Skeletal Transformers19 Apr 2024
- 2024PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos5 Apr 2024
- 2024SkateFormer: Skeletal-Temporal Transformer for Human Action Recognition14 Mar 2024
- 2024Attention-Propagation Network for Egocentric Heatmap to 3D Pose Lifting28 Feb 2024
- 2024Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimation4 Feb 2024
- 2024Full-Body Motion Reconstruction with Sparse Sensing from Graph Perspective22 Jan 2024
- 2023SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentation15 Dec 2023
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Input11 Dec 2023
- 2023RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling24 Nov 2023
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation20 Nov 2023
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation6 Nov 2023
- 2023Spatio-temporal MLP-graph network for 3D human pose estimation29 Aug 2023
- 2023Lightweight Super-Resolution Head for Human Pose Estimation31 Jul 2023
- 2023Iterative Graph Filtering Network for 3D Human Pose Estimation29 Jul 2023
- 2023ActionPrompt: Action-Guided 3D Human Pose Estimation With Text and Pose Prompting18 Jul 2023
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video12 Jul 2023
- 2023Regular Splitting Graph Network for 3D Human Pose Estimation9 May 2023
- 2023TSGCNeXt: Dynamic-Static Multi-Graph Convolution for Efficient Skeleton-Based Action Recognition with Long-term Learning Potential23 Apr 2023
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generation9 Apr 2023
- 2023SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling30 Mar 2023
- 2023GATOR: Graph-Aware Transformer with Motion-Disentangled Regression for Human Mesh Recovery from a 2D Pose10 Mar 2023
- 2023Learning Discriminative Representations for Skeleton Based Action Recognition7 Mar 2023
- 2023HopFIR: Hop-wise GraphFormer with Intragroup Joint Refinement for 3D Human Pose Estimation28 Feb 2023
- 2023HTNet: Human Topology Aware Network for 3D Human Pose Estimation20 Feb 2023
- 20233D Human Pose Lifting with Grid Convolution17 Feb 2023
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimation3 Feb 2023
- 2023HSTFormer: Hierarchical Spatial-Temporal Transformers for 3D Human Pose Estimation18 Jan 2023
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fields16 Dec 2022
- 2022Cross-Modal Learning with 3D Deformable Attention for Action Recognition12 Dec 2022
- 2022Leveraging Spatio-Temporal Dependency for Skeleton-Based Action Recognition9 Dec 2022
- 2022STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognition14 Oct 2022
- 2022Mutual Adaptive Reasoning for Monocular 3D Multi-Person Pose Estimation16 Jul 2022
- 2022GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimation13 Jun 2022
50 newest of 62 All 62 (JSON)
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2022P-STMO: Pre-Trained Spatial Temporal Many-to-One Model for 3D Human Pose Estimationcited by 80
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2023Learning Discriminative Representations for Skeleton Based Action Recognitioncited by 62
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fieldscited by 57
- 2023SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modelingcited by 54
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 46
- 2024SkateFormer: Skeletal-Temporal Transformer for Human Action Recognitioncited by 46
- 2022STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognitioncited by 43
- 2022DeciWatch: A Simple Baseline for 10x Efficient 2D and 3D Pose Estimationcited by 29
12 most cited of 59 All 59 (JSON)
- 2026DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimation5 Jun 2026
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation10 Mar 2026
- 2025Adaptive graph Kolmogorov-Arnold network for 3D human pose estimation11 Nov 2025
- 2025HGFreNet: Hop-hybrid GraphFomer for 3D Human Pose Estimation with Trajectory Consistency in Frequency Domain3 Nov 2025
- 2025PoseGRAF: Geometric-Reinforced Adaptive Fusion for Monocular 3D Human Pose Estimation17 Jun 2025
- 2025Learning Pyramid-structured Long-range Dependencies for 3D Human Pose Estimation3 Jun 2025
- 2025Rodrigues Network for Learning Robot Actions3 Jun 2025
- 2025NanoHTNet: Nano Human Topology Network for Efficient 3D Human Pose Estimation27 Jan 2025
- 2024Synchronized and Fine-Grained Head for Skeleton-Based Ambiguous Action Recognition19 Dec 2024
- 2024MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls30 Jul 2024
- 2024Flexible graph convolutional network for 3D human pose estimation26 Jul 2024
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimation15 Jul 2024
12 newest of 59 All 59 (JSON)