mlsanityData to 14 Oct 2026

3D WholeBody Pose Estimation based on Semantic Graph Attention Network and Distance Information

arXiv 2406.01196 ↗First posted 3 Jun 2024cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

In recent years, a plethora of diverse methods have been proposed for 3D pose estimation. Among these, self-attention mechanisms and graph convolutions have both been proven to be effective and practical methods. Recognizing the strengths of those two techniques, we have developed a novel Semantic Graph Attention Network which can benefit from the ability of self-attention to capture global context, while also utilizing the graph convolutions to handle the local connectivity and structural constraints of the skeleton. We also design a Body Part Decoder that assists in extracting and refining the information related to specific segments of the body. Furthermore, our approach incorporates Distance Information, enhancing our model's capability to comprehend and accurately predict spatial relationships. Finally, we introduce a Geometry Loss who makes a critical constraint on the structural skeleton of the body, ensuring that the model's predictions adhere to the natural limits of human posture. The experimental results validate the effectiveness of our approach, demonstrating that every element within the system is essential for improving pose estimation outcomes. With comparison to state-of-the-art, the proposed work not only meets but exceeds the existing benchmarks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 38 references that are in the map. First posted on arXiv 3 Jun 2024.

Builds on

34 of 38 references.

References · 34

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  5. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  6. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  7. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  8. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  9. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
  10. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 418
  11. 20183D human pose estimation in video with temporal convolutions and semi-supervised trainingcited by 403
  12. 2017A simple yet effective baseline for 3d human pose estimationcited by 401
22 more
  1. 2014Recurrent Models of Visual Attentioncited by 349
  2. 2018Graph R-CNN for Scene Graph Generationcited by 298
  3. 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
  4. 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 221
  5. 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
  6. 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
  7. 20193D Hand Shape and Pose from Images in the Wildcited by 190
  8. 2020Whole-Body Human Pose Estimation in the Wildcited by 178
  9. 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
  10. 2017Compositional Human Pose Regressioncited by 124
  11. 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 115
  12. 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 95
  13. 2018LCR-Net++: Multi-person 2D and 3D Pose Detection in Natural Imagescited by 88
  14. 2017Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regressioncited by 66
  15. 2020CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the Wildcited by 65
  16. 2021Model-based 3D Hand Reconstruction via Self-Supervised Learningcited by 65
  17. 2019In the Wild Human Pose Estimation Using Explicit 2D Features and Intermediate 3D Representationscited by 48
  18. 2021Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Predictioncited by 48
  19. 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
  20. 2022Jointformer: Single-Frame Lifting Transformer with Error Prediction and Refinement for 3D Human Pose Estimationcited by 10
  21. 20233D-LFM: Lifting Foundation Modelcited by 8
  22. 2017Pix2face: Direct 3D Face Model Estimationcited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025PriorFormer: A Transformer for Real-time Monocular 3D Human Pose Estimation with Versatile Geometric Priorscited by 1