mlsanityData to 7 Oct 2026

3D Human Pose Estimation Based on 2D-3D Consistency with Synchronized Adversarial Training

arXiv 2106.04274 ↗First posted 8 Jun 2021cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

3D human pose estimation from a single image is still a challenging problem despite the large amount of work that has been performed in this field. Generally, most methods directly use neural networks and ignore certain constraints (e.g., reprojection constraints, joint angle, and bone length constraints). While a few methods consider these constraints but train the network separately, they cannot effectively solve the depth ambiguity problem. In this paper, we propose a GAN-based model for 3D human pose estimation, in which a reprojection network is employed to learn the mapping of the distribution from 3D poses to 2D poses, and a discriminator is employed for 2D-3D consistency discrimination. We adopt a novel strategy to synchronously train the generator, the reprojection network and the discriminator. Furthermore, inspired by the typical kinematic chain space (KCS) matrix, we introduce a weighted KCS matrix and take it as one of the discriminator's inputs to impose joint angle and bone length constraints. The experimental results on Human3.6M show that our method significantly outperforms state-of-the-art methods in most cases.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 8 Jun 2021.

Builds on

37 of 49 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  3. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  4. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  5. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
  6. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  7. 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 515
  8. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
  9. 2017A simple yet effective baseline for 3d human pose estimationcited by 401
  10. 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
  11. 2017Integral Human Pose Regressioncited by 255
  12. 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 220
25 more
  1. 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
  2. 2015Human Pose Estimation with Iterative Error Feedbackcited by 121
  3. 2015DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimationcited by 117
  4. 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 114
  5. 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 111
  6. 2017Self-supervised Learning of Motion Capturecited by 97
  7. 2019Unsupervised 3D Pose Estimation with Geometric Self-Supervisioncited by 95
  8. 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 94
  9. 20183D Human Pose Estimation in the Wild by Adversarial Learningcited by 86
  10. 2019RepNet: Weakly Supervised Training of an Adversarial Reprojection Network for 3D Human Pose Estimationcited by 85
  11. 20163D Human Pose Estimation from a Single Image via Distance Matrix Regressioncited by 73
  12. 2018Unsupervised Geometry-Aware Representation for 3D Human Pose Estimationcited by 73
  13. 2020Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wildcited by 66
  14. 2020CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the Wildcited by 65
  15. 2015Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Videocited by 54
  16. 2016Human pose estimation via Convolutional Part Heatmap Regressioncited by 51
  17. 2018OriNet: A Fully Convolutional Network for 3D Human Pose Estimationcited by 28
  18. 2017Adversarial Inverse Graphics Networks: Learning 2D-to-3D Lifting and Image-to-Image Translation from Unpaired Supervisioncited by 27
  19. 20213D Human Pose, Shape and Texture from Low-Resolution Images and Videoscited by 26
  20. 2021Unsupervised Human Pose Estimation through Transforming Shape Templatescited by 26
  21. 2020Weakly Supervised Generative Network for Multiple 3D Human Pose Hypothesescited by 25
  22. 2016Single Image 3D Interpreter Networkcited by 19
  23. 2018Unsupervised Adversarial Learning of 3D Human Pose from 2D Joint Locationscited by 18
  24. 2015Sparse Representation for 3D Shape Estimation: A Convex Relaxation Approachcited by 16
  25. 2019Lifting 2d Human Pose to 3d : A Weakly Supervised Approachcited by 4

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.

  1. 2023Global Adaptation meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimationcited by 19