Learning Transferable Kinematic Dictionary for 3D Human Pose and Shape Reconstruction
Not on the map. Why?
Abstract (arXiv)
Estimating 3D human pose and shape from a single image is highly under-constrained. To address this ambiguity, we propose a novel prior, namely kinematic dictionary, which explicitly regularizes the solution space of relative 3D rotations of human joints in the kinematic tree. Integrated with a statistical human model and a deep neural network, our method achieves end-to-end 3D reconstruction without the need of using any shape annotations during the training of neural networks. The kinematic dictionary bridges the gap between in-the-wild images and 3D datasets, and thus facilitates end-to-end training across all types of datasets. The proposed method achieves competitive results on large-scale datasets including Human3.6M, MPI-INF-3DHP, and LSP, while running in real-time given the human bounding boxes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 2 Apr 2021.
Builds on
38 of 56 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
26 more
- 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 337
- 2016Convolutional Pose Machinescited by 325
- 2018Learning 3D Human Dynamics from Videocited by 315
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2017Integral Human Pose Regressioncited by 255
- 2018Learning to Estimate 3D Human Pose and Shape from a Single Color Imagecited by 226
- 2016Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Posecited by 220
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
- 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
- 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
- 2017Compositional Human Pose Regressioncited by 124
- 2017Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approachcited by 114
- 20163D Human Pose Estimation = 2D Pose Estimation + Matchingcited by 112
- 20182D/3D Pose Estimation and Action Recognition using Multitask Deep Learningcited by 103
- 20163D Human Pose Estimation from a Single Image via Distance Matrix Regressioncited by 73
- 2015Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Videocited by 54
- 2016Deep Kinematic Pose Regressioncited by 40
- 2016MoCap-guided Data Augmentation for 3D Pose Estimation in the Wildcited by 37
- 2020Motion Capture from Internet Videoscited by 33
- 2014Robust Estimation of 3D Human Poses from a Single Imagecited by 23
- 20143D Shape Estimation from 2D Landmarks: A Convex Relaxation Approachcited by 11
- 2018Monocular 3D Pose Recovery via Nonconvex Sparsity with Theoretical Analysiscited by 1
Built on by
Not cited yet.