Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Image
Not on the map. Why?
Abstract (arXiv)
We propose a unified formulation for the problem of 3D human pose estimation from a single raw RGB image that reasons jointly about 2D joint estimation and 3D pose reconstruction to improve both tasks. We take an integrated approach that fuses probabilistic knowledge of 3D human pose with a multi-stage CNN architecture and uses the knowledge of plausible 3D landmark locations to refine the search for better 2D locations. The entire process is trained end-to-end, is extremely efficient and obtains state- of-the-art results on Human3.6M outperforming previous approaches both on 2D and 3D errors.
Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jan 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 18; 2023: 18; 2024: 5; 2025: 4.
73 papers.
Sort:
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2023Human Motion Generation: A Surveycited by 95
- 2021Neural Monocular 3D Human Motion Capture with Physical Awarenesscited by 70
- 2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2021Body Meshes as Pointscited by 45
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
- 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimationcited by 32
- 2021Hand Image Understanding via Deep Multi-Task Learningcited by 31
- 2021Gravity-Aware Monocular 3D Human-Object Reconstructioncited by 30
38 more
- 2022HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidancecited by 29
- 2021KAMA: 3D Keypoint Aware Body Mesh Articulationcited by 27
- 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localizationcited by 25
- 2021DECA: Deep viewpoint-Equivariant human pose estimation using Capsule Autoencoderscited by 23
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDARcited by 23
- 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenescited by 18
- 2023Improving 3D Pose Estimation for Sign Languagecited by 16
- 2021Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Networkcited by 13
- 2021Human Pose and Shape Estimation from Single Polarization Imagescited by 13
- 2022MotionAug: Augmentation with Physical Correction for Human Motion Predictioncited by 13
- 2023A Hybrid ANN-SNN Architecture for Low-Power and Low-Latency Visual Perceptioncited by 13
- 2023Markerless human pose estimation for biomedical applications: a surveycited by 13
- 2022HiFECap: Monocular High-Fidelity and Expressive Capture of Human Performancescited by 12
- 2021Everybody Is Unique: Towards Unbiased Human Mesh Recoverycited by 10
- 2022On Triangulation as a Form of Self-Supervision for 3D Human Pose Estimationcited by 10
- 2021Iterative Greedy Matching for 3D Human Pose Tracking from Multiple Viewscited by 9
- 20213D Human Pose Regression using Graph Convolutional Networkcited by 8
- 2023Self-supervised 3D Human Pose Estimation from a Single Imagecited by 8
- 2021Pose and Semantic Map Based Probabilistic Forecast of Vulnerable Road Users' Trajectoriescited by 6
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypointscited by 6
- 2023LInKs "Lifting Independent Keypoints" -- Partial Pose Lifting for Occlusion Handling with Improved Accuracy in 2D-3D Human Pose Estimationcited by 6
- 2024HumMUSS: Human Motion Understanding using State Space Modelscited by 6
- 2022Enhancing Egocentric 3D Pose Estimation with Third Person Viewscited by 5
- 2023Video-based Contrastive Learning on Decision Trees: from Action Recognition to Autism Diagnosiscited by 5
- 2023Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Modelscited by 5
- 2021PoseKernelLifter: Metric Lifting of 3D Human Pose using Soundcited by 4
- 2022A Simple Method to Boost Human Pose Estimation Accuracy by Correcting the Joint Regressor for the Human3.6m Datasetcited by 4
- 2023CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Surveycited by 4
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Inputcited by 4
- 2024Human Modelling and Pose Estimation Overviewcited by 4
- 2021Temporal Consistency Loss for High Resolution Textured and Clothed 3DHuman Reconstruction from Monocular Videocited by 3
- 2021SVMAC: Unsupervised 3D Human Pose Estimation from a Single Image with Single-view-multi-angle Consistencycited by 3
- 2021TriPose: A Weakly-Supervised 3D Human Pose Estimation via Triangulation from Videocited by 2
- 2021PONet: Robust 3D Human Pose Estimation via Learning Orientations Onlycited by 2
- 2023Understanding Pose and Appearance Disentanglement in 3D Human Pose Estimationcited by 2
- 20243D Human Pose Estimation with Occlusions: Introducing BlendMimic3D Dataset and GCN Refinementcited by 2
- 2025RAPTR: Radar-based 3D Pose Estimation using Transformercited by 2
- 2021On the role of depth predictions for 3D human pose estimationcited by 1
50 most cited of 73 All 73 (JSON)
- 2025RAPTR: Radar-based 3D Pose Estimation using Transformer11 Nov 2025
- 2025Bimanual 3D Hand Motion and Articulation Forecasting in Everyday Images7 Oct 2025
- 2025EHPE: A Segmented Architecture for Enhanced Hand Pose Estimation13 Jul 2025
- 2025IMASHRIMP: Automatic White Shrimp (Penaeus vannamei) Biometrical Analysis from Laboratory Images Using Computer Vision and Deep Learning3 Jul 2025
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024Multi-hop graph transformer network for 3D human pose estimation5 May 2024
- 20243D Human Pose Estimation with Occlusions: Introducing BlendMimic3D Dataset and GCN Refinement24 Apr 2024
- 2024HumMUSS: Human Motion Understanding using State Space Models16 Apr 2024
- 2024Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignment15 Apr 2024
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Input11 Dec 2023
- 2023RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling24 Nov 2023
- 2023Understanding Pose and Appearance Disentanglement in 3D Human Pose Estimation20 Sep 2023
38 more
- 2023LInKs "Lifting Independent Keypoints" -- Partial Pose Lifting for Occlusion Handling with Improved Accuracy in 2D-3D Human Pose Estimation13 Sep 2023
- 2023PoseGraphNet++: Enriching 3D Human Pose with Orientation Estimation22 Aug 2023
- 2023Improving 3D Pose Estimation for Sign Language18 Aug 2023
- 2023Vision-based Semantic Communications for Metaverse Services: A Contest Theoretic Approach15 Aug 2023
- 2023Markerless human pose estimation for biomedical applications: a survey1 Aug 2023
- 2023Iterative Graph Filtering Network for 3D Human Pose Estimation29 Jul 2023
- 2023Human Motion Generation: A Survey20 Jul 2023
- 2023Gait Data Augmentation using Physics-Based Biomechanical Simulation16 Jul 2023
- 2023Human Body Pose Estimation for Gait Identification: A Comprehensive Survey of Datasets and Models23 May 2023
- 2023Video-based Contrastive Learning on Decision Trees: from Action Recognition to Autism Diagnosis20 Apr 2023
- 2023Self-supervised 3D Human Pose Estimation from a Single Image5 Apr 2023
- 2023Novel View Synthesis of Humans using Differentiable Rendering28 Mar 2023
- 2023A Hybrid ANN-SNN Architecture for Low-Power and Low-Latency Visual Perception24 Mar 2023
- 2023Capsules as viewpoint learners for human pose estimation13 Feb 2023
- 2023CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Survey15 Jan 2023
- 2022Recovering Surveillance Video Using RF Cues27 Dec 2022
- 2022Weakly Supervised 3D Multi-person Pose Estimation for Large-scale Scenes based on Monocular Camera and Single LiDAR30 Nov 2022
- 2022Multi-view Gait Recognition based on Siamese Vision Transformer19 Oct 2022
- 2022HiFECap: Monocular High-Fidelity and Expressive Capture of Human Performances11 Oct 2022
- 2022Optimising 2D Pose Representation: Improve Accuracy, Stability and Generalisability Within Unsupervised 2D-3D Human Pose Estimation1 Sep 2022
- 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenes17 Aug 2022
- 2022Szloca: towards a framework for full 3D tracking through a single camera in context of interactive arts26 Jun 2022
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypoints24 Jun 2022
- 2022"Teaching Independent Parts Separately" (TIPSy-GAN) : Improving Accuracy and Stability in Unsupervised Adversarial 2D to 3D Pose Estimation12 May 2022
- 2022HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidance11 May 2022
- 2022A Simple Method to Boost Human Pose Estimation Accuracy by Correcting the Joint Regressor for the Human3.6m Dataset29 Apr 2022
- 2022Visual-based Positioning and Pose Estimation20 Apr 2022
- 2022On Triangulation as a Form of Self-Supervision for 3D Human Pose Estimation29 Mar 2022
- 2022Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localization22 Mar 2022
- 2022MotionAug: Augmentation with Physical Correction for Human Motion Prediction17 Mar 2022
- 2022Human-Aware Object Placement for Visual Environment Reconstruction7 Mar 2022
- 2022Learning from the Pros: Extracting Professional Goalkeeper Technique from Broadcast Footage22 Feb 2022
- 2022Enhancing Egocentric 3D Pose Estimation with Third Person Views6 Jan 2022
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Driving22 Dec 2021
- 2021PONet: Robust 3D Human Pose Estimation via Learning Orientations Only21 Dec 2021
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Poses14 Dec 2021
- 2021PoseKernelLifter: Metric Lifting of 3D Human Pose using Sound1 Dec 2021
- 2021Human Pose Manipulation and Novel View Synthesis using Differentiable Rendering24 Nov 2021
50 newest of 73 All 73 (JSON)
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2023Human Motion Generation: A Surveycited by 95
- 2021Neural Monocular 3D Human Motion Capture with Physical Awarenesscited by 70
- 2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2021Body Meshes as Pointscited by 45
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
- 2021TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimationcited by 32
- 2021Hand Image Understanding via Deep Multi-Task Learningcited by 31
- 2021Gravity-Aware Monocular 3D Human-Object Reconstructioncited by 30
12 most cited of 73 All 73 (JSON)
- 2025RAPTR: Radar-based 3D Pose Estimation using Transformer11 Nov 2025
- 2025Bimanual 3D Hand Motion and Articulation Forecasting in Everyday Images7 Oct 2025
- 2025EHPE: A Segmented Architecture for Enhanced Hand Pose Estimation13 Jul 2025
- 2025IMASHRIMP: Automatic White Shrimp (Penaeus vannamei) Biometrical Analysis from Laboratory Images Using Computer Vision and Deep Learning3 Jul 2025
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024Multi-hop graph transformer network for 3D human pose estimation5 May 2024
- 20243D Human Pose Estimation with Occlusions: Introducing BlendMimic3D Dataset and GCN Refinement24 Apr 2024
- 2024HumMUSS: Human Motion Understanding using State Space Models16 Apr 2024
- 2024Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignment15 Apr 2024
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Input11 Dec 2023
- 2023RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling24 Nov 2023
- 2023Understanding Pose and Appearance Disentanglement in 3D Human Pose Estimation20 Sep 2023
12 newest of 73 All 73 (JSON)