Cascaded deep monocular 3D human pose estimation with evolutionary training data
Not on the map. Why?
Abstract (arXiv)
End-to-end deep representation learning has achieved remarkable accuracy for monocular 3D human pose estimation, yet these models may fail for unseen poses with limited and fixed training data. This paper proposes a novel data augmentation method that: (1) is scalable for synthesizing massive amount of training data (over 8 million valid 3D human poses with corresponding 2D projections) for training 2D-to-3D networks, (2) can effectively reduce dataset bias. Our method evolves a limited dataset to synthesize unseen 3D human skeletons based on a hierarchical human representation and heuristics inspired by prior knowledge. Extensive experiments show that our approach not only achieves state-of-the-art accuracy on the largest public benchmark, but also generalizes significantly better to unseen and rare poses. Code, pre-trained models and tools are available at this HTTPS URL.
Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 19; 2023: 20; 2024: 10; 2025: 8; 2026: 4.
80 papers.
Sort:
By area:
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 91
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 88
- 2021Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flowscited by 84
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2023Human Pose as Compositional Tokenscited by 45
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
38 more
- 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformerscited by 33
- 2021AdaptPose: Cross-Dataset Adaptation for 3D Human Pose Estimation by Learnable Motion Generationcited by 32
- 2022Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimationcited by 25
- 2022PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervisioncited by 25
- 2023Back to Optimization: Diffusion-based Zero-Shot 3D Human Pose Estimationcited by 24
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimationcited by 23
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Surveycited by 20
- 2021Adaptive Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimationcited by 19
- 2023Global Adaptation meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimationcited by 19
- 2021Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimationcited by 18
- 2024Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Rangingcited by 18
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimationcited by 15
- 2022PoseTrans: A Simple Yet Effective Pose Transformation Augmentation for Human Pose Estimationcited by 14
- 2021Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systemscited by 13
- 2022Dual networks based 3D Multi-Person Pose Estimation from Monocular Videocited by 13
- 2023PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimationcited by 12
- 2022CrossFormer: Cross Spatio-Temporal Transformer for 3D Human Pose Estimationcited by 11
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimationcited by 11
- 2022On Triangulation as a Form of Self-Supervision for 3D Human Pose Estimationcited by 10
- 2022VirtualPose: Learning Generalizable 3D Human Pose Models from Virtual Datacited by 10
- 2022A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trendscited by 9
- 2021Deep Monocular 3D Human Pose Estimation via Cascaded Dimension-Liftingcited by 8
- 2022DH-AUG: DH Forward Kinematics Model Driven Augmentation for 3D Human Pose Estimationcited by 8
- 2022Non-Local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimationcited by 6
- 2023CameraPose: Weakly-Supervised Monocular 3D Human Pose Estimation by Leveraging In-the-wild 2D Annotationscited by 6
- 2023Lifting by Image -- Leveraging Image Cues for Accurate 3D Human Pose Estimationcited by 6
- 2024Optimal-state Dynamics Estimation for Physics-based Human Motion Capture from Videoscited by 6
- 2021Motion Projection Consistency Based 3D Human Pose Estimation with Virtual Bones from Monocular Videoscited by 5
- 2024KITRO: Refining Human Mesh by 2D Clues and Kinematic-tree Rotationcited by 5
- 2024GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correctioncited by 5
- 2025H2OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformerscited by 5
- 2021Lifting 2D Human Pose to 3D with Domain Adapted 3D Body Conceptcited by 4
- 2022HAA4D: Few-Shot Human Atomic Action Recognition via 3D Spatio-Temporal Skeletal Alignmentcited by 4
- 2022PoseGU: 3D Human Pose Estimation with Novel Human Pose Generator and Unbiased Learningcited by 4
- 2022Computer Vision to the Rescue: Infant Postural Symmetry Estimation from Incongruent Annotationscited by 4
- 2023MPM: A Unified 2D-3D Human Pose Representation via Masked Pose Modelingcited by 4
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Inputcited by 4
- 2024Human Modelling and Pose Estimation Overviewcited by 4
50 most cited of 80 All 80 (JSON)
- 2026STA-TFM: Spatio-Temporal Aggregation Across Views TransForMer for Pose Estimation21 Sep 2026
- 2026Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling25 Jun 2026
- 2026QuaMo: Quaternion Motions for Vision-based 3D Human Kinematics Capture27 Jan 2026
- 2026On the Role of Rotation Equivariance in Monocular 2D-to-3D Human Pose Lifting20 Jan 2026
- 2025Lifelong Domain Adaptive 3D Human Pose Estimation29 Dec 2025
- 2025RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting17 Dec 2025
- 2025H2OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformers8 Sep 2025
- 2025HyperDiff: Hypergraph Guided Diffusion Model for 3D Human Pose Estimation20 Aug 2025
- 2025Spectral Compression Transformer with Line Pose Graph for Monocular 3D Human Pose Estimation27 May 2025
- 2025Mamba-Driven Topology Fusion for Monocular 3D Human Pose Estimation27 May 2025
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms17 Apr 2025
- 2025Toward Efficient Generalization in 3D Human Pose Estimation via a Canonical Domain Approach27 Jan 2025
38 more
- 2024GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correction11 Nov 2024
- 2024Occluded Human Pose Estimation based on Limb Joint Augmentation13 Oct 2024
- 2024Optimal-state Dynamics Estimation for Physics-based Human Motion Capture from Videos10 Oct 2024
- 2024ESCAPE: Energy-based Selective Adaptive Correction for Out-of-distribution 3D Human Pose Estimation19 Jul 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024KITRO: Refining Human Mesh by 2D Clues and Kinematic-tree Rotation30 May 2024
- 2024Probablistic Restoration with Adaptive Noise Sampling for 3D Human Pose Estimation3 May 2024
- 2024Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging30 Apr 2024
- 2024Data Augmentation in Human-Centric Vision13 Mar 2024
- 2024Exploring Latent Cross-Channel Embedding for Accurate 3D Human Pose Reconstruction in a Diffusion Framework18 Jan 2024
- 2023Lifting by Image -- Leveraging Image Cues for Accurate 3D Human Pose Estimation25 Dec 2023
- 2023PoseGen: Learning to Generate 3D Human Pose Dataset with NeRF22 Dec 2023
- 2023Improving the Robustness of 3D Human Pose Estimation: A Benchmark and Learning from Noisy Input11 Dec 2023
- 2023Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation20 Nov 2023
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation6 Nov 2023
- 2023Augmenting Vision-Based Human Pose Estimation with Rotation Matrix9 Oct 2023
- 2023Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing28 Sep 2023
- 2023Text2Control3D: Controllable 3D Avatar Generation in Neural Radiance Fields using Geometry-Guided Text-to-Image Diffusion Model7 Sep 2023
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Survey26 Aug 2023
- 2023PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimation18 Aug 2023
- 2023Back to Optimization: Diffusion-based Zero-Shot 3D Human Pose Estimation7 Jul 2023
- 2023MPM: A Unified 2D-3D Human Pose Representation via Masked Pose Modeling29 Jun 2023
- 2023ConvFormer: Parameter Reduction in Transformer Models for 3D Human Pose Estimation by Leveraging Dynamic Multi-Headed Convolutional Attention4 Apr 2023
- 2023A real-time algorithm for human action recognition in RGB and thermal video4 Apr 2023
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimation30 Mar 2023
- 2023Global Adaptation meets Local Generalization: Unsupervised Domain Adaptation for 3D Human Pose Estimation29 Mar 2023
- 2023Human Pose as Compositional Tokens21 Mar 2023
- 20233D Human Pose Lifting with Grid Convolution17 Feb 2023
- 2023HDFormer: High-order Directed Transformer for 3D Human Pose Estimation3 Feb 2023
- 2023CameraPose: Weakly-Supervised Monocular 3D Human Pose Estimation by Leveraging In-the-wild 2D Annotations8 Jan 2023
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models29 Nov 2022
- 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformers12 Oct 2022
- 2022Decanus to Legatus: Synthetic training for 2D-3D human pose lifting5 Oct 2022
- 2022A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trends14 Sep 2022
- 2022PoseTrans: A Simple Yet Effective Pose Transformation Augmentation for Human Pose Estimation16 Aug 2022
- 2022VirtualPose: Learning Generalizable 3D Human Pose Models from Virtual Data20 Jul 2022
- 2022Computer Vision to the Rescue: Infant Postural Symmetry Estimation from Incongruent Annotations19 Jul 2022
- 2022DH-AUG: DH Forward Kinematics Model Driven Augmentation for 3D Human Pose Estimation19 Jul 2022
50 newest of 80 All 80 (JSON)
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2023Text2Control3D: Controllable 3D Avatar Generation in Neural Radiance Fields using Geometry-Guided Text-to-Image Diffusion Modelcited by 3
- 2025HyperDiff: Hypergraph Guided Diffusion Model for 3D Human Pose Estimationcited by 0
- 2025HyperDiff: Hypergraph Guided Diffusion Model for 3D Human Pose Estimation20 Aug 2025
- 2023Text2Control3D: Controllable 3D Avatar Generation in Neural Radiance Fields using Geometry-Guided Text-to-Image Diffusion Model7 Sep 2023
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models29 Nov 2022
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 271
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 158
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 91
- 2021PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimationcited by 88
- 2021Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flowscited by 84
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2023Human Pose as Compositional Tokenscited by 45
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
- 2022Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformerscited by 33
12 most cited of 76 All 76 (JSON)
- 2026STA-TFM: Spatio-Temporal Aggregation Across Views TransForMer for Pose Estimation21 Sep 2026
- 2026Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling25 Jun 2026
- 2026QuaMo: Quaternion Motions for Vision-based 3D Human Kinematics Capture27 Jan 2026
- 2026On the Role of Rotation Equivariance in Monocular 2D-to-3D Human Pose Lifting20 Jan 2026
- 2025Lifelong Domain Adaptive 3D Human Pose Estimation29 Dec 2025
- 2025RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting17 Dec 2025
- 2025H2OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformers8 Sep 2025
- 2025Spectral Compression Transformer with Line Pose Graph for Monocular 3D Human Pose Estimation27 May 2025
- 2025Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms17 Apr 2025
- 2025Toward Efficient Generalization in 3D Human Pose Estimation via a Canonical Domain Approach27 Jan 2025
- 2024GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correction11 Nov 2024
- 2024Occluded Human Pose Estimation based on Limb Joint Augmentation13 Oct 2024
12 newest of 76 All 76 (JSON)