Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flows
Not on the map. Why?
Abstract (arXiv)
3D human pose estimation from monocular images is a highly ill-posed problem due to depth ambiguities and occlusions. Nonetheless, most existing works ignore these ambiguities and only estimate a single solution. In contrast, we generate a diverse set of hypotheses that represents the full posterior distribution of feasible 3D poses. To this end, we propose a normalizing flow based method that exploits the deterministic 3D-to-2D mapping to solve the ambiguous inverse 2D-to-3D problem. Additionally, uncertain detections and occlusions are effectively modeled by incorporating uncertainty information of the 2D detector as condition. Further keys to success are a learned 3D pose prior and a generalization of the best-of-M loss. We evaluate our approach on the two benchmark datasets Human3.6M and MPI-INF-3DHP, outperforming all comparable methods in most metrics. The implementation is available on GitHub.
Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). Builds on 37 of its 56 references that are in the map. First posted on arXiv 29 Jul 2021.
Builds on
37 of 56 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2016Density estimation using Real NVPcited by 2,042
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2017Masked Autoregressive Flow for Density Estimationcited by 684
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
25 more
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
- 2017A simple yet effective baseline for 3d human pose estimationcited by 401
- 2015MADE: Masked Autoencoder for Distribution Estimationcited by 307
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 307
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 242
- 2020Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flowscited by 212
- 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
- 2019Learning Likelihoods with Conditional Normalizing Flowscited by 172
- 2019Guided Image Generation with Conditional Invertible Neural Networkscited by 147
- 20163D Human Pose Estimation = 2D Pose Estimation + Matchingcited by 113
- 2020Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flowscited by 94
- 2019Generating Multiple Hypotheses for 3D Human Pose Estimation with Mixture Density Networkcited by 92
- 2019RepNet: Weakly Supervised Training of an Adversarial Reprojection Network for 3D Human Pose Estimationcited by 85
- 2020Cascaded deep monocular 3D human pose estimation with evolutionary training datacited by 80
- 2019Monocular 3D Human Pose Estimation by Generation and Ordinal Rankingcited by 76
- 20163D Human Pose Estimation from a Single Image via Distance Matrix Regressioncited by 73
- 2020CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the Wildcited by 65
- 2020PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Timecited by 50
- 20203D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image Datacited by 50
- 2019In the Wild Human Pose Estimation Using Explicit 2D Features and Intermediate 3D Representationscited by 48
- 2017Generating Multiple Diverse Hypotheses for Human 3D Pose Consistent with 2D Joint Detectionscited by 30
- 2020GraphMDN: Leveraging graph structure and deep learning to solve inverse problemscited by 26
- 2020Weakly Supervised Generative Network for Multiple 3D Human Pose Hypothesescited by 25
- 2019Not All Parts Are Created Equal: 3D Pose Estimation by Modelling Bi-directional Dependencies of Body Partscited by 19
- 2017A Kinematic Chain Space for Monocular Motion Capturecited by 8
Built on by
Citing papers per year: 2021: 4; 2022: 19; 2023: 22; 2024: 24; 2025: 8; 2026: 8.
85 papers.
Sort:
By area:
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 159
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2021Fully Convolutional Cross-Scale-Flows for Image-based Defect Detectioncited by 117
- 2022Asymmetric Student-Teacher Networks for Industrial Anomaly Detectioncited by 117
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 82
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fieldscited by 57
- 2021Hierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wildcited by 48
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 47
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
38 more
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
- 2024KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimationcited by 34
- 2023Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Viewscited by 33
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Modelcited by 29
- 2024NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priorscited by 27
- 2023The Treasure Beneath Multiple Annotations: An Uncertainty-aware Edge Detectorcited by 25
- 2024SplatPose & Detect: Pose-Agnostic 3D Anomaly Detectioncited by 25
- 2023HuManiFlow: Ancestor-Conditioned Normalising Flows on SO(3) Manifolds for Human Pose and Shape Distribution Estimationcited by 24
- 2023Back to Optimization: Diffusion-based Zero-Shot 3D Human Pose Estimationcited by 24
- 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Modelscited by 23
- 20222D Human Pose Estimation: A Surveycited by 21
- 2023POCO: 3D Pose and Shape Estimation with Confidencecited by 21
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Surveycited by 20
- 2023Pose-Oriented Transformer with Uncertainty-Guided Refinement for 2D-to-3D Human Pose Estimationcited by 19
- 2023Markerless human pose estimation for biomedical applications: a surveycited by 13
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humanscited by 13
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 12
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimationcited by 11
- 2024EnvPoser: Environment-aware Realistic Human Motion Estimation from Sparse Observations with Uncertainty Modelingcited by 11
- 2022Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimationcited by 10
- 2023On the Calibration of Human Pose Estimationcited by 10
- 2022Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimationcited by 9
- 2022Dynamic Graph Reasoning for Multi-person 3D Pose Estimationcited by 9
- 2022Self-supervised Human Mesh Recovery with Cross-Representation Alignmentcited by 9
- 2022VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose Estimationcited by 9
- 2022Progressive Multi-view Human Mesh Recovery with Self-Supervisioncited by 9
- 2023DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusioncited by 9
- 2023Self-supervised 3D Human Pose Estimation from a Single Imagecited by 8
- 2023Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstructioncited by 8
- 2022MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Viewscited by 7
- 2023Lightweight Super-Resolution Head for Human Pose Estimationcited by 7
- 2023The voraus-AD Dataset for Anomaly Detection in Robot Applicationscited by 7
- 2022Multi-hypothesis 3D human pose estimation metrics favor miscalibrated distributionscited by 6
- 2022Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledgecited by 6
- 2023ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimationcited by 6
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimationcited by 6
- 2022HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flowcited by 5
- 2024Quantum Normalizing Flows for Anomaly Detectioncited by 5
50 most cited of 85 All 85 (JSON)
- 2026Kinematics-Induced Multimodal 3D Human Pose Estimation with Subject-Level Privacy2 Oct 2026
- 2026CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image1 Sep 2026
- 2026MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation31 Aug 2026
- 2026You Only Flow Once: Calibrated and Real-Time Radar Pose Estimation with Multi-Hypothesis Normalizing Flows10 Aug 2026
- 2026FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery14 May 2026
- 2026FMPose3D: monocular 3D pose estimation via flow matching5 Feb 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2026Flow Matching for Probabilistic Monocular 3D Human Pose Estimation23 Jan 2026
- 2025PoseMoE: Mixture-of-Experts Network for Monocular 3D Human Pose Estimation18 Dec 2025
- 2025Adversarially-Refined VQ-GAN with Dense Motion Tokenization for Spatio-Temporal Heatmaps23 Sep 2025
- 2025VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusions9 Aug 2025
- 2025A Structure-aware and Motion-adaptive Framework for 3D Human Pose Estimation with Mamba26 Jul 2025
38 more
- 2025HDiffTG: A Lightweight Hybrid Diffusion-Transformer-GCN Architecture for 3D Human Pose Estimation7 May 2025
- 2025Multi-Flow: Multi-View-Enriched Normalizing Flows for Industrial Anomaly Detection4 Apr 2025
- 2025MoFM: A Large-Scale Human Motion Foundation Model8 Feb 2025
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimation9 Jan 2025
- 2024Optimizing Local-Global Dependencies for Accurate 3D Human Pose Estimation27 Dec 2024
- 2024CondiMen: Conditional Multi-Person Mesh Recovery17 Dec 2024
- 2024EnvPoser: Environment-aware Realistic Human Motion Estimation from Sparse Observations with Uncertainty Modeling13 Dec 2024
- 2024CUPS: Improving Human Pose-Shape Estimators with Conformalized Deep Uncertainty11 Dec 2024
- 2024Utilizing Uncertainty in 2D Pose Detectors for Probabilistic 3D Human Mesh Recovery25 Nov 2024
- 2024GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correction11 Nov 2024
- 2024Social EgoMesh Estimation7 Nov 2024
- 2024Enhancing 3D Human Pose Estimation Amidst Severe Occlusion with Dual Transformer Fusion6 Oct 2024
- 2024Occlusion-Aware 3D Motion Interpretation for Abnormal Behavior Detection23 Jul 2024
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimation15 Jul 2024
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimators27 May 2024
- 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models8 May 2024
- 2024Probablistic Restoration with Adaptive Noise Sampling for 3D Human Pose Estimation3 May 2024
- 2024Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Training30 Apr 2024
- 2024PoseINN: Realtime Visual-based Pose Regression and Localization with Invertible Neural Networks20 Apr 2024
- 2024SplatPose & Detect: Pose-Agnostic 3D Anomaly Detection10 Apr 2024
- 2024An Animation-based Augmentation Approach for Action Recognition from Discontinuous Video10 Apr 2024
- 2024KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimation31 Mar 2024
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans30 Mar 2024
- 2024Personalized 3D Human Pose and Shape Refinement18 Mar 2024
- 2024Platypose: Calibrated Zero-Shot Multi-Hypothesis 3D Human Motion Estimation10 Mar 2024
- 2024NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priors5 Mar 2024
- 2024Quantum Normalizing Flows for Anomaly Detection5 Feb 2024
- 2024Diffusion-based Pose Refinement and Muti-hypothesis Generation for 3D Human Pose Estimaiton10 Jan 2024
- 2023Geometry-Biased Transformer for Robust Multi-View 3D Human Pose Reconstruction28 Dec 2023
- 2023ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation11 Dec 2023
- 2023On the Calibration of Human Pose Estimation28 Nov 2023
- 2023The voraus-AD Dataset for Anomaly Detection in Robot Applications8 Nov 2023
- 2023A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation6 Nov 2023
- 2023Multimodal Active Measurement for Human Mesh Recovery in Close Proximity12 Oct 2023
- 2023DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusion4 Sep 2023
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Survey26 Aug 2023
- 2023POCO: 3D Pose and Shape Estimation with Confidence24 Aug 2023
- 2023Physics-Guided Human Motion Capture with Pose Probability Modeling19 Aug 2023
50 newest of 85 All 85 (JSON)
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Modelcited by 29
- 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Modelscited by 23
- 2023DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusioncited by 9
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimatorscited by 5
- 2026FMPose3D: monocular 3D pose estimation via flow matchingcited by 3
- 2026Flow Matching for Probabilistic Monocular 3D Human Pose Estimationcited by 2
- 2025HDiffTG: A Lightweight Hybrid Diffusion-Transformer-GCN Architecture for 3D Human Pose Estimationcited by 0
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Modelscited by 0
- 2026You Only Flow Once: Calibrated and Real-Time Radar Pose Estimation with Multi-Hypothesis Normalizing Flowscited by 0
- 2026You Only Flow Once: Calibrated and Real-Time Radar Pose Estimation with Multi-Hypothesis Normalizing Flows10 Aug 2026
- 2026FMPose3D: monocular 3D pose estimation via flow matching5 Feb 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2026Flow Matching for Probabilistic Monocular 3D Human Pose Estimation23 Jan 2026
- 2025HDiffTG: A Lightweight Hybrid Diffusion-Transformer-GCN Architecture for 3D Human Pose Estimation7 May 2025
- 2024CHAMP: Conformalized 3D Human Multi-Hypothesis Pose Estimators27 May 2024
- 2024FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models8 May 2024
- 2023DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusion4 Sep 2023
- 2022DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Model6 Dec 2022
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models29 Nov 2022
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
- 2022MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Videocited by 159
- 2021MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimationcited by 151
- 2021Fully Convolutional Cross-Scale-Flows for Image-based Defect Detectioncited by 117
- 2022Asymmetric Student-Teacher Networks for Industrial Anomaly Detectioncited by 117
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 82
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fieldscited by 57
- 2021Hierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wildcited by 48
- 2023GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Videocited by 47
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
12 most cited of 73 All 73 (JSON)
- 2026Kinematics-Induced Multimodal 3D Human Pose Estimation with Subject-Level Privacy2 Oct 2026
- 2026CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image1 Sep 2026
- 2026MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation31 Aug 2026
- 2026FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery14 May 2026
- 2025Adversarially-Refined VQ-GAN with Dense Motion Tokenization for Spatio-Temporal Heatmaps23 Sep 2025
- 2025VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusions9 Aug 2025
- 2025Multi-Flow: Multi-View-Enriched Normalizing Flows for Industrial Anomaly Detection4 Apr 2025
- 2025MoFM: A Large-Scale Human Motion Foundation Model8 Feb 2025
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimation9 Jan 2025
- 2024Optimizing Local-Global Dependencies for Accurate 3D Human Pose Estimation27 Dec 2024
- 2024CondiMen: Conditional Multi-Person Mesh Recovery17 Dec 2024
- 2024EnvPoser: Environment-aware Realistic Human Motion Estimation from Sparse Observations with Uncertainty Modeling13 Dec 2024
12 newest of 73 All 73 (JSON)