Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows
Not on the map. Why?
Abstract (arXiv)
Monocular 3D human pose and shape estimation is challenging due to the many degrees of freedom of the human body and thedifficulty to acquire training data for large-scale supervised learning in complex visual scenes. In this paper we present practical semi-supervised and self-supervised models that support training and good generalization in real-world images and video. Our formulation is based on kinematic latent normalizing flow representations and dynamics, as well as differentiable, semantic body part alignment loss functions that support self-supervised learning. In extensive experiments using 3D motion capture datasets like CMU, Human3.6M, 3DPW, or AMASS, as well as image repositories like COCO, we show that the proposed methods outperform the state of the art, supporting the practical construction of an accurate family of models based on large-scale training with diverse and incompletely labeled image and video data.
Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 20; 2023: 21; 2024: 14; 2025: 4; 2026: 3.
94 papers.
Sort:
By area:
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 152
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
38 more
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 99
- 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
- 2021Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flowscited by 84
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2023X-Avatar: Expressive Human Avatarscited by 66
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2021Estimating Egocentric 3D Human Pose in Global Spacecited by 56
- 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observationscited by 54
- 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
- 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
- 2022Accurate 3D Body Shape Regression using Metric and Semantic Attributescited by 49
- 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 46
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesiscited by 44
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Imagescited by 43
- 2021Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentationcited by 40
- 2021Learning to Regress Bodies from Images using Differentiable Semantic Renderingcited by 39
- 2021Adversarial Parametric Pose Priorcited by 38
- 2022Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Videocited by 37
- 2021ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Posescited by 35
- 2021Task-Generic Hierarchical Human Motion Prior using VAEscited by 33
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 33
- 2021HSPACE: Synthetic Parametric Humans Animated in Complex Environmentscited by 29
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithmscited by 28
- 20233D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimationcited by 28
- 2021KAMA: 3D Keypoint Aware Body Mesh Articulationcited by 27
- 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
- 2022SUPR: A Sparse Unified Part-Based Human Representationcited by 21
- 2023POCO: 3D Pose and Shape Estimation with Confidencecited by 20
- 2021Revitalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulationcited by 19
- 2022Structured 3D Features for Reconstructing Controllable Avatarscited by 19
- 2023HMD-NeMo: Online 3D Avatar Motion Generation From Sparse Observationscited by 17
- 2024Synergistic Global-space Camera and Human Reconstruction from Videoscited by 17
50 most cited of 94 All 94 (JSON)
- 2026CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image1 Sep 2026
- 2026You Only Flow Once: Calibrated and Real-Time Radar Pose Estimation with Multi-Hypothesis Normalizing Flows10 Aug 2026
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
- 2025ClothHMR: 3D Mesh Recovery of Humans in Diverse Clothing from Single Image19 Dec 2025
- 2025LaxMotion: Rethinking Supervision Granularity for 3D Human Motion Generation14 Nov 2025
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstruction21 Jul 2025
- 2025Neural Human Pose Prior16 Jul 2025
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation29 Aug 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024MeshPose: Unifying DensePose and 3D Body Mesh reconstruction14 Jun 2024
- 2024T2LM: Long-Term 3D Human Motion Generation from Multiple Sentences2 Jun 2024
- 2024Synergistic Global-space Camera and Human Reconstruction from Videos23 May 2024
38 more
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypoints10 Apr 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
- 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery1 Apr 2024
- 2024Personalized 3D Human Pose and Shape Refinement18 Mar 2024
- 2024Distribution and Depth-Aware Transformers for 3D Human Mesh Recovery14 Mar 2024
- 2024Deep learning for 3D human pose estimation and mesh recovery: A survey29 Feb 2024
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recovery25 Jan 2024
- 2024RoHM: Robust Human Motion Reconstruction via Diffusion16 Jan 2024
- 2023Towards Robust and Expressive Whole-body Human Pose and Shape Estimation14 Dec 2023
- 2023Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Maps27 Nov 2023
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videos20 Oct 2023
- 2023GenLayNeRF: Generalizable Layered Representations with 3D Model Alignment for Multi-Human View Synthesis20 Sep 2023
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
- 2023Mirror-Aware Neural Humans9 Sep 2023
- 2023POCO: 3D Pose and Shape Estimation with Confidence24 Aug 2023
- 2023HMD-NeMo: Online 3D Avatar Motion Generation From Sparse Observations22 Aug 2023
- 20233D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimation19 Aug 2023
- 2023Reconstructing Three-Dimensional Models of Interacting Humans3 Aug 2023
- 2023Body Knowledge and Uncertainty Modeling for Monocular 3D Human Body Reconstruction1 Aug 2023
- 2023Language-free Compositional Action Generation via Decoupling Refinement7 Jul 2023
- 2023Implicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-view30 Jun 2023
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Images15 Jun 2023
- 2023DreamHuman: Animatable 3D Avatars from Text15 Jun 2023
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation15 May 2023
- 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesis21 Apr 2023
- 20233D Human Pose Estimation via Intuitive Physics31 Mar 2023
- 2023PoseExaminer: Automated Testing of Out-of-Distribution Robustness in Human Pose and Shape Estimation13 Mar 2023
- 2023X-Avatar: Expressive Human Avatars8 Mar 2023
- 2023IKOL: Inverse kinematics optimization layer for 3D human pose and shape estimation via Gauss-Newton differentiation2 Feb 2023
- 2022Structured 3D Features for Reconstructing Controllable Avatars13 Dec 2022
- 2022Transformer-Based Learned Optimization2 Dec 2022
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models29 Nov 2022
- 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmark28 Nov 2022
- 2022SUPR: A Sparse Unified Part-Based Human Representation25 Oct 2022
- 2022Decanus to Legatus: Synthetic training for 2D-3D human pose lifting5 Oct 2022
- 2022HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flow4 Oct 2022
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithms21 Sep 2022
50 newest of 94 All 94 (JSON)
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Imagescited by 43
- 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recoverycited by 16
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 2
- 2026You Only Flow Once: Calibrated and Real-Time Radar Pose Estimation with Multi-Hypothesis Normalizing Flowscited by 0
- 2026You Only Flow Once: Calibrated and Real-Time Radar Pose Estimation with Multi-Hypothesis Normalizing Flows10 Aug 2026
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation29 Aug 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery1 Apr 2024
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Images15 Jun 2023
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models29 Nov 2022
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 152
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
12 most cited of 87 All 87 (JSON)
- 2026CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image1 Sep 2026
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
- 2025ClothHMR: 3D Mesh Recovery of Humans in Diverse Clothing from Single Image19 Dec 2025
- 2025LaxMotion: Rethinking Supervision Granularity for 3D Human Motion Generation14 Nov 2025
- 2025Neural Human Pose Prior16 Jul 2025
- 2024MeshPose: Unifying DensePose and 3D Body Mesh reconstruction14 Jun 2024
- 2024T2LM: Long-Term 3D Human Motion Generation from Multiple Sentences2 Jun 2024
- 2024Synergistic Global-space Camera and Human Reconstruction from Videos23 May 2024
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypoints10 Apr 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
- 2024Personalized 3D Human Pose and Shape Refinement18 Mar 2024
12 newest of 87 All 87 (JSON)