Adversarial Parametric Pose Prior
Not on the map. Why?
Abstract (arXiv)
The Skinned Multi-Person Linear (SMPL) model can represent a human body by mapping pose and shape parameters to body meshes. This has been shown to facilitate inferring 3D human pose and shape from images via different learning models. However, not all pose and shape parameter values yield physically-plausible or even realistic body meshes. In other words, SMPL is under-constrained and may thus lead to invalid results when used to reconstruct humans from images, either by directly optimizing its parameters, or by learning a mapping from the image to these parameters. In this paper, we therefore learn a prior that restricts the SMPL parameters to values that produce realistic poses via adversarial training. We show that our learned prior covers the diversity of the real-data distribution, facilitates optimization for 3D reconstruction from 2D keypoints, and yields better pose estimates when used for regression from images. We found that the prior based on spherical distribution gets the best results. Furthermore, in all these tasks, it outperforms the state-of-the-art VAE-based approach to constraining the SMPL parameters.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 8 Dec 2021.
Builds on
23 of 31 references.
References · 23
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2017Deep Image Priorcited by 1,098
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2017Learning from Synthetic Humanscited by 359
- 2017Unite the People: Closing the Loop Between 3D and 2D Human Representationscited by 205
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2019NASA: Neural Articulated Shape Approximationcited by 149
11 more
- 2020Coherent Reconstruction of Multiple Humans from a Single Imagecited by 136
- 2020Exemplar Fine-Tuning for 3D Human Model Fitting Towards In-the-Wild 3D Human Pose Estimationcited by 113
- 2019Exploiting temporal context for 3D human pose estimation in the wildcited by 110
- 2020Contact and Human Dynamics from Monocular Videocited by 95
- 2020Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flowscited by 94
- 2020Hierarchical Kinematic Human Mesh Recoverycited by 71
- 2020LIMP: Learning Latent Shape Representations with Metric Preservation Priorscited by 55
- 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fieldscited by 55
- 2019TexturePose: Supervising Human Mesh Estimation with Texture Consistencycited by 53
- 2015Building Statistical Shape Spaces for 3D Human Modelingcited by 47
- 2021Everybody Is Unique: Towards Unbiased Human Mesh Recoverycited by 10
Built on by
Citing papers per year: 2022: 8; 2023: 8; 2024: 15; 2025: 5; 2026: 2.
38 papers.
Sort:
By area:
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldscited by 85
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fieldscited by 57
- 2023Neural Sign Actors: A diffusion model for 3D sign language production from textcited by 49
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 41
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2024NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priorscited by 27
- 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
- 2024Programmable Motion Generation for Open-Set Motion Control Taskscited by 20
- 2023Modiff: Action-Conditioned 3D Motion Generation with Denoising Diffusion Probabilistic Modelscited by 17
26 more
- 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Priorcited by 13
- 2024MetaCap: Meta-learning Priors from Multi-View Imagery for Sparse-view Human Performance Capture and Renderingcited by 11
- 2022Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifoldscited by 10
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimationcited by 9
- 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Priorcited by 8
- 2023BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Trackingcited by 7
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modelingcited by 7
- 2023KBody: Towards general, robust, and aligned monocular whole-body estimationcited by 6
- 2025Geometric Neural Distance Fields for Learning Human Motion Priorscited by 6
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detectioncited by 5
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 3
- 2023PoseGen: Learning to Generate 3D Human Pose Dataset with NeRFcited by 2
- 2024Personalized 3D Human Pose and Shape Refinementcited by 2
- 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Priorcited by 2
- 2024Recovering Complete Actions for Cross-dataset Skeleton Action Recognitioncited by 2
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstructioncited by 2
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recoverycited by 1
- 2024MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifoldscited by 1
- 2026Anny-Fit: All-Age Human Mesh Recoverycited by 1
- 2023Noise-in, Bias-out: Balanced and Real-time MoCap Solvingcited by 0
- 2023QPoser: Quantized Explicit Pose Prior Modeling for Controllable Pose Generationcited by 0
- 2024Using Motion Cues to Supervise Single-Frame Body Pose and Shape Estimation in Low Data Regimescited by 0
- 2024Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignmentcited by 0
- 2025Neural Human Pose Priorcited by 0
- 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusioncited by 0
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Texturescited by 0
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026Anny-Fit: All-Age Human Mesh Recovery6 May 2026
- 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusion30 Sep 2025
- 2025Geometric Neural Distance Fields for Learning Human Motion Priors11 Sep 2025
- 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Prior1 Aug 2025
- 2025MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstruction21 Jul 2025
- 2025Neural Human Pose Prior16 Jul 2025
- 2024Recovering Complete Actions for Cross-dataset Skeleton Action Recognition31 Oct 2024
- 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior18 Oct 2024
- 2024MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds1 Sep 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024Programmable Motion Generation for Open-Set Motion Control Tasks29 May 2024
26 more
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detection24 May 2024
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignment15 Apr 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
- 2024MetaCap: Meta-learning Priors from Multi-View Imagery for Sparse-view Human Performance Capture and Rendering27 Mar 2024
- 2024Personalized 3D Human Pose and Shape Refinement18 Mar 2024
- 2024Score-Guided Diffusion for 3D Human Recovery14 Mar 2024
- 2024NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priors5 Mar 2024
- 2024Using Motion Cues to Supervise Single-Frame Body Pose and Shape Estimation in Low Data Regimes5 Feb 2024
- 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recovery25 Jan 2024
- 2023PoseGen: Learning to Generate 3D Human Pose Dataset with NeRF22 Dec 2023
- 2023Neural Sign Actors: A diffusion model for 3D sign language production from text5 Dec 2023
- 2023QPoser: Quantized Explicit Pose Prior Modeling for Controllable Pose Generation2 Dec 2023
- 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior31 Oct 2023
- 2023Noise-in, Bias-out: Balanced and Real-time MoCap Solving25 Sep 2023
- 2023BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking3 Sep 2023
- 2023KBody: Towards general, robust, and aligned monocular whole-body estimation23 Apr 2023
- 2023Modiff: Action-Conditioned 3D Motion Generation with Denoising Diffusion Probabilistic Models10 Jan 2023
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fields16 Dec 2022
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models29 Nov 2022
- 2022Learning 3D Scene Priors with 2D Supervision25 Nov 2022
- 2022DrapeNet: Garment Generation and Self-Supervised Draping21 Nov 2022
- 2022Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifolds4 Oct 2022
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimation1 Aug 2022
- 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fields27 Jul 2022
- 2022Recovering 3D Human Mesh from Monocular Images: A Survey3 Mar 2022
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2023Neural Sign Actors: A diffusion model for 3D sign language production from textcited by 49
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2023Modiff: Action-Conditioned 3D Motion Generation with Denoising Diffusion Probabilistic Modelscited by 17
- 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Priorcited by 13
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Posecited by 3
- 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Priorcited by 2
- 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Prior1 Aug 2025
- 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior18 Oct 2024
- 2024DiffSurf: A Transformer-based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose27 Aug 2024
- 2024Score-Guided Diffusion for 3D Human Recovery14 Mar 2024
- 2023Neural Sign Actors: A diffusion model for 3D sign language production from text5 Dec 2023
- 2023Modiff: Action-Conditioned 3D Motion Generation with Denoising Diffusion Probabilistic Models10 Jan 2023
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models29 Nov 2022
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldscited by 85
- 2022GFPose: Learning 3D Human Pose Prior with Gradient Fieldscited by 57
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 41
- 2024NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priorscited by 27
- 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
- 2024Programmable Motion Generation for Open-Set Motion Control Taskscited by 20
- 2024MetaCap: Meta-learning Priors from Multi-View Imagery for Sparse-view Human Performance Capture and Renderingcited by 11
- 2022Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifoldscited by 10
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimationcited by 9
- 2023Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Priorcited by 8
12 most cited of 30 All 30 (JSON)
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026Anny-Fit: All-Age Human Mesh Recovery6 May 2026
- 2025LieHMR: Autoregressive Human Mesh Recovery with SO(3) Diffusion30 Sep 2025
- 2025Geometric Neural Distance Fields for Learning Human Motion Priors11 Sep 2025
- 2025Neural Human Pose Prior16 Jul 2025
- 2024Recovering Complete Actions for Cross-dataset Skeleton Action Recognition31 Oct 2024
- 2024MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds1 Sep 2024
- 2024Programmable Motion Generation for Open-Set Motion Control Tasks29 May 2024
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detection24 May 2024
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation23 Apr 2024
- 2024Learning Human Motion from Monocular Videos via Cross-Modal Manifold Alignment15 Apr 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
12 newest of 30 All 30 (JSON)