Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
Not on the map. Why?
Cited by 37 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We describe the first method to automatically estimate the 3D pose of the human body as well as its 3D shape from a single unconstrained image. We estimate a full 3D mesh and show that 2D joints alone carry a surprising amount of information about body shape. The problem is challenging because of the complexity of the human body, articulation, occlusion, clothing, lighting, and the inherent ambiguity in inferring 3D from 2D. To solve this, we first use a recently published CNN-based method, DeepCut, to predict (bottom-up) the 2D body joint locations. We then fit (top-down) a recently published statistical body shape model, called SMPL, to the 2D joints. We do so by minimizing an objective function that penalizes the error between the projected 3D model joints and detected 2D joints. Because SMPL captures correlations in human shape across the population, we are able to robustly fit it to very little data. We further leverage the 3D model to prevent solutions that cause interpenetration. We evaluate our method, SMPLify, on the Leeds Sports, HumanEva, and Human3.6M datasets, showing superior pose accuracy with respect to the state of the art.
Key facts. Cited by 692 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 133; 2022: 115; 2023: 136; 2024: 132; 2025: 100; 2026: 76.
692 papers.
Sort:
By area:
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
38 more
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 154
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 152
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 141
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2022InstantAvatar: Learning Avatars from Monocular Video in 60 Secondscited by 138
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 134
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
- 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 111
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2021Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothingcited by 102
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90
50 most cited of 692 All 692 (JSON)
- 2026BeyondRetarget: Learning Executable Humanoid Motions Directly from Monocular Video24 Sep 2026
- 2026All modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation23 Sep 2026
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image1 Sep 2026
- 2026Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representation1 Sep 2026
- 2026Biomechanical 3D Body: Self-Supervised Distillation of Biomechanical Pose from a 3D Body Foundation Model30 Aug 2026
- 2026GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image28 Aug 2026
- 2026Reconstructing Humans and Objects in Interaction using Large Reconstruction Models27 Aug 2026
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026PressureMesh: 3D Human Mesh Estimation from Multi-Device Pressure Images10 Aug 2026
- 2026Ordered Diffusion for 3D Human Registration6 Aug 2026
- 2026UniMoCa: Unifying Motion and Camera Controls as Visual Proxies for Faithful Human Video Generation3 Aug 2026
38 more
- 2026Intrinsic and Triangulation-Agnostic Attention: A Simple and Powerful Approach for Learning on Meshes27 Jul 2026
- 2026RAMP: Recognition parametrisation by Amortised Message Passing21 Jul 2026
- 2026Reliability-Aware 3D Geometric Injection for Universal Person Re-identification21 Jul 2026
- 2026PoseShield: Neural Collision Fields for Human Self-Collision Resolution29 Jun 2026
- 2026RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction28 Jun 2026
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
- 2026PIAvatar: Physically Interactive Avatars via Deformation Gradient Decoupling19 Jun 2026
- 2026CalTennis: Large Multi-View Tennis Video Dataset and Benchmark of Monocular-to-3D Pose Estimation18 Jun 2026
- 2026Contactless 3D Human Body Measurement Using Depth Cameras for Smart Health Monitoring10 Jun 2026
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation1 Jun 2026
- 2026DiscoForcing: A Unified Framework for Real-Time Audio-Driven Character Control with Diffusion Forcing27 May 2026
- 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization27 May 2026
- 2026Natural Human Motion Recovery by Aligning High-Order Temporal Dynamics from Monocular Videos26 May 2026
- 2026Self-Intersection-Aware 3D Human Motion Generation Using an Efficient Human Sphere Proxy26 May 2026
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images25 May 2026
- 2026HumanFlow -- Diffusion-Driven MAV Navigation Among Humans via Tightly-Coupled Motion Tracking, Forecasting, and Control25 May 2026
- 2026Millimeter-wave Imaging for Anthropometric Body Measurement21 May 2026
- 2026B'ezier Degradation Modeling for LiDAR-based Human Motion Capture19 May 2026
- 2026GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstruction17 May 2026
- 2026AnyAct: Towards Human Reenactment of Character Motion From Video15 May 2026
- 2026FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery14 May 2026
- 2026Monocular Biomechanical Tracking of Fingers with Inverse Kinematics to Foundation Models10 May 2026
- 2026LAMP: Localization Aware Multi-camera People Tracking in Metric 3D World6 May 2026
- 2026Anny-Fit: All-Age Human Mesh Recovery6 May 2026
- 2026HumanSplatHMR: Closing the Loop Between Human Mesh Recovery and Gaussian Splatting Avatar4 May 2026
- 2026ResiHMR: Residual-Limb Aware Single-Image 3D Human Mesh Recovery for Individuals with Limb Loss30 Apr 2026
- 2026LEXIS: LatEnt ProXimal Interaction Signatures for 3D HOI from an Image22 Apr 2026
- 2026UniCon3R: Unified Contact-aware 4D Human-Scene Reconstruction from Monocular Video21 Apr 2026
- 2026AnyLift: Scaling Motion Reconstruction from Internet Videos via 2D Diffusion20 Apr 2026
- 2026DGHMesh: A Large-scale Dual-radar mmWave Dataset and Generalization-focused Benchmark for Human Mesh Reconstruction19 Apr 2026
- 2026Amortized Inverse Kinematics via Graph Attention for Real-Time Human Avatar Animation17 Apr 2026
- 2026SocialMirror: Reconstructing 3D Human Interaction Behaviors from Monocular Videos with Semantic and Geometric Guidance15 Apr 2026
- 2026ETCH-X: Robustify Expressive Body Fitting to Clothed Humans with Composable Datasets9 Apr 2026
- 2026Human Interaction-Aware 3D Reconstruction from a Single Image7 Apr 2026
- 2026Human Pose Estimation in Trampoline Gymnastics: How to Improve Performance on Extreme Poses1 Apr 2026
- 2026Meta-Learned Adaptive Optimization for Robust Human Mesh Recovery with Uncertainty-Aware Parameter Updates27 Mar 2026
- 2026How good was my shot? Quantifying Player Skill Level in Table Tennis26 Mar 2026
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating25 Mar 2026
50 newest of 692 All 692 (JSON)
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generationcited by 81
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
- 2022DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion modelscited by 65
- 2023HeadSculpt: Crafting 3D Head Avatars with Textcited by 48
- 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesiscited by 48
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Imagescited by 43
- 2023Iterative Motion Editing with Natural Languagecited by 39
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2023MAS: Multi-view Ancestral Sampling for 3D motion generation using 2D diffusioncited by 37
- 2023DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusioncited by 36
12 most cited of 37 All 37 (JSON)
- 2026HumanFlow -- Diffusion-Driven MAV Navigation Among Humans via Tightly-Coupled Motion Tracking, Forecasting, and Control25 May 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors4 Mar 2026
- 2026Direct Reward Fine-Tuning on Poses for Single Image to 3D Human in the Wild3 Mar 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2025Sketch2PoseNet: Efficient and Generalized Sketch to 3D Human Pose Prediction30 Oct 2025
- 2025SimDiff: Simulator-constrained Diffusion Model for Physically Plausible Motion Generation25 Sep 2025
- 2025DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Prior1 Aug 2025
- 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction31 Jul 2025
- 2025AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Models24 Jun 2025
- 2025Animating the Uncaptured: Humanoid Mesh Animation with Video Diffusion Models20 Mar 2025
- 2024JADE: Joint-aware Latent Diffusion for 3D Human Generative Modeling29 Dec 2024
12 newest of 37 All 37 (JSON)
- 2025HMVLM: Human Motion-Vision-Lanuage Model via MoE LoRAcited by 4
- 2025HMVLM: Human Motion-Vision-Lanuage Model via MoE LoRA3 Nov 2025
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
- 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
12 most cited of 648 All 648 (JSON)
- 2026BeyondRetarget: Learning Executable Humanoid Motions Directly from Monocular Video24 Sep 2026
- 2026All modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation23 Sep 2026
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image1 Sep 2026
- 2026Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representation1 Sep 2026
- 2026Biomechanical 3D Body: Self-Supervised Distillation of Biomechanical Pose from a 3D Body Foundation Model30 Aug 2026
- 2026GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image28 Aug 2026
- 2026Reconstructing Humans and Objects in Interaction using Large Reconstruction Models27 Aug 2026
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026PressureMesh: 3D Human Mesh Estimation from Multi-Device Pressure Images10 Aug 2026
- 2026Ordered Diffusion for 3D Human Registration6 Aug 2026
- 2026UniMoCa: Unifying Motion and Camera Controls as Visual Proxies for Faithful Human Video Generation3 Aug 2026
12 newest of 648 All 648 (JSON)