mlsanityData to 14 Oct 2026

End-to-end Recovery of Human Shape and Pose

arXiv 1712.06584 ↗First posted 18 Dec 2017cs.CVcited by 885

Not on the map. Why?

Cited by 31 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We describe Human Mesh Recovery (HMR), an end-to-end framework for reconstructing a full 3D mesh of a human body from a single RGB image. In contrast to most current methods that compute 2D or 3D joint locations, we produce a richer and more useful mesh representation that is parameterized by shape and 3D joint angles. The main objective is to minimize the reprojection loss of keypoints, which allow our model to be trained using images in-the-wild that only have ground truth 2D annotations. However, the reprojection loss alone leaves the model highly under constrained. In this work we address this problem by introducing an adversary trained to tell whether a human body parameter is real or not using a large database of 3D human meshes. We show that HMR can be trained with and without using any paired 2D-to-3D supervision. We do not rely on intermediate 2D keypoint detections and infer 3D pose and shape parameters directly from image pixels. Our model runs in real-time given a bounding box containing the person. We demonstrate our approach on various images in-the-wild and out-perform previous optimization based methods that output 3D meshes and show competitive results on tasks such as 3D joint location estimation and part segmentation.

Key facts. Cited by 885 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Dec 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 185; 2022: 157; 2023: 175; 2024: 159; 2025: 103; 2026: 106.

885 papers.

Sort:

By area:

  1. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  2. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
  3. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 337
  4. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
  5. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
  6. 2023Reconstructing Hands in 3D with Transformerscited by 306
  7. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  8. 2021Mesh Graphormercited by 265
  9. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  10. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  11. 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
  12. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
38 more
  1. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  2. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  3. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
  4. 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 205
  5. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  6. 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
  7. 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
  8. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 180
  9. 2022Generating Holistic 3D Human Motion from Speechcited by 180
  10. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  11. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 169
  12. 2022Human-to-Robot Imitation in the Wildcited by 161
  13. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
  14. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
  15. 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 155
  16. 2021Probabilistic Modeling for Human Mesh Recoverycited by 153
  17. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
  18. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
  19. 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
  20. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  21. 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 142
  22. 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 142
  23. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 139
  24. 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
  25. 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
  26. 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 135
  27. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
  28. 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 130
  29. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
  30. 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 123
  31. 2023GART: Gaussian Articulated Template Modelscited by 121
  32. 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 117
  33. 2021SimPoE: Simulated Character Control for 3D Human Pose Estimationcited by 114
  34. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
  35. 2022Gait Recognition in the Wild with Dense 3D Representations and A Benchmarkcited by 114
  36. 2021Audio2Gestures: Generating Diverse Gestures from Speech Audio with Conditional Variational Autoencoderscited by 109
  37. 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
  38. 2022VideoDex: Learning Dexterity from Internet Videoscited by 106

50 most cited of 885 All 885 (JSON)