mlsanityData to 7 Oct 2026

imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose

arXiv 2108.10842 ↗First posted 24 Aug 2021cs.CV cs.LGcited by 102

Not on the map. Why?

Abstract (arXiv)

We present imGHUM, the first holistic generative model of 3D human shape and articulated pose, represented as a signed distance function. In contrast to prior work, we model the full human body implicitly as a function zero-level-set and without the use of an explicit template mesh. We propose a novel network architecture and a learning paradigm, which make it possible to learn a detailed implicit generative model of human pose, shape, and semantics, on par with state-of-the-art mesh-based models. Our model features desired detail for human models, such as articulated pose including hand motion and facial expressions, a broad spectrum of shape variations, and can be queried at arbitrary resolutions and spatial locations. Additionally, our model has attached spatial semantics making it straightforward to establish correspondences between different shape instances, thus enabling applications that are difficult to tackle using classical implicit representations. In extensive experiments, we demonstrate the model accuracy and its applicability to current research problems.

Key facts. Cited by 102 papers in the map (data through 7 Oct 2026). Builds on 36 of its 56 references that are in the map. First posted on arXiv 24 Aug 2021.

Builds on

36 of 56 references.

References · 36

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  5. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  7. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  8. 2018On the Spectral Bias of Neural Networkscited by 1,321
  9. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  10. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  11. 2017End-to-end Recovery of Human Shape and Posecited by 883
  12. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
24 more
  1. 2020Convolutional Occupancy Networkscited by 760
  2. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  3. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  4. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
  5. 2020Local Implicit Grid Representations for 3D Scenescited by 372
  6. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
  7. 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
  8. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  9. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  10. 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
  11. 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
  12. 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
  13. 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
  14. 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
  15. 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
  16. 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
  17. 2020Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flowscited by 94
  18. 2019Deep Level Sets: Implicit Surface Representations for 3D Shape Inferencecited by 52
  19. 2015Building Statistical Shape Spaces for 3D Human Modelingcited by 47
  20. 2020Implicit Feature Networks for Texture Completion from Partial 3D Datacited by 31
  21. 2020TexMesh: Reconstructing Detailed Human Texture and Geometry from RGB-D Videocited by 27
  22. 2020Ladybird: Quasi-Monte Carlo Sampling for Deep Implicit Field Based 3D Reconstruction with Symmetrycited by 24
  23. 2018Learning and Tracking the 3D Body Shape of Freely Moving Infants from RGB-D sequencescited by 19
  24. 2019Human Synthesis and Scene Compositingcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 25; 2023: 29; 2024: 21; 2025: 13; 2026: 7.

102 papers.

Sort:

By area:

  1. 2021Neural Fields in Visual Computing and Beyondcited by 539
  2. 2021Advances in Neural Renderingcited by 365
  3. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  4. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  5. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  6. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  7. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  8. 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
  9. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  10. 2023TADA! Text to Animatable Digital Avatarscited by 109
  11. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  12. 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
38 more
  1. 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
  2. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  3. 2022SNUG: Self-Supervised Neural Dynamic Garmentscited by 83
  4. 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
  5. 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
  6. 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
  7. 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
  8. 2021CoNeRF: Controllable Neural Radiance Fieldscited by 65
  9. 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
  10. 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
  11. 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
  12. 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
  13. 2022COAP: Compositional Articulated Occupancy of Peoplecited by 59
  14. 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
  15. 2022A Level Set Theory for Neural Implicit Evolution under Explicit Flowscited by 42
  16. 2022DANBO: Disentangled Articulated Neural Body Representations via Graph Neural Networkscited by 38
  17. 2022Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Videocited by 37
  18. 2023OmniAvatar: Geometry-Guided Controllable 3D Head Synthesiscited by 34
  19. 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
  20. 2024CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalizationcited by 28
  21. 2023SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearancecited by 24
  22. 2023RelightableHands: Efficient Neural Relighting of Articulated Hand Modelscited by 21
  23. 2023NICP: Neural ICP for 3D Human Registration at Scalecited by 21
  24. 2022Structured 3D Features for Reconstructing Controllable Avatarscited by 19
  25. 2024OHTA: One-shot Hand Avatar via Data-driven Implicit Priorscited by 18
  26. 2023NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objectscited by 17
  27. 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
  28. 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Textcited by 16
  29. 2024Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Priorcited by 15
  30. 2022Dual-Space NeRF: Learning Animatable Avatars and Scene Lighting in Separate Spacescited by 13
  31. 2023Efficient 3D Articulated Human Generation with Layered Surface Volumescited by 13
  32. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  33. 2024STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargetingcited by 13
  34. 2022An Implicit Parametric Morphable Dental Modelcited by 12
  35. 2024DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusioncited by 12
  36. 2022Human Image Generation: A Comprehensive Surveycited by 11
  37. 2023GenCorres: Consistent Shape Matching via Coupled Implicit-Explicit Shape Generative Modelscited by 11
  38. 2023Relightable Neural Actor with Intrinsic Decomposition and Pose Controlcited by 11

50 most cited of 102 All 102 (JSON)