mlsanityData to 13 Oct 2026

D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field

arXiv 2308.08857 ↗First posted 17 Aug 2023cs.CV cs.AIcited by 26

Not on the map. Why?

Abstract (arXiv)

Realistic virtual humans play a crucial role in numerous industries, such as metaverse, intelligent healthcare, and self-driving simulation. But creating them on a large scale with high levels of realism remains a challenge. The utilization of deep implicit function sparks a new era of image-based 3D clothed human reconstruction, enabling pixel-aligned shape recovery with fine details. Subsequently, the vast majority of works locate the surface by regressing the deterministic implicit value for each point. However, should all points be treated equally regardless of their proximity to the surface? In this paper, we propose replacing the implicit value with an adaptive uncertainty distribution, to differentiate between points based on their distance to the surface. This simple ``value to distribution'' transition yields significant improvements on nearly all the baselines. Furthermore, qualitative results demonstrate that the models trained using our uncertainty distribution loss, can capture more intricate wrinkles, and realistic limbs. Code and models are available for research purposes at https://github.com/psyai-net/D-IF_release.

Key facts. Cited by 26 papers in the map (data through 13 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 17 Aug 2023.

Builds on

35 of 49 references.

References · 35

  1. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
  2. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,340
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,603
  5. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  6. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  7. 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
  8. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 321
  9. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
  10. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  11. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  12. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
23 more
  1. 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
  2. 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
  3. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  4. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  5. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  6. 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
  7. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  8. 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
  9. 2020Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstructioncited by 112
  10. 2018Detailed Human Avatars from Monocular Videocited by 109
  11. 2021Variational Relational Point Completion Networkcited by 104
  12. 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
  13. 2020Monocular Real-Time Volumetric Performance Capturecited by 74
  14. 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
  15. 2019Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformationcited by 71
  16. 2020MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Videocited by 62
  17. 2018Photo Wake-Up: 3D Character Animation from a Single Photocited by 60
  18. 2021S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modelingcited by 59
  19. 2021Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometrycited by 46
  20. 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Visioncited by 38
  21. 2023High-Fidelity Clothed Avatar Reconstruction from a Single Imagecited by 38
  22. 2022RCareWorld: A Human-centric Simulation World for Caregiving Robotscited by 14
  23. 2022Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimationcited by 12

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2023: 4; 2024: 17; 2025: 4; 2026: 1.

26 papers.

Sort:

By area:

  1. 2023TADA! Text to Animatable Digital Avatarscited by 110
  2. 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
  3. 2024Advances in 3D Generation: A Surveycited by 63
  4. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
  5. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
  6. 2024Generalizable Human Gaussians from Single-View Imagecited by 29
  7. 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
  8. 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
  9. 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshingcited by 23
  10. 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Imagecited by 17
  11. 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albumscited by 16
  12. 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergycited by 16
14 more
  1. 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humanscited by 13
  2. 2024HiLo: Detailed and Robust 3D Clothed Human Reconstruction with High-and Low-Frequency Information of Parametric Modelscited by 13
  3. 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstructioncited by 8
  4. 2023R2Human: Real-Time 3D Human Appearance Rendering from a Single Imagecited by 5
  5. 2024Semantic Human Mesh Reconstruction with Texturescited by 5
  6. 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
  7. 2024StdGEN: Semantic-Decomposed 3D Character Generation from Single Imagescited by 5
  8. 2024An Embeddable Implicit IUVD Representation for Part-based 3D Human Surface Reconstructioncited by 2
  9. 2024Uncertainty modeling for fine-tuned implicit functionscited by 2
  10. 2024FOF-X: Towards Real-time Detailed Human Reconstruction from a Single Imagecited by 1
  11. 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformationcited by 1
  12. 2025Link to the Past: Temporal Propagation for Fast 3D Human Reconstruction from Monocular Videocited by 0
  13. 2025CHRIS: Clothed Human Reconstruction with Side View Consistencycited by 0
  14. 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Imagescited by 0