D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field
Not on the map. Why?
Abstract (arXiv)
Realistic virtual humans play a crucial role in numerous industries, such as metaverse, intelligent healthcare, and self-driving simulation. But creating them on a large scale with high levels of realism remains a challenge. The utilization of deep implicit function sparks a new era of image-based 3D clothed human reconstruction, enabling pixel-aligned shape recovery with fine details. Subsequently, the vast majority of works locate the surface by regressing the deterministic implicit value for each point. However, should all points be treated equally regardless of their proximity to the surface? In this paper, we propose replacing the implicit value with an adaptive uncertainty distribution, to differentiate between points based on their distance to the surface. This simple ``value to distribution'' transition yields significant improvements on nearly all the baselines. Furthermore, qualitative results demonstrate that the models trained using our uncertainty distribution loss, can capture more intricate wrinkles, and realistic limbs. Code and models are available for research purposes at https://github.com/psyai-net/D-IF_release.
Key facts. Cited by 26 papers in the map (data through 13 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 17 Aug 2023.
Builds on
35 of 49 references.
References · 35
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,686
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,340
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,039
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,603
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 321
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
23 more
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2020Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstructioncited by 112
- 2018Detailed Human Avatars from Monocular Videocited by 109
- 2021Variational Relational Point Completion Networkcited by 104
- 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
- 2020Monocular Real-Time Volumetric Performance Capturecited by 74
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2019Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformationcited by 71
- 2020MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Videocited by 62
- 2018Photo Wake-Up: 3D Character Animation from a Single Photocited by 60
- 2021S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modelingcited by 59
- 2021Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometrycited by 46
- 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Visioncited by 38
- 2023High-Fidelity Clothed Avatar Reconstruction from a Single Imagecited by 38
- 2022RCareWorld: A Human-centric Simulation World for Caregiving Robotscited by 14
- 2022Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimationcited by 12
Built on by
Citing papers per year: 2023: 4; 2024: 17; 2025: 4; 2026: 1.
26 papers.
Sort:
By area:
- 2023TADA! Text to Animatable Digital Avatarscited by 110
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2024Advances in 3D Generation: A Surveycited by 63
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2024Generalizable Human Gaussians from Single-View Imagecited by 29
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
- 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshingcited by 23
- 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Imagecited by 17
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albumscited by 16
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergycited by 16
14 more
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humanscited by 13
- 2024HiLo: Detailed and Robust 3D Clothed Human Reconstruction with High-and Low-Frequency Information of Parametric Modelscited by 13
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstructioncited by 8
- 2023R2Human: Real-Time 3D Human Appearance Rendering from a Single Imagecited by 5
- 2024Semantic Human Mesh Reconstruction with Texturescited by 5
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
- 2024StdGEN: Semantic-Decomposed 3D Character Generation from Single Imagescited by 5
- 2024An Embeddable Implicit IUVD Representation for Part-based 3D Human Surface Reconstructioncited by 2
- 2024Uncertainty modeling for fine-tuned implicit functionscited by 2
- 2024FOF-X: Towards Real-time Detailed Human Reconstruction from a Single Imagecited by 1
- 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformationcited by 1
- 2025Link to the Past: Temporal Propagation for Fast 3D Human Reconstruction from Monocular Videocited by 0
- 2025CHRIS: Clothed Human Reconstruction with Side View Consistencycited by 0
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Imagescited by 0
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images25 May 2026
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstruction9 Oct 2025
- 2025CHRIS: Clothed Human Reconstruction with Side View Consistency17 May 2025
- 2025Link to the Past: Temporal Propagation for Fast 3D Human Reconstruction from Monocular Video12 May 2025
- 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformation24 Feb 2025
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy9 Dec 2024
- 2024FOF-X: Towards Real-time Detailed Human Reconstruction from a Single Image8 Dec 2024
- 2024StdGEN: Semantic-Decomposed 3D Character Generation from Single Images8 Nov 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Image25 Sep 2024
- 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshing16 Sep 2024
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors18 Jun 2024
14 more
- 2024Uncertainty modeling for fine-tuned implicit functions17 Jun 2024
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun 2024
- 2024Generalizable Human Gaussians from Single-View Image10 Jun 2024
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albums23 May 2024
- 2024HiLo: Detailed and Robust 3D Clothed Human Reconstruction with High-and Low-Frequency Information of Parametric Models7 Apr 2024
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans30 Mar 2024
- 2024Semantic Human Mesh Reconstruction with Textures5 Mar 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2024An Embeddable Implicit IUVD Representation for Part-based 3D Human Surface Reconstruction30 Jan 2024
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM22 Jan 2024
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstruction10 Dec 2023
- 2023R2Human: Real-Time 3D Human Appearance Rendering from a Single Image10 Dec 2023
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion28 Nov 2023
- 2023TADA! Text to Animatable Digital Avatars21 Aug 2023
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergycited by 16
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy9 Dec 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun 2024
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM22 Jan 2024
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion28 Nov 2023
- 2023TADA! Text to Animatable Digital Avatarscited by 110
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2024Advances in 3D Generation: A Surveycited by 63
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2024Generalizable Human Gaussians from Single-View Imagecited by 29
- 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshingcited by 23
- 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Imagecited by 17
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albumscited by 16
- 2024DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humanscited by 13
- 2024HiLo: Detailed and Robust 3D Clothed Human Reconstruction with High-and Low-Frequency Information of Parametric Modelscited by 13
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstructioncited by 8
- 2023R2Human: Real-Time 3D Human Appearance Rendering from a Single Imagecited by 5
12 most cited of 21 All 21 (JSON)
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images25 May 2026
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstruction9 Oct 2025
- 2025CHRIS: Clothed Human Reconstruction with Side View Consistency17 May 2025
- 2025Link to the Past: Temporal Propagation for Fast 3D Human Reconstruction from Monocular Video12 May 2025
- 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformation24 Feb 2025
- 2024FOF-X: Towards Real-time Detailed Human Reconstruction from a Single Image8 Dec 2024
- 2024StdGEN: Semantic-Decomposed 3D Character Generation from Single Images8 Nov 2024
- 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Image25 Sep 2024
- 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshing16 Sep 2024
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors18 Jun 2024
- 2024Uncertainty modeling for fine-tuned implicit functions17 Jun 2024
- 2024Generalizable Human Gaussians from Single-View Image10 Jun 2024
12 newest of 21 All 21 (JSON)