DeepHuman: 3D Human Reconstruction from a Single Image
Not on the map. Why?
Abstract (arXiv)
We propose DeepHuman, an image-guided volume-to-volume translation CNN for 3D human reconstruction from a single RGB image. To reduce the ambiguities associated with the surface geometry reconstruction, even for the reconstruction of invisible areas, we propose and leverage a dense semantic representation generated from SMPL model as an additional input. One key feature of our network is that it fuses different scales of image features into the 3D space through volumetric feature transformation, which helps to recover accurate surface geometry. The visible surface details are further refined through a normal refinement network, which can be concatenated with the volume generation network using our proposed volumetric normal projection layer. We also contribute THuman, a 3D real-world human model dataset containing about 7000 models. The network is trained using training data generated from the dataset. Overall, due to the specific design of our network and the diversity in our dataset, our method enables 3D human model estimation given only a single image and outperforms state-of-the-art approaches.
Key facts. Cited by 182 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 47; 2022: 47; 2023: 40; 2024: 25; 2025: 10; 2026: 13.
182 papers.
Sort:
By area:
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
38 more
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
- 2021DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Camerascited by 67
- 2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 55
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 2022MPS-NeRF: Generalizable 3D Human Rendering from Multiview Imagescited by 52
- 2021Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Renderingcited by 46
- 2023Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstructioncited by 42
- 20223D Clothed Human Reconstruction in the Wildcited by 41
- 2021NeuralHumanFVV: Real-Time Neural Volumetric Human Performance Rendering using RGB Camerascited by 40
- 2022Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Imagescited by 39
- 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Visioncited by 38
- 2023High-Fidelity Clothed Avatar Reconstruction from a Single Imagecited by 38
- 2021Point-Based Modeling of Human Clothingcited by 37
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
- 2021Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstructioncited by 36
- 20213D Human Texture Estimation from a Single Image with Transformerscited by 35
- 2021ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priorscited by 34
- 2023Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identificationcited by 34
- 2022Animatable Implicit Neural Representations for Creating Realistic Avatars from Videoscited by 33
- 2022Neural MoCon: Neural Motion Control for Physically Plausible Human Motion Capturecited by 31
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 29
50 most cited of 182 All 182 (JSON)
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
- 2026VolHuMe: a High-Resolution Large Scale Dataset of Volumetric Human Meshes22 Jun 2026
- 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model18 Jun 2026
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation1 Jun 2026
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images25 May 2026
- 2026OmniFit: Multi-modal 3D Body Fitting via Scale-agnostic Dense Landmark Prediction23 Apr 2026
- 2026DGHMesh: A Large-scale Dual-radar mmWave Dataset and Generalization-focused Benchmark for Human Mesh Reconstruction19 Apr 2026
- 2026ETCH-X: Robustify Expressive Body Fitting to Clothed Humans with Composable Datasets9 Apr 2026
- 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridging3 Apr 2026
- 2026CrowdGaussian: Reconstructing High-Fidelity 3D Gaussians for Human Crowd from a Single Image18 Mar 2026
- 2026Real-Time Human Frontal View Synthesis from a Single Image16 Mar 2026
38 more
- 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxies5 Jan 2026
- 2025Age-Inclusive 3D Human Mesh Recovery for Action-Preserving Data Anonymization4 Dec 2025
- 2025SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstruction9 Oct 2025
- 2025HumanRAM: Feed-forward Human Reconstruction and Animation Model using Transformers3 Jun 2025
- 2025CHRIS: Clothed Human Reconstruction with Side View Consistency17 May 2025
- 2025EOPose : Exemplar-based object reposing using Generalized Pose Correspondences6 May 2025
- 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitization3 May 2025
- 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assets9 Apr 2025
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2025ETCH: Generalizing Body Fitting to Clothed Humans via Equivariant Tightness13 Mar 2025
- 2025Referring to Any Person11 Mar 2025
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Image19 Dec 2024
- 2024FOF-X: Towards Real-time Detailed Human Reconstruction from a Single Image8 Dec 2024
- 2024DiHuR: Diffusion-Guided Generalizable Human Reconstruction16 Nov 2024
- 2024GarVerseLOD: High-Fidelity 3D Garment Reconstruction from a Single In-the-Wild Image using a Dataset with Levels of Details5 Nov 2024
- 20243D Representation Methods: A Survey9 Oct 2024
- 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshing16 Sep 2024
- 2024GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers6 Sep 2024
- 2024Monocular Occupancy Prediction for Scalable Indoor Scenes16 Jul 2024
- 2024COSMU: Complete 3D human shape from monocular unconstrained images15 Jul 2024
- 2024Learning Localization of Body and Finger Animation Skeleton Joints on Three-Dimensional Models of Human Bodies11 Jul 2024
- 2024WildAvatar: Learning In-the-wild 3D Avatars from the Web2 Jul 2024
- 2024Instant 3D Human Avatar Generation using Image Diffusion Models11 Jun 2024
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albums23 May 2024
- 2024HiLo: Detailed and Robust 3D Clothed Human Reconstruction with High-and Low-Frequency Information of Parametric Models7 Apr 2024
- 2024Neural Radiance Field-based Visual Rendering: A Comprehensive Review31 Mar 2024
- 2024MetaCap: Meta-learning Priors from Multi-View Imagery for Sparse-view Human Performance Capture and Rendering27 Mar 2024
- 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generation19 Mar 2024
- 2024Ultraman: Single Image 3D Human Reconstruction with Ultra Speed and Detail18 Mar 2024
- 2024ANIM: Accurate Neural Implicit Model for Human Reconstruction from a single RGB-D image15 Mar 2024
- 2024CharNeRF: 3D Character Generation from Concept Art27 Feb 2024
- 2024An Embeddable Implicit IUVD Representation for Part-based 3D Human Surface Reconstruction30 Jan 2024
- 2024TIFu: Tri-directional Implicit Function for High-Fidelity 3D Character Reconstruction25 Jan 2024
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM22 Jan 2024
- 20243D Reconstruction of Interacting Multi-Person in Clothing from a Single Image12 Jan 2024
- 2024A Survey on 3D Gaussian Splatting8 Jan 2024
- 2023SHARE: Single-view Human Adversarial REconstruction30 Dec 2023
- 2023SPnet: Estimating Garment Sewing Patterns from a Single Image26 Dec 2023
50 newest of 182 All 182 (JSON)
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
- 2024Instant 3D Human Avatar Generation using Image Diffusion Modelscited by 14
- 2023Guide3D: Create 3D Avatars from Text and Image Guidancecited by 10
- 2023Boosting3D: High-Fidelity Image-to-3D by Boosting 2D Diffusion Prior to 3D Prior with Progressive Learningcited by 7
- 2023Learning Structure-Guided Diffusion Model for 2D Human Pose Estimationcited by 5
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Imagecited by 4
- 2024DiHuR: Diffusion-Guided Generalizable Human Reconstructioncited by 3
- 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Modelcited by 1
- 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model18 Jun 2026
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2024DiHuR: Diffusion-Guided Generalizable Human Reconstruction16 Nov 2024
- 2024Instant 3D Human Avatar Generation using Image Diffusion Models11 Jun 2024
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM22 Jan 2024
- 2023Boosting3D: High-Fidelity Image-to-3D by Boosting 2D Diffusion Prior to 3D Prior with Progressive Learning22 Nov 2023
- 2023Guide3D: Create 3D Avatars from Text and Image Guidance18 Aug 2023
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug 2023
- 2023Learning Structure-Guided Diffusion Model for 2D Human Pose Estimation29 Jun 2023
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation16 Jun 2023
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
12 most cited of 172 All 172 (JSON)
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion21 Aug 2026
- 2026VolHuMe: a High-Resolution Large Scale Dataset of Volumetric Human Meshes22 Jun 2026
- 2026PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation1 Jun 2026
- 2026MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images25 May 2026
- 2026OmniFit: Multi-modal 3D Body Fitting via Scale-agnostic Dense Landmark Prediction23 Apr 2026
- 2026DGHMesh: A Large-scale Dual-radar mmWave Dataset and Generalization-focused Benchmark for Human Mesh Reconstruction19 Apr 2026
- 2026ETCH-X: Robustify Expressive Body Fitting to Clothed Humans with Composable Datasets9 Apr 2026
- 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridging3 Apr 2026
- 2026CrowdGaussian: Reconstructing High-Fidelity 3D Gaussians for Human Crowd from a Single Image18 Mar 2026
- 2026Real-Time Human Frontal View Synthesis from a Single Image16 Mar 2026
- 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxies5 Jan 2026
12 newest of 172 All 172 (JSON)