High-Fidelity Clothed Avatar Reconstruction from a Single Image
Not on the map. Why?
Abstract (arXiv)
This paper presents a framework for efficient 3D clothed avatar reconstruction. By combining the advantages of the high accuracy of optimization-based methods and the efficiency of learning-based methods, we propose a coarse-to-fine way to realize a high-fidelity clothed avatar reconstruction (CAR) from a single image. At the first stage, we use an implicit model to learn the general shape in the canonical space of a person in a learning-based way, and at the second stage, we refine the surface detail by estimating the non-rigid deformation in the posed space in an optimization way. A hyper-network is utilized to generate a good initialization so that the convergence o f the optimization process is greatly accelerated. Extensive experiments on various datasets show that the proposed CAR successfully produces high-fidelity avatars for arbitrarily clothed humans in real scenes.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Builds on 41 of its 62 references that are in the map. First posted on arXiv 8 Apr 2023.
Builds on
41 of 62 references.
References · 41
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
29 more
- 2018Video Based Reconstruction of 3D People Modelscited by 238
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
- 2020Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstructioncited by 112
- 2018Detailed Human Avatars from Monocular Videocited by 109
- 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
- 2018LiveCap: Real-time Human Performance Capture from Monocular Videocited by 93
- 2019Learning-Based Animation of Clothing for Virtual Try-Oncited by 89
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
- 2020Monocular Real-Time Volumetric Performance Capturecited by 74
- 2017MonoPerfCap: Human Performance Capture from Monocular Videocited by 63
- 2020MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Videocited by 62
- 2018Photo Wake-Up: 3D Character Animation from a Single Photocited by 60
- 2022MIME: Human-Aware 3D Scene Generationcited by 57
- 2022AvatarCap: Animatable Avatar Conditioned Monocular Human Volumetric Capturecited by 25
- 2019A Neural Network for Detailed Human Depth Estimation from a Single Imagecited by 21
Built on by
Citing papers per year: 2023: 11; 2024: 11; 2025: 13; 2026: 3.
38 papers.
Sort:
By area:
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2023TADA! Text to Animatable Digital Avatarscited by 110
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 91
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2024GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splattingcited by 36
- 2023D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Fieldcited by 26
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
26 more
- 2023ConTex-Human: Free-View Rendering of Human from a Single Image with Texture-Consistent Synthesiscited by 16
- 2024GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understandingcited by 15
- 2024CanonicalFusion: Generating Drivable 3D Human Avatars from Multiple Imagescited by 12
- 2025LIFe-GoM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Meshcited by 11
- 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Datacited by 7
- 2024Motion-Aware Animatable Gaussian Avatars Deblurringcited by 6
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3Dcited by 6
- 2024Semantic Human Mesh Reconstruction with Texturescited by 5
- 2024X-Oscar: A Progressive Framework for High-quality Text-guided 3D Animatable Avatar Generationcited by 5
- 2025FRESA: Feedforward Reconstruction of Personalized Skinned Avatars from Few Imagescited by 4
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Imagecited by 4
- 2024An Embeddable Implicit IUVD Representation for Part-based 3D Human Surface Reconstructioncited by 2
- 2025Deblur-Avatar: Animatable Avatars from Motion-Blurred Monocular Videoscited by 2
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Imagecited by 2
- 2024TIFu: Tri-directional Implicit Function for High-Fidelity 3D Character Reconstructioncited by 1
- 2024COSMU: Complete 3D human shape from monocular unconstrained imagescited by 1
- 2024MVBoost: Boost 3D Reconstruction with Multi-View Refinementcited by 1
- 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformationcited by 1
- 2025MVD-HuGaS: Human Gaussians from a Single Image via 3D Human Multi-view Diffusion Priorcited by 1
- 2026TeHOR: Text-Guided 3D Human and Object Reconstruction with Texturescited by 1
- 2025Real-Time Animatable 2DGS-Avatars with Detail Enhancement from Monocular Videoscited by 0
- 2025Link to the Past: Temporal Propagation for Fast 3D Human Reconstruction from Monocular Videocited by 0
- 2025ReMu: Reconstructing Multi-layer 3D Clothed Human from Image Layerscited by 0
- 2026HOIGS: Human-Object Interaction Gaussian Splattingcited by 0
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Imagecited by 0
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image1 Jun 2026
- 2026HOIGS: Human-Object Interaction Gaussian Splatting5 Apr 2026
- 2026TeHOR: Text-Guided 3D Human and Object Reconstruction with Textures23 Feb 2026
- 2025ReMu: Reconstructing Multi-layer 3D Clothed Human from Image Layers2 Aug 2025
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image23 Jul 2025
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3D16 Jun 2025
- 2025Link to the Past: Temporal Propagation for Fast 3D Human Reconstruction from Monocular Video12 May 2025
- 2025Real-Time Animatable 2DGS-Avatars with Detail Enhancement from Monocular Videos1 May 2025
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data27 Mar 2025
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2025FRESA: Feedforward Reconstruction of Personalized Skinned Avatars from Few Images24 Mar 2025
- 2025MVD-HuGaS: Human Gaussians from a Single Image via 3D Human Multi-view Diffusion Prior11 Mar 2025
26 more
- 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformation24 Feb 2025
- 2025HumanGif: Single-View Human Diffusion with Generative Prior17 Feb 2025
- 2025LIFe-GoM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Mesh13 Feb 2025
- 2025Deblur-Avatar: Animatable Avatars from Motion-Blurred Monocular Videos23 Jan 2025
- 2024MVBoost: Boost 3D Reconstruction with Multi-View Refinement26 Nov 2024
- 2024Motion-Aware Animatable Gaussian Avatars Deblurring24 Nov 2024
- 2024COSMU: Complete 3D human shape from monocular unconstrained images15 Jul 2024
- 2024CanonicalFusion: Generating Drivable 3D Human Avatars from Multiple Images5 Jul 2024
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors18 Jun 2024
- 2024X-Oscar: A Progressive Framework for High-quality Text-guided 3D Animatable Avatar Generation2 May 2024
- 2024GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understanding6 Mar 2024
- 2024Semantic Human Mesh Reconstruction with Textures5 Mar 2024
- 2024An Embeddable Implicit IUVD Representation for Part-based 3D Human Surface Reconstruction30 Jan 2024
- 2024TIFu: Tri-directional Implicit Function for High-Fidelity 3D Character Reconstruction25 Jan 2024
- 2024GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splatting18 Jan 2024
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstruction10 Dec 2023
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videos5 Dec 2023
- 2023ConTex-Human: Free-View Rendering of Human from a Single Image with Texture-Consistent Synthesis28 Nov 2023
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatars28 Nov 2023
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion28 Nov 2023
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion27 Nov 2023
- 2023TADA! Text to Animatable Digital Avatars21 Aug 2023
- 2023D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field17 Aug 2023
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug 2023
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environments5 Jun 2023
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation15 May 2023
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
- 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Datacited by 7
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Imagecited by 4
- 2025MVD-HuGaS: Human Gaussians from a Single Image via 3D Human Multi-view Diffusion Priorcited by 1
- 2025Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data27 Mar 2025
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2025MVD-HuGaS: Human Gaussians from a Single Image via 3D Human Multi-view Diffusion Prior11 Mar 2025
- 2025HumanGif: Single-View Human Diffusion with Generative Prior17 Feb 2025
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion28 Nov 2023
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion27 Nov 2023
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug 2023
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2023TADA! Text to Animatable Digital Avatarscited by 110
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 91
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2023NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimationcited by 45
- 2024GaussianBody: Clothed Human Reconstruction via 3d Gaussian Splattingcited by 36
- 2023D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Fieldcited by 26
- 2023ConTex-Human: Free-View Rendering of Human from a Single Image with Texture-Consistent Synthesiscited by 16
- 2024GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understandingcited by 15
- 2024CanonicalFusion: Generating Drivable 3D Human Avatars from Multiple Imagescited by 12
12 most cited of 31 All 31 (JSON)
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image1 Jun 2026
- 2026HOIGS: Human-Object Interaction Gaussian Splatting5 Apr 2026
- 2026TeHOR: Text-Guided 3D Human and Object Reconstruction with Textures23 Feb 2026
- 2025ReMu: Reconstructing Multi-layer 3D Clothed Human from Image Layers2 Aug 2025
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image23 Jul 2025
- 2025LHM++: An Efficient Large Human Reconstruction Model for Pose-free Images to 3D16 Jun 2025
- 2025Link to the Past: Temporal Propagation for Fast 3D Human Reconstruction from Monocular Video12 May 2025
- 2025Real-Time Animatable 2DGS-Avatars with Detail Enhancement from Monocular Videos1 May 2025
- 2025FRESA: Feedforward Reconstruction of Personalized Skinned Avatars from Few Images24 Mar 2025
- 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformation24 Feb 2025
- 2025LIFe-GoM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Mesh13 Feb 2025
- 2025Deblur-Avatar: Animatable Avatars from Motion-Blurred Monocular Videos23 Jan 2025
12 newest of 31 All 31 (JSON)