SHARP: Shape-Aware Reconstruction of People in Loose Clothing
Not on the map. Why?
Abstract (arXiv)
Recent advancements in deep learning have enabled 3D human body reconstruction from a monocular image, which has broad applications in multiple domains. In this paper, we propose SHARP (SHape Aware Reconstruction of People in loose clothing), a novel end-to-end trainable network that accurately recovers the 3D geometry and appearance of humans in loose clothing from a monocular image. SHARP uses a sparse and efficient fusion strategy to combine parametric body prior with a non-parametric 2D representation of clothed humans. The parametric body prior enforces geometrical consistency on the body shape and pose, while the non-parametric representation models loose clothing and handle self-occlusions as well. We also leverage the sparseness of the non-parametric representation for faster training of our network while using losses on 2D maps. Another key contribution is 3DHumans, our new life-like dataset of 3D human body scans with rich geometrical and textural details. We evaluate SHARP on 3DHumans and other publicly available datasets and show superior qualitative and quantitative performance than existing state-of-the-art methods.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 47 of its 75 references that are in the map. First posted on arXiv 24 May 2022.
Builds on
47 of 75 references.
References · 47
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2017Learning from Synthetic Humanscited by 359
- 2018Learning 3D Human Dynamics from Videocited by 316
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
35 more
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 245
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
- 2020DeepCap: Monocular Human Performance Capture Using Weak Supervisioncited by 162
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
- 2021Probabilistic Modeling for Human Mesh Recoverycited by 153
- 2020TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Stylecited by 149
- 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
- 2018Instance-level Human Parsing via Part Grouping Networkcited by 134
- 2020Combining Implicit Function Learning and Parametric Models for 3D Human Reconstructioncited by 133
- 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
- 2019CLOTH3D: Clothed 3D Humanscited by 116
- 2020Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstructioncited by 112
- 2020LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registrationcited by 108
- 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2017Detailed, accurate, human shape estimation from clothed 3D scan sequencescited by 89
- 2020SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothingcited by 87
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2019Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformationcited by 71
- 2020PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsamplingcited by 69
- 2018SiCloPe: Silhouette-Based Clothed Peoplecited by 68
- 2019Moulding Humans: Non-parametric 3D Human Shape Estimation from Single Imagescited by 67
- 2019FACSIMILE: Fast and Accurate Scans From an Image in Less Than a Secondcited by 35
- 2019Shape-Aware Human Pose and Shape Reconstruction Using Multi-View Imagescited by 28
- 2020Self-Supervised Human Depth Estimation from Monocular Videoscited by 17
- 2019HumanMeshNet: Polygonal Mesh Recovery of Humanscited by 6
- 2018Deep Textured 3D Reconstruction of Human Bodiescited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 5; 2025: 2; 2026: 2.
12 papers.
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2024CloSe: A 3D Clothing Segmentation Dataset and Modelcited by 22
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergycited by 16
- 2022xCloth: Extracting Template-free Textured 3D Clothes from a Monocular Imagecited by 6
- 2023SPnet: Estimating Garment Sewing Patterns from a Single Imagecited by 5
- 2024From Easy to Hard: Learning Curricular Shape-aware Features for Robust Panoptic Scene Graph Generationcited by 3
- 2023Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Mapscited by 1
- 2024Learning Localization of Body and Finger Animation Skeleton Joints on Three-Dimensional Models of Human Bodiescited by 1
- 2025OpenHuman4D: Open-Vocabulary 4D Human Parsingcited by 0
- 2025Three-dimensional narrow volume reconstruction method with unconditional stability based on a phase-field Lagrange multiplier approachcited by 0
- 2026SARS: A Novel Face and Body Shape and Appearance Aware 3D Reconstruction System extends Morphable Modelscited by 0
- 2026MB-Loc: Multi-planar Bird's-eye-view Localization in outdoor LiDAR scenescited by 0
- 2026MB-Loc: Multi-planar Bird's-eye-view Localization in outdoor LiDAR scenes7 Jun 2026
- 2026SARS: A Novel Face and Body Shape and Appearance Aware 3D Reconstruction System extends Morphable Models10 Feb 2026
- 2025Three-dimensional narrow volume reconstruction method with unconditional stability based on a phase-field Lagrange multiplier approach1 Nov 2025
- 2025OpenHuman4D: Open-Vocabulary 4D Human Parsing14 Jul 2025
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy9 Dec 2024
- 2024From Easy to Hard: Learning Curricular Shape-aware Features for Robust Panoptic Scene Graph Generation12 Jul 2024
- 2024Learning Localization of Body and Finger Animation Skeleton Joints on Three-Dimensional Models of Human Bodies11 Jul 2024
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun 2024
- 2024CloSe: A 3D Clothing Segmentation Dataset and Model22 Jan 2024
- 2023SPnet: Estimating Garment Sewing Patterns from a Single Image26 Dec 2023
- 2023Weakly-Supervised 3D Reconstruction of Clothed Humans via Normal Maps27 Nov 2023
- 2022xCloth: Extracting Template-free Textured 3D Clothes from a Monocular Image27 Aug 2022