Detailed, accurate, human shape estimation from clothed 3D scan sequences
Not on the map. Why?
Abstract (arXiv)
We address the problem of estimating human pose and body shape from 3D scans over time. Reliable estimation of 3D body shape is necessary for many applications including virtual try-on, health monitoring, and avatar creation for virtual reality. Scanning bodies in minimal clothing, however, presents a practical barrier to these applications. We address this problem by estimating body shape under clothing from a sequence of 3D scans. Previous methods that have exploited body models produce smooth shapes lacking personalized details. We contribute a new approach to recover a personalized shape of the person. The estimated shape deviates from a parametric model to fit the 3D scans. We demonstrate the method using high quality 4D data as well as sequences of visual hulls extracted from multi-view images. We also make available BUFF, a new 4D dataset that enables quantitative evaluation (http://buff.is.tue.mpg.de). Our method outperforms the state of the art in both pose estimation and shape estimation, qualitatively and quantitatively.
Key facts. Cited by 89 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 24; 2023: 18; 2024: 16; 2025: 4; 2026: 7.
89 papers.
Sort:
By area:
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 205
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 180
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 117
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2022SNUG: Self-Supervised Neural Dynamic Garmentscited by 83
- 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
38 more
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
- 2022NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactionscited by 68
- 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatarcited by 66
- 2023X-Avatar: Expressive Human Avatarscited by 66
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 54
- 2022PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequencecited by 46
- 2021Dynamic Surface Function Networks for Clothed Human Bodiescited by 44
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2021Locally Aware Piecewise Transformation Fields for 3D Human Mesh Registrationcited by 41
- 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Visioncited by 38
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 38
- 2022Learned Vertex Descent: A New Direction for 3D Human Model Fittingcited by 37
- 2021Generating Datasets of 3D Garments with Sewing Patternscited by 34
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Imagecited by 34
- 2022Neural Point-based Shape Modeling of Humans in Challenging Clothingcited by 29
- 2024GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patternscited by 28
- 2022JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstructioncited by 26
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environmentcited by 23
- 2022PERGAMO: Personalized 3D Garments from Monocular Videocited by 22
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Inputcited by 22
- 2024CloSe: A 3D Clothing Segmentation Dataset and Modelcited by 22
- 2022SUPR: A Sparse Unified Part-Based Human Representationcited by 21
- 2023NSF: Neural Surface Fields for Human Modeling from Monocular Depthcited by 21
- 2022Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothingcited by 19
- 2021HUMBI: A Large Multiview Dataset of Human Body Expressions and Benchmark Challengecited by 17
- 2021Detailed Avatar Recovery from Single Imagecited by 16
- 2023Towards Multi-Layered 3D Garments Animationcited by 16
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albumscited by 16
- 2024GarVerseLOD: High-Fidelity 3D Garment Reconstruction from a Single In-the-Wild Image using a Dataset with Levels of Detailscited by 16
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergycited by 16
- 2021Action2video: Generating Videos of Human 3D Actionscited by 15
- 2023Animatable 3D Gaussians for High-fidelity Synthesis of Human Motionscited by 15
- 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generationcited by 15
- 2023Efficient 3D Articulated Human Generation with Layered Surface Volumescited by 13
- 2021Self-supervised 3D Representation Learning of Dressed Humans from Social Media Videoscited by 12
- 2022SHARP: Shape-Aware Reconstruction of People in Loose Clothingcited by 12
50 most cited of 89 All 89 (JSON)
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns1 Jul 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026OmniFit: Multi-modal 3D Body Fitting via Scale-agnostic Dense Landmark Prediction23 Apr 2026
- 2026ETCH-X: Robustify Expressive Body Fitting to Clothed Humans with Composable Datasets9 Apr 2026
- 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On4 Mar 2026
- 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxies5 Jan 2026
- 2025OpenHuman4D: Open-Vocabulary 4D Human Parsing14 Jul 2025
- 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitization3 May 2025
- 2025GarmageNet: A Multimodal Generative Framework for Sewing Pattern Design and Generic Garment Modeling2 Apr 2025
- 2025ETCH: Generalizing Body Fitting to Clothed Humans via Equivariant Tightness13 Mar 2025
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing12 Dec 2024
38 more
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy9 Dec 2024
- 2024GarVerseLOD: High-Fidelity 3D Garment Reconstruction from a Single In-the-Wild Image using a Dataset with Levels of Details5 Nov 2024
- 2024Motion Capture from Inertial and Vision Sensors23 Jul 2024
- 2024Learning Localization of Body and Finger Animation Skeleton Joints on Three-Dimensional Models of Human Bodies11 Jul 2024
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun 2024
- 2024CanFields: Consolidating Diffeomorphic Flows for Non-Rigid 4D Interpolation from Arbitrary-Length Sequences5 Jun 2024
- 2024SMPLX-Lite: A Realistic and Drivable Avatar Benchmark with Rich Geometry and Texture Annotations30 May 2024
- 2024GarmentCodeData: A Dataset of 3D Made-to-Measure Garments With Sewing Patterns27 May 2024
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albums23 May 2024
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotations29 Apr 2024
- 2024Neural-ABC: Neural Parametric Models for Articulated Body with Clothes6 Apr 2024
- 2024Design2Cloth: 3D Cloth Generation from 2D Masks3 Apr 2024
- 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generation19 Mar 2024
- 2024Fine Structure-Aware Sampling: A New Sampling Training Scheme for Pixel-Aligned Implicit Models in Single-View Human Reconstruction29 Feb 2024
- 2024CloSe: A 3D Clothing Segmentation Dataset and Model22 Jan 2024
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation12 Dec 2023
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Captures5 Dec 2023
- 2023Animatable 3D Gaussians for High-fidelity Synthesis of Human Motions22 Nov 2023
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Image7 Nov 2023
- 2023High-Quality Animatable Dynamic Garment Reconstruction from Monocular Videos2 Nov 2023
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input9 Oct 2023
- 2023Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing28 Sep 2023
- 2023AnthroNet: Conditional Generation of Humans via Anthropometrics7 Sep 2023
- 2023NSF: Neural Surface Fields for Human Modeling from Monocular Depth28 Aug 2023
- 2023ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environment19 Aug 2023
- 2023Leveraging Intrinsic Properties for Non-Rigid Garment Alignment18 Aug 2023
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Rendering19 Jul 2023
- 2023Efficient 3D Articulated Human Generation with Layered Surface Volumes11 Jul 2023
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion29 Jun 2023
- 20234DHumanOutfit: a multi-subject 4D dataset of human motion sequences in varying outfits exhibiting large displacements12 Jun 2023
- 2023Towards Multi-Layered 3D Garments Animation17 May 2023
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Images27 Mar 2023
- 2023X-Avatar: Expressive Human Avatars8 Mar 2023
- 2022NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactions15 Dec 2022
- 2022Layered-Garment Net: Generating Multiple Implicit Garment Layers from a Single Image22 Nov 2022
- 2022IntegratedPIFu: Integrated Pixel Aligned Implicit Function for Single-view Human Reconstruction15 Nov 2022
- 2022PERGAMO: Personalized 3D Garments from Monocular Video26 Oct 2022
- 2022SUPR: A Sparse Unified Part-Based Human Representation25 Oct 2022
50 newest of 89 All 89 (JSON)
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 38
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergycited by 16
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothingcited by 9
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing12 Dec 2024
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy9 Dec 2024
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun 2024
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation12 Dec 2023
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2021AGORA: Avatars in Geography Optimized for Regression Analysiscited by 205
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 180
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 117
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2022SNUG: Self-Supervised Neural Dynamic Garmentscited by 83
- 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
12 most cited of 85 All 85 (JSON)
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns1 Jul 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026OmniFit: Multi-modal 3D Body Fitting via Scale-agnostic Dense Landmark Prediction23 Apr 2026
- 2026ETCH-X: Robustify Expressive Body Fitting to Clothed Humans with Composable Datasets9 Apr 2026
- 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On4 Mar 2026
- 2026DiffProxy: Multi-View Human Mesh Recovery via Diffusion-Generated Dense Proxies5 Jan 2026
- 2025OpenHuman4D: Open-Vocabulary 4D Human Parsing14 Jul 2025
- 2025MVHumanNet++: A Large-scale Dataset of Multi-view Daily Dressing Human Captures with Richer Annotations for 3D Human Digitization3 May 2025
- 2025GarmageNet: A Multimodal Generative Framework for Sewing Pattern Design and Generic Garment Modeling2 Apr 2025
- 2025ETCH: Generalizing Body Fitting to Clothed Humans via Equivariant Tightness13 Mar 2025
- 2024GarVerseLOD: High-Fidelity 3D Garment Reconstruction from a Single In-the-Wild Image using a Dataset with Levels of Details5 Nov 2024
12 newest of 85 All 85 (JSON)