Point-Based Modeling of Human Clothing
Not on the map. Why?
Abstract (arXiv)
We propose a new approach to human clothing modeling based on point clouds. Within this approach, we learn a deep model that can predict point clouds of various outfits, for various human poses, and for various human body shapes. Notably, outfits of various types and topologies can be handled by the same model. Using the learned model, we can infer the geometry of new outfits from as little as a single image, and perform outfit retargeting to new bodies in new poses. We complement our geometric model with appearance modeling that uses the point cloud geometry as a geometric scaffolding and employs neural point-based graphics to capture outfit appearance from videos and to re-render the captured outfits. We validate both geometric modeling and appearance modeling aspects of the proposed approach against recently proposed methods and establish the viability of point-based clothing modeling.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Builds on 48 of its 69 references that are in the map. First posted on arXiv 16 Apr 2021.
Builds on
48 of 69 references.
References · 48
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
36 more
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2019Neural Point-Based Graphicscited by 326
- 2017VITON: An Image-based Virtual Try-on Networkcited by 285
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
- 2018Video Based Reconstruction of 3D People Modelscited by 237
- 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
- 2017Optimizing the Latent Space of Generative Networkscited by 157
- 2020TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Stylecited by 148
- 2020Towards Photo-Realistic Virtual Try-On by Adaptively GeneratingleftrightarrowPreserving Image Contentcited by 148
- 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
- 2019Morphing and Sampling Network for Dense Point Cloud Completioncited by 132
- 2019Neural Rerendering in the Wildcited by 121
- 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 118
- 2019CLOTH3D: Clothed 3D Humanscited by 114
- 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
- 2019Graphonomy: Universal Human Parsing via Graph Transfer Learningcited by 81
- 2020Do Not Mask What You Do Not Need to Mask: a Parser-Free Virtual Try-Oncited by 77
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2018GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Drapingcited by 69
- 2018SiCloPe: Silhouette-Based Clothed Peoplecited by 68
- 2019Moulding Humans: Non-parametric 3D Human Shape Estimation from Single Imagescited by 67
- 2020MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Videocited by 62
- 2020Learning to Transfer Texture from Clothing Images to 3D Humanscited by 58
- 2017The Conditional Analogy GAN: Swapping Fashion Articles on People Imagescited by 33
- 2019Fashion++: Minimal Edits for Outfit Improvementcited by 20
- 2019Generating High-Resolution Fashion Model Images Wearing Custom Outfitscited by 15
- 2021Neural 3D Clothes Retargeting from a Single Imagecited by 5
Built on by
Citing papers per year: 2021: 1; 2022: 10; 2023: 13; 2024: 7; 2025: 4; 2026: 2.
37 papers.
Sort:
By area:
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 77
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 39
- 2023Dynamic Point Fieldscited by 37
- 2023ISP: Multi-Layered Garment Draping with Implicit Sewing Patternscited by 31
- 2022DIG: Draping Implicit Garment over the Human Bodycited by 26
25 more
- 2023NPC: Neural Point Characters from Videocited by 26
- 2023Garment Recovery with Shape and Deformation Priorscited by 23
- 2023CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decompositioncited by 21
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatarscited by 20
- 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priorscited by 19
- 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Imagecited by 17
- 2023TriVol: Point Cloud Rendering via Triple Volumescited by 16
- 2022Neural Mesh-Based Graphicscited by 12
- 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinatescited by 12
- 2022NeuralTailor: Reconstructing Sewing Pattern Structures from 3D Point Clouds of Garmentscited by 10
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothingcited by 9
- 2025PhysRig: Differentiable Physics-Based Skinning and Rigging Framework for Realistic Articulated Object Modelingcited by 8
- 2023Learning Anchor Transformations for 3D Garment Animationcited by 7
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
- 2023A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Drapingcited by 4
- 2022AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modelingcited by 3
- 2025DiffusedWrinkles: A Diffusion-Based Model for Data-Driven Garment Animationcited by 3
- 2023DeepIron: Predicting Unwarped Garment Texture from a Single Imagecited by 2
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modelingcited by 2
- 2025Human Geometry Distribution for 3D Animation Generationcited by 2
- 2024A Comparative Study of Garment Draping Techniquescited by 1
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesiscited by 1
- 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridgingcited by 1
- 2024InstantGeoAvatar: Effective Geometry and Appearance Modeling of Animatable Avatars from Monocular Videocited by 0
- 2026DiT-Garment: Garment Dynamics with Diffusion Transformerscited by 0
- 2026DiT-Garment: Garment Dynamics with Diffusion Transformers16 Sep 2026
- 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridging3 Apr 2026
- 2025Human Geometry Distribution for 3D Animation Generation8 Dec 2025
- 2025PhysRig: Differentiable Physics-Based Skinning and Rigging Framework for Realistic Articulated Object Modeling26 Jun 2025
- 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates11 Apr 2025
- 2025DiffusedWrinkles: A Diffusion-Based Model for Data-Driven Garment Animation24 Mar 2025
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing12 Dec 2024
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling29 Nov 2024
- 2024InstantGeoAvatar: Effective Geometry and Appearance Modeling of Animatable Avatars from Monocular Video3 Nov 2024
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesis13 Oct 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Image25 Sep 2024
25 more
- 2024A Comparative Study of Garment Draping Techniques17 May 2024
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstruction10 Dec 2023
- 2023Garment Recovery with Shape and Deformation Priors17 Nov 2023
- 2023A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Draping5 Nov 2023
- 2023DeepIron: Predicting Unwarped Garment Texture from a Single Image24 Oct 2023
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug 2023
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatars11 Aug 2023
- 2023ISP: Multi-Layered Garment Draping with Implicit Sewing Patterns23 May 2023
- 2023CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decomposition6 Apr 2023
- 2023Dynamic Point Fields5 Apr 2023
- 2023NPC: Neural Point Characters from Video4 Apr 2023
- 2023Learning Anchor Transformations for 3D Garment Animation3 Apr 2023
- 2023TriVol: Point Cloud Rendering via Triple Volumes29 Mar 2023
- 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priors2 Feb 2023
- 2022ECON: Explicit Clothed humans Optimized via Normal integration14 Dec 2022
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics14 Dec 2022
- 2022DrapeNet: Garment Generation and Self-Supervised Draping21 Nov 2022
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFs18 Oct 2022
- 2022DIG: Draping Implicit Garment over the Human Body22 Sep 2022
- 2022Neural Mesh-Based Graphics10 Aug 2022
- 2022Realistic One-shot Mesh-based Head Avatars16 Jun 2022
- 2022AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modeling25 Mar 2022
- 2022NeuralTailor: Reconstructing Sewing Pattern Structures from 3D Point Clouds of Garments31 Jan 2022
- 2022gDNA: Towards Generative Detailed Neural Avatars11 Jan 2022
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images22 Jun 2021
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothingcited by 9
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
- 2025DiffusedWrinkles: A Diffusion-Based Model for Data-Driven Garment Animationcited by 3
- 2026DiT-Garment: Garment Dynamics with Diffusion Transformerscited by 0
- 2026DiT-Garment: Garment Dynamics with Diffusion Transformers16 Sep 2026
- 2025DiffusedWrinkles: A Diffusion-Based Model for Data-Driven Garment Animation24 Mar 2025
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing12 Dec 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humans16 Aug 2023
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 77
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 39
- 2023Dynamic Point Fieldscited by 37
- 2023ISP: Multi-Layered Garment Draping with Implicit Sewing Patternscited by 31
- 2022DIG: Draping Implicit Garment over the Human Bodycited by 26
- 2023NPC: Neural Point Characters from Videocited by 26
12 most cited of 32 All 32 (JSON)
- 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridging3 Apr 2026
- 2025Human Geometry Distribution for 3D Animation Generation8 Dec 2025
- 2025PhysRig: Differentiable Physics-Based Skinning and Rigging Framework for Realistic Articulated Object Modeling26 Jun 2025
- 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates11 Apr 2025
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling29 Nov 2024
- 2024InstantGeoAvatar: Effective Geometry and Appearance Modeling of Animatable Avatars from Monocular Video3 Nov 2024
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesis13 Oct 2024
- 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Image25 Sep 2024
- 2024A Comparative Study of Garment Draping Techniques17 May 2024
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstruction10 Dec 2023
- 2023Garment Recovery with Shape and Deformation Priors17 Nov 2023
- 2023A Generative Multi-Resolution Pyramid and Normal-Conditioning 3D Cloth Draping5 Nov 2023
12 newest of 32 All 32 (JSON)