Multi-Garment Net: Learning to Dress 3D People from Images
Not on the map. Why?
Abstract (arXiv)
We present Multi-Garment Network (MGN), a method to predict body shape and clothing, layered on top of the SMPL model from a few frames (1-8) of a video. Several experiments demonstrate that this representation allows higher level of control when compared to single mesh or voxel representations of shape. Our model allows to predict garment geometry, relate it to the body shape, and transfer it to new body shapes and poses. To train MGN, we leverage a digital wardrobe containing 712 digital garments in correspondence, obtained with a novel method to register a set of clothing templates to a dataset of real 3D scans of people in different clothing and poses. Garments from the digital wardrobe, or predicted by MGN, can be used to dress any body shape in arbitrary poses. We will make publicly available the digital wardrobe, the MGN model, and code to dress SMPL with the garments.
Key facts. Cited by 245 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 57; 2023: 55; 2024: 49; 2025: 19; 2026: 14.
245 papers.
Sort:
By area:
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2021Real-time Deep Dynamic Characterscited by 133
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
38 more
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2021Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothingcited by 102
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2021NPMs: Neural Parametric Models for 3D Deformable Shapescited by 90
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2022Style-Based Global Appearance Flow for Virtual Try-Oncited by 88
- 2023Hi4D: 4D Instance Segmentation of Close Human Interactioncited by 87
- 2022Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldscited by 85
- 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84
- 2022SNUG: Self-Supervised Neural Dynamic Garmentscited by 83
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 76
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2022Neural Dual Contouringcited by 71
- 2023X-Avatar: Expressive Human Avatarscited by 66
- 2022Single Stage Virtual Try-on via Deformable Attention Flowscited by 65
- 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
- 2022Drivable Volumetric Avatars using Texel-Aligned Featurescited by 62
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 56
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 54
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2021Learning Skeletal Articulations with Neural Blend Shapescited by 53
- 2022Learning Implicit Templates for Point-Based Clothed Human Modelingcited by 50
- 2021Hierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wildcited by 48
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 47
- 2022PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequencecited by 46
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
- 20223D Clothed Human Reconstruction in the Wildcited by 42
- 2023Single-Image 3D Human Digitization with Shape-Guided Diffusioncited by 42
- 2022CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshescited by 41
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 41
- 2023NeUDF: Leaning Neural Unsigned Distance Fields with Volume Renderingcited by 41
- 2021NeuralHumanFVV: Real-Time Neural Volumetric Human Performance Rendering using RGB Camerascited by 40
- 2022Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Imagescited by 39
- 2021StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Visioncited by 38
50 most cited of 245 All 245 (JSON)
- 2026MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction14 Oct 2026
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns31 Aug 2026
- 2026Forwardrobe: Garment-Aware Gaussian Avatars from a Single Image31 Jul 2026
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns1 Jul 2026
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments23 Jun 2026
- 2026AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalization2 Jun 2026
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image1 Jun 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates27 Feb 2026
- 2026Neu-PiG: Neural Preconditioned Grids for Fast Dynamic Surface Reconstruction on Long Sequences25 Feb 2026
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Draping8 Feb 2026
38 more
- 2026Learning Sewing Patterns via Latent Flow Matching of Implicit Fields25 Jan 2026
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Image14 Jan 2026
- 2025Preconditioned Deformation Grids22 Sep 2025
- 2025High Resolution UDF Meshing via Iterative Networks21 Sep 2025
- 2025Point cloud segmentation for 3D Clothed Human Layering7 Aug 2025
- 2025ReMu: Reconstructing Multi-layer 3D Clothed Human from Image Layers2 Aug 2025
- 2025VITON-DRR: Details Retention Virtual Try-on via Non-rigid Registration29 May 2025
- 2025UltraBoneUDF: Self-supervised Bone Surface Reconstruction from Ultrasound Based on Neural Unsigned Distance Functions23 May 2025
- 2025From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketching15 May 2025
- 2025ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos17 Apr 2025
- 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates11 Apr 2025
- 2025GarmageNet: A Multimodal Generative Framework for Sewing Pattern Design and Generic Garment Modeling2 Apr 2025
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2025FRESA: Feedforward Reconstruction of Personalized Skinned Avatars from Few Images24 Mar 2025
- 2025TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting21 Mar 2025
- 2025OffsetOPT: Explicit Surface Reconstruction without Normals20 Mar 2025
- 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Direction15 Mar 2025
- 2025GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing11 Mar 2025
- 2025MF-VITON: High-Fidelity Mask-Free Virtual Try-On with Minimal Input11 Mar 2025
- 2025Open-Vocabulary Semantic Part Segmentation of 3D Human27 Feb 2025
- 2025Neural Shortest Path for Surface Reconstruction from Point Clouds9 Feb 2025
- 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Models23 Dec 2024
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing12 Dec 2024
- 2024AIpparel: A Multimodal Foundation Model for Digital Garments5 Dec 2024
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction3 Dec 2024
- 2024HumanRig: Learning Automatic Rigging for Humanoid Character in a Large Scale Dataset3 Dec 2024
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling29 Nov 2024
- 2024MVBoost: Boost 3D Reconstruction with Multi-View Refinement26 Nov 2024
- 2024TED-VITON: Transformer-Empowered Diffusion Models for Virtual Try-On26 Nov 2024
- 2024DAGSM: Disentangled Avatar Generation with GS-enhanced Mesh20 Nov 2024
- 2024GarVerseLOD: High-Fidelity 3D Garment Reconstruction from a Single In-the-Wild Image using a Dataset with Levels of Details5 Nov 2024
- 2024NASM: Neural Anisotropic Surface Meshing30 Oct 2024
- 2024Gradient Distance Function29 Oct 2024
- 2024Monge-Ampere Regularization for Learning Arbitrary Shapes from Point Clouds24 Oct 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024Disco4D: Disentangled 4D Human Generation and Animation from a Single Image25 Sep 2024
- 2024ReLoo: Reconstructing Humans Dressed in Loose Garments from Monocular Video in the Wild23 Sep 2024
- 2024MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds1 Sep 2024
50 newest of 245 All 245 (JSON)
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023Single-Image 3D Human Digitization with Shape-Guided Diffusioncited by 42
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 38
- 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinementcited by 24
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothingcited by 9
- 2024DreamVTON: Customizing 3D Virtual Try-on with Personalized Diffusion Modelscited by 8
- 2024TED-VITON: Transformer-Empowered Diffusion Models for Virtual Try-Oncited by 8
- 2025MF-VITON: High-Fidelity Mask-Free Virtual Try-On with Minimal Inputcited by 6
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Imagecited by 4
12 most cited of 15 All 15 (JSON)
- 2026Learning Sewing Patterns via Latent Flow Matching of Implicit Fields25 Jan 2026
- 2025DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image25 Mar 2025
- 2025MF-VITON: High-Fidelity Mask-Free Virtual Try-On with Minimal Input11 Mar 2025
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing12 Dec 2024
- 2024TED-VITON: Transformer-Empowered Diffusion Models for Virtual Try-On26 Nov 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinement26 Aug 2024
- 2024DreamVTON: Customizing 3D Virtual Try-on with Personalized Diffusion Models23 Jul 2024
- 2024GraVITON: Graph based garment warping with attention guided inversion for Virtual-tryon4 Jun 2024
- 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM22 Jan 2024
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation12 Dec 2023
- 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion28 Nov 2023
12 newest of 15 All 15 (JSON)
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2021Real-time Deep Dynamic Characterscited by 133
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
12 most cited of 229 All 229 (JSON)
- 2026MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction14 Oct 2026
- 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need10 Sep 2026
- 2026GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns31 Aug 2026
- 2026Forwardrobe: Garment-Aware Gaussian Avatars from a Single Image31 Jul 2026
- 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns1 Jul 2026
- 2026PatternGSL: A Structured Specification Language for Template-Free and Simulation-Ready 3D Garments23 Jun 2026
- 2026AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalization2 Jun 2026
- 2026HumanNOVA: Photorealistic, Universal and Rapid 3D Human Avatar Modeling from a Single Image1 Jun 2026
- 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars20 May 2026
- 2026Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates27 Feb 2026
- 2026Neu-PiG: Neural Preconditioned Grids for Fast Dynamic Surface Reconstruction on Long Sequences25 Feb 2026
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Draping8 Feb 2026
12 newest of 229 All 229 (JSON)