mlsanityData to 14 Oct 2026

DiffusedWrinkles: A Diffusion-Based Model for Data-Driven Garment Animation

arXiv 2503.18370 ↗First posted 24 Mar 2025cs.CVcited by 3

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We present a data-driven method for learning to generate animations of 3D garments using a 2D image diffusion model. In contrast to existing methods, typically based on fully connected networks, graph neural networks, or generative adversarial networks, which have difficulties to cope with parametric garments with fine wrinkle detail, our approach is able to synthesize high-quality 3D animations for a wide variety of garments and body shapes, while being agnostic to the garment mesh topology. Our key idea is to represent 3D garment deformations as a 2D layout-consistent texture that encodes 3D offsets with respect to a parametric garment template. Using this representation, we encode a large dataset of garments simulated in various motions and shapes and train a novel conditional diffusion model that is able to synthesize high-quality pose-shape-and-design dependent 3D garment deformations. Since our model is generative, we can synthesize various plausible deformations for a given target pose, shape, and design. Additionally, we show that we can further condition our model using an existing garment state, which enables the generation of temporally coherent sequences.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 50 of its 86 references that are in the map. First posted on arXiv 24 Mar 2025.

Builds on

50 of 86 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model17 Apr
  2. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  3. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 47

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2022Video Diffusion Modelscited by 2,305
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  8. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  9. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  10. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  11. 2022Human Motion Diffusion Modelcited by 1,080
  12. 2022Diffusion Models in Vision: A Surveycited by 1,015
35 more
  1. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  2. 2022On Distillation of Guided Diffusion Modelscited by 725
  3. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  4. 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 464
  5. 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
  6. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 331
  7. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 309
  8. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
  9. 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
  10. 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
  11. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  12. 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 205
  13. 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 181
  14. 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
  15. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
  16. 2021Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothingcited by 102
  17. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  18. 2018DeepWrinkles: Accurate and Realistic Clothing Modelingcited by 90
  19. 2021The Power of Points for Modeling Humans in Clothingcited by 90
  20. 2019Learning-Based Animation of Clothing for Virtual Try-Oncited by 89
  21. 2020SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothingcited by 87
  22. 2022SNUG: Self-Supervised Neural Dynamic Garmentscited by 83
  23. 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
  24. 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 78
  25. 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
  26. 2018GarNet: A Two-Stream Network for Fast and Accurate 3D Cloth Drapingcited by 69
  27. 2020PBNS: Physically Based Neural Simulator for Unsupervised Garment Pose Space Deformationcited by 63
  28. 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
  29. 2020DeepCloth: Neural Garment Representation for Shape and Style Editingcited by 54
  30. 2020Fully Convolutional Graph Neural Networks for Parametric Virtual Try-Oncited by 48
  31. 2021Point-Based Modeling of Human Clothingcited by 37
  32. 2018A Pixel-Based Framework for Data-Driven Clothingcited by 28
  33. 2021Dynamic Neural Garmentscited by 27
  34. 2022Motion Guided Deep Dynamic 3D Garmentscited by 19
  35. 20193D Virtual Garment Modeling from RGB Imagescited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

  1. 2025D-Garment: Physically Grounded Latent Diffusion for Dynamic Garment Deformationscited by 2
  2. 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animationcited by 0
  3. 2026DiT-Garment: Garment Dynamics with Diffusion Transformerscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
  2. 2025GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformers
  3. 2025Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates
  4. 2026Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates
  5. 2026GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Model
  6. 2025Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physics
  7. 2026Fashion-3DLR: A Controllable 3D Garment Generation Using Pairwise Fashion Elements for Intelligent Design
  8. 2025GarmageNet: A Multimodal Generative Framework for Sewing Pattern Design and Generic Garment Modeling