mlsanityData to 7 Oct 2026

Towards Multi-Layered 3D Garments Animation

arXiv 2305.10418 ↗First posted 17 May 2023cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

Mimicking realistic dynamics in 3D garment animations is a challenging task due to the complex nature of multi-layered garments and the variety of outer forces involved. Existing approaches mostly focus on single-layered garments driven by only human bodies and struggle to handle general scenarios. In this paper, we propose a novel data-driven method, called LayersNet, to model garment-level animations as particle-wise interactions in a micro physics system. We improve simulation efficiency by representing garments as patch-level particles in a two-level structural hierarchy. Moreover, we introduce a novel Rotation Equivalent Transformation that leverages the rotation invariance and additivity of physics systems to better model outer forces. To verify the effectiveness of our approach and bridge the gap between experimental environments and real-world scenarios, we introduce a new challenging dataset, D-LAYERS, containing 700K frames of dynamics of 4,900 different combinations of multi-layered garments driven by both human bodies and randomly sampled wind. Our experiments show that LayersNet achieves superior performance both quantitatively and qualitatively. We will make the dataset and code publicly available at https://mmlab-ntu.github.io/project/layersnet/index.html .

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 17 May 2023.

Builds on

36 of 46 references.

References · 36

  1. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  2. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  3. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  4. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  5. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  6. 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
  7. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
  8. 2019Cormorant: Covariant Molecular Neural Networkscited by 262
  9. 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
  10. 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
  11. 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
  12. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
24 more
  1. 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
  2. 2021Spherical Message Passing for 3D Graph Networkscited by 166
  3. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
  4. 2020TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Stylecited by 148
  5. 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
  6. 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
  7. 2019CLOTH3D: Clothed 3D Humanscited by 114
  8. 2017Detailed, accurate, human shape estimation from clothed 3D scan sequencescited by 89
  9. 2020SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothingcited by 87
  10. 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
  11. 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 77
  12. 2020Scalable Differentiable Physics for Learning and Controlcited by 72
  13. 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
  14. 20193DPeople: Modeling the Geometry of Dressed Humanscited by 58
  15. 2020Fully Convolutional Graph Neural Networks for Parametric Virtual Try-Oncited by 48
  16. 2020DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animationcited by 43
  17. 2022Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networkscited by 39
  18. 2021Generating Datasets of 3D Garments with Sewing Patternscited by 34
  19. 2021Directional Message Passing on Molecular Graphs via Synthetic Coordinatescited by 24
  20. 2022Motion Guided Deep Dynamic 3D Garmentscited by 19
  21. 2022Transformer with Implicit Edges for Particle-based Physics Simulationcited by 15
  22. 2021N-Cloth: Predicting 3D Cloth Deformation with Mesh-Based Networkscited by 14
  23. 2021Graph-based Task-specific Prediction Models for Interactions between Deformable and Rigid Objectscited by 10
  24. 2022Layered-Garment Net: Generating Multiple Implicit Garment Layers from a Single Imagecited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 2; 2026: 6.

16 papers.

Sort: