Towards Multi-Layered 3D Garments Animation
Not on the map. Why?
Abstract (arXiv)
Mimicking realistic dynamics in 3D garment animations is a challenging task due to the complex nature of multi-layered garments and the variety of outer forces involved. Existing approaches mostly focus on single-layered garments driven by only human bodies and struggle to handle general scenarios. In this paper, we propose a novel data-driven method, called LayersNet, to model garment-level animations as particle-wise interactions in a micro physics system. We improve simulation efficiency by representing garments as patch-level particles in a two-level structural hierarchy. Moreover, we introduce a novel Rotation Equivalent Transformation that leverages the rotation invariance and additivity of physics systems to better model outer forces. To verify the effectiveness of our approach and bridge the gap between experimental environments and real-world scenarios, we introduce a new challenging dataset, D-LAYERS, containing 700K frames of dynamics of 4,900 different combinations of multi-layered garments driven by both human bodies and randomly sampled wind. Our experiments show that LayersNet achieves superior performance both quantitatively and qualitatively. We will make the dataset and code publicly available at https://mmlab-ntu.github.io/project/layersnet/index.html .
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 17 May 2023.
Builds on
36 of 46 references.
References · 36
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2021GemNet: Universal Directional Graph Neural Networks for Moleculescited by 342
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
- 2019Cormorant: Covariant Molecular Neural Networkscited by 262
- 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 225
- 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
24 more
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2021Spherical Message Passing for 3D Graph Networkscited by 166
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
- 2020TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Stylecited by 148
- 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2019CLOTH3D: Clothed 3D Humanscited by 114
- 2017Detailed, accurate, human shape estimation from clothed 3D scan sequencescited by 89
- 2020SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothingcited by 87
- 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
- 2022HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamicscited by 77
- 2020Scalable Differentiable Physics for Learning and Controlcited by 72
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 20193DPeople: Modeling the Geometry of Dressed Humanscited by 58
- 2020Fully Convolutional Graph Neural Networks for Parametric Virtual Try-Oncited by 48
- 2020DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animationcited by 43
- 2022Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networkscited by 39
- 2021Generating Datasets of 3D Garments with Sewing Patternscited by 34
- 2021Directional Message Passing on Molecular Graphs via Synthetic Coordinatescited by 24
- 2022Motion Guided Deep Dynamic 3D Garmentscited by 19
- 2022Transformer with Implicit Edges for Particle-based Physics Simulationcited by 15
- 2021N-Cloth: Predicting 3D Cloth Deformation with Mesh-Based Networkscited by 14
- 2021Graph-based Task-specific Prediction Models for Interactions between Deformable and Rigid Objectscited by 10
- 2022Layered-Garment Net: Generating Multiple Implicit Garment Layers from a Single Imagecited by 9
Built on by
Citing papers per year: 2024: 8; 2025: 2; 2026: 6.
16 papers.
Sort:
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 51
- 2024ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulationscited by 23
- 2024Towards High-Quality 3D Motion Transfer with Realistic Apparel Animationcited by 5
- 2024EvoMesh: Adaptive Physical Simulation with Hierarchical Graph Evolutionscited by 4
- 2024GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objectscited by 4
- 2026Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessoriescited by 4
- 2024A Neural-Network-Based Approach for Loose-Fitting Clothingcited by 2
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modelingcited by 2
- 2024Neural Garment Dynamic Super-Resolutioncited by 1
- 2025Learning 3D Garment Animation from Trajectories of A Piece of Clothcited by 1
- 2026ClothTransformer: Unified Latent-Space Transformers for Scalable Cloth Simulationcited by 1
- 2025SAFT: Shape and Appearance of Fabrics from Template via Differentiable Physical Simulations from Monocular Videocited by 0
4 more
- 2026Patch-based Representation and Learning for Efficient Deformation Modelingcited by 0
- 2026CloDS: Visual-Only Unsupervised Cloth Dynamics Learning in Unknown Conditionscited by 0
- 2026MV-Fashion: Towards Enabling Virtual Try-On and Size Estimation with Multi-View Paired Datacited by 0
- 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animationcited by 0
- 2026ClothTransformer: Unified Latent-Space Transformers for Scalable Cloth Simulation27 May 2026
- 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation26 Mar 2026
- 2026Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessories14 Mar 2026
- 2026MV-Fashion: Towards Enabling Virtual Try-On and Size Estimation with Multi-View Paired Data9 Mar 2026
- 2026CloDS: Visual-Only Unsupervised Cloth Dynamics Learning in Unknown Conditions2 Feb 2026
- 2026Patch-based Representation and Learning for Efficient Deformation Modeling8 Jan 2026
- 2025SAFT: Shape and Appearance of Fabrics from Template via Differentiable Physical Simulations from Monocular Video10 Sep 2025
- 2025Learning 3D Garment Animation from Trajectories of A Piece of Cloth2 Jan 2025
- 2024GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objects23 Dec 2024
- 2024Neural Garment Dynamic Super-Resolution9 Dec 2024
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling29 Nov 2024
- 2024EvoMesh: Adaptive Physical Simulation with Hierarchical Graph Evolutions3 Oct 2024
4 more
- 2024Towards High-Quality 3D Motion Transfer with Realistic Apparel Animation15 Jul 2024
- 2024ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulations15 May 2024
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotations29 Apr 2024
- 2024A Neural-Network-Based Approach for Loose-Fitting Clothing25 Apr 2024
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 51
- 2024ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulationscited by 23
- 2024Towards High-Quality 3D Motion Transfer with Realistic Apparel Animationcited by 5
- 2024EvoMesh: Adaptive Physical Simulation with Hierarchical Graph Evolutionscited by 4
- 2024GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objectscited by 4
- 2026Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessoriescited by 4
- 2024A Neural-Network-Based Approach for Loose-Fitting Clothingcited by 2
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modelingcited by 2
- 2024Neural Garment Dynamic Super-Resolutioncited by 1
- 2025Learning 3D Garment Animation from Trajectories of A Piece of Clothcited by 1
- 2026ClothTransformer: Unified Latent-Space Transformers for Scalable Cloth Simulationcited by 1
- 2025SAFT: Shape and Appearance of Fabrics from Template via Differentiable Physical Simulations from Monocular Videocited by 0
12 most cited of 16 All 16 (JSON)
- 2026ClothTransformer: Unified Latent-Space Transformers for Scalable Cloth Simulation27 May 2026
- 2026UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation26 Mar 2026
- 2026Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessories14 Mar 2026
- 2026MV-Fashion: Towards Enabling Virtual Try-On and Size Estimation with Multi-View Paired Data9 Mar 2026
- 2026CloDS: Visual-Only Unsupervised Cloth Dynamics Learning in Unknown Conditions2 Feb 2026
- 2026Patch-based Representation and Learning for Efficient Deformation Modeling8 Jan 2026
- 2025SAFT: Shape and Appearance of Fabrics from Template via Differentiable Physical Simulations from Monocular Video10 Sep 2025
- 2025Learning 3D Garment Animation from Trajectories of A Piece of Cloth2 Jan 2025
- 2024GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objects23 Dec 2024
- 2024Neural Garment Dynamic Super-Resolution9 Dec 2024
- 2024FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling29 Nov 2024
- 2024EvoMesh: Adaptive Physical Simulation with Hierarchical Graph Evolutions3 Oct 2024
12 newest of 16 All 16 (JSON)