mlsanityData to 14 Oct 2026

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video

arXiv 2409.08189 ↗First posted 12 Sep 2024cs.CV cs.GRcited by 25

Not on the map. Why?

Abstract (arXiv)

We introduce Gaussian Garments, a novel approach for reconstructing realistic simulation-ready garment assets from multi-view videos. Our method represents garments with a combination of a 3D mesh and a Gaussian texture that encodes both the color and high-frequency surface details. This representation enables accurate registration of garment geometries to multi-view videos and helps disentangle albedo textures from lighting effects. Furthermore, we demonstrate how a pre-trained graph neural network (GNN) can be fine-tuned to replicate the real behavior of each garment. The reconstructed Gaussian Garments can be automatically combined into multi-garment outfits and animated with the fine-tuned GNN.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 12 Sep 2024.

Builds on

35 of 49 references.

References · 35

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  7. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  8. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  9. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  10. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  11. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
  12. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
23 more
  1. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
  2. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 172
  3. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
  4. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  5. 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
  6. 2023Drivable 3D Gaussian Avatarscited by 120
  7. 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 103
  8. 2020SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size Sensitive 3D Clothingcited by 87
  9. 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
  10. 2021Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-Oncited by 81
  11. 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatarcited by 66
  12. 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 54
  13. 2024PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observationscited by 51
  14. 2023DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulationcited by 41
  15. 2022Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Imagescited by 39
  16. 2023Towards Garment Sewing Pattern Reconstruction from a Single Imagecited by 34
  17. 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videoscited by 29
  18. 2024ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulationscited by 23
  19. 2024LayGA: Layered Gaussian Avatars for Animatable Clothing Transfercited by 22
  20. 2023CaPhy: Capturing Physical Properties for Animatable Human Avatarscited by 20
  21. 2022Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothingcited by 19
  22. 2022NeuralTailor: Reconstructing Sewing Pattern Structures from 3D Point Clouds of Garmentscited by 10
  23. 2023Leveraging Intrinsic Properties for Non-Rigid Garment Alignmentcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 10; 2026: 13.

25 papers.

Sort:

  1. 2025Generative Physical AI in Vision: A Surveycited by 24
  2. 2024Design2GarmentCode: Turning Design Concepts to Tangible Garments Through Program Synthesiscited by 18
  3. 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splattingcited by 13
  4. 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformancecited by 8
  5. 2025MPMAvatar: Learning 3D Gaussian Avatars with Accurate and Robust Physics-Based Dynamicscited by 8
  6. 2025GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editingcited by 6
  7. 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatarcited by 3
  8. 2025MonoCloth: Reconstruction and Animation of Cloth-Decoupled Human Avatars from Monocular Videoscited by 3
  9. 2026Image2Garment: Simulation-ready Garment Generation from a Single Imagecited by 3
  10. 2026Zero-Shot Reconstruction of Animatable 3D Avatars with Cloth Dynamics from a Single Imagecited by 3
  11. 2025SRM-Hair: Single Image Head Mesh Reconstruction via 3D Morphable Haircited by 2
  12. 2025NGD: Neural Gradient Based Deformation for Monocular Garment Reconstructioncited by 2
13 more
  1. 2025Relightable Holoported Characters: Capturing and Relighting Dynamic Human Performance from Sparse Viewscited by 2
  2. 2026Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-Oncited by 2
  3. 2026DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatarscited by 2
  4. 2026FreeForm: Reduced-Order Deformable Simulation from Particle-Based Skinning Eigenmodescited by 2
  5. 2026ReWeaver: Towards Simulation-Ready and Topology-Accurate Garment Reconstructioncited by 1
  6. 2026InverseDraping: Recovering Sewing Patterns from 3D Garment Surfaces via BoxMesh Bridgingcited by 1
  7. 2026When 3D Gaussian Splatting Recovers Real Surfacescited by 1
  8. 2025SAFT: Shape and Appearance of Fabrics from Template via Differentiable Physical Simulations from Monocular Videocited by 0
  9. 2026CloDS: Visual-Only Unsupervised Cloth Dynamics Learning in Unknown Conditionscited by 0
  10. 2026MV-Fashion: Towards Enabling Virtual Try-On and Size Estimation with Multi-View Paired Datacited by 0
  11. 2026Real-Time Physics Simulation with Dynamic Mesh-Gaussian Reconstructionscited by 0
  12. 2026Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patternscited by 0
  13. 2026Astrolabe: Spherical-Map Guidance Across Diffusion Pipelines for Full-Body Capture from Unconstrained Imagescited by 0