mlsanityData to 14 Oct 2026

LAGA: Layered 3D Avatar Generation and Customization via Gaussian Splatting

arXiv 2405.12663 ↗First posted 21 May 2024cs.GR cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Creating and customizing a 3D clothed avatar from textual descriptions is a critical and challenging task. Traditional methods often treat the human body and clothing as inseparable, limiting users' ability to freely mix and match garments. In response to this limitation, we present LAyered Gaussian Avatar (LAGA), a carefully designed framework enabling the creation of high-fidelity decomposable avatars with diverse garments. By decoupling garments from avatar, our framework empowers users to conviniently edit avatars at the garment level. Our approach begins by modeling the avatar using a set of Gaussian points organized in a layered structure, where each layer corresponds to a specific garment or the human body itself. To generate high-quality garments for each layer, we introduce a coarse-to-fine strategy for diverse garment generation and a novel dual-SDS loss function to maintain coherence between the generated garments and avatar components, including the human body and other garments. Moreover, we introduce three regularization losses to guide the movement of Gaussians for garment transfer, allowing garments to be freely transferred to various avatars. Extensive experimentation demonstrates that our approach surpasses existing methods in the generation of 3D clothed humans.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 38 of its 51 references that are in the map. First posted on arXiv 21 May 2024.

Builds on

38 of 51 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2023Segment Anythingcited by 8,234
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  9. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  11. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  12. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
26 more
  1. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  2. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  3. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  4. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  5. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  6. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  7. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 155
  8. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
  9. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 144
  10. 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 120
  11. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
  12. 2023TADA! Text to Animatable Digital Avatarscited by 110
  13. 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 103
  14. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  15. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  16. 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84
  17. 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
  18. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  19. 2021Modeling Clothing as a Separate Layer for an Animatable Human Avatarcited by 66
  20. 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
  21. 2024DressCode: Autoregressively Sewing and Generating Garments from Text Guidancecited by 44
  22. 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
  23. 20243D-SceneDreamer: Text-Driven 3D-Consistent Scene Generationcited by 29
  24. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  25. 2023HumanLiff: Layer-wise 3D Human Generation with Diffusion Modelcited by 23
  26. 2023Layered 3D Human Generation via Semantic-Aware Diffusion Modelcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 2.

7 papers.