mlsanityData to 7 Oct 2026

DreamBarbie: Text to Barbie-Style 3D Avatars

arXiv 2408.09126 ↗First posted 17 Aug 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

To integrate digital humans into everyday life, there is a strong demand for generating high-quality, fine-grained disentangled 3D avatars that support expressive animation and simulation capabilities, ideally from low-cost textual inputs. Although text-driven 3D avatar generation has made significant progress by leveraging 2D generative priors, existing methods still struggle to fulfill all these requirements simultaneously. To address this challenge, we propose DreamBarbie, a novel text-driven framework for generating animatable 3D avatars with separable shoes, accessories, and simulation-ready garments, truly capturing the iconic ``Barbie doll'' aesthetic. The core of our framework lies in an expressive 3D representation combined with appropriate modeling constraints. Unlike prior methods, we use G-Shell to uniformly model watertight components (e.g., bodies, shoes) and non-watertight garments. By reformulating boundaries as Euclidean field intersections instead of manifold geodesics, we propose an SDF-based initialization and a hole regularization loss that together achieve a 100x speedup and stable open topology without image input. These disentangled 3D representations are then optimized by specialized expert diffusion models tailored to each domain, ensuring high-fidelity outputs. To mitigate geometric artifacts and texture conflicts when combining different expert models, we further propose several effective geometric losses and strategies. Extensive experiments demonstrate that DreamBarbie outperforms existing methods in both dressed human and outfit generation. Our framework further enables diverse applications, including apparel combination, editing, expressive animation, and physical simulation. Project page: https://xiaokunsun.github.io/DreamBarbie.github.io/.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 63 of its 85 references that are in the map. First posted on arXiv 17 Aug 2024.

Builds on

63 of 85 references.

References · 63

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
38 more
  1. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  2. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  5. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  6. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  7. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  8. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  9. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  10. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  11. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  12. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  13. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
  14. 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
  15. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  16. 2022Generating Holistic 3D Human Motion from Speechcited by 180
  17. 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
  18. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  19. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
  20. 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 118
  21. 2023TADA! Text to Animatable Digital Avatarscited by 109
  22. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  23. 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
  24. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  25. 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
  26. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  27. 2023LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluationcited by 85
  28. 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
  29. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  30. 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
  31. 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
  32. 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
  33. 2022LAVIS: A Library for Language-Vision Intelligencecited by 55
  34. 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Promptscited by 51
  35. 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
  36. 2023Text-Guided Generation and Editing of Compositional 3D Avatarscited by 39
  37. 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
  38. 2023Ghost on the Shell: An Expressive Representation of General 3D Shapescited by 24

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing
  2. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models
  3. 2024DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion
  4. 2024DivAvatar: Diverse 3D Avatar Generation with a Single Prompt
  5. 2025Text-based Animatable 3D Avatars with Morphable Model Alignment
  6. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion
  7. 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance
  8. 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models