DreamBarbie: Text to Barbie-Style 3D Avatars
Not on the map. Why?
Abstract (arXiv)
To integrate digital humans into everyday life, there is a strong demand for generating high-quality, fine-grained disentangled 3D avatars that support expressive animation and simulation capabilities, ideally from low-cost textual inputs. Although text-driven 3D avatar generation has made significant progress by leveraging 2D generative priors, existing methods still struggle to fulfill all these requirements simultaneously. To address this challenge, we propose DreamBarbie, a novel text-driven framework for generating animatable 3D avatars with separable shoes, accessories, and simulation-ready garments, truly capturing the iconic ``Barbie doll'' aesthetic. The core of our framework lies in an expressive 3D representation combined with appropriate modeling constraints. Unlike prior methods, we use G-Shell to uniformly model watertight components (e.g., bodies, shoes) and non-watertight garments. By reformulating boundaries as Euclidean field intersections instead of manifold geodesics, we propose an SDF-based initialization and a hole regularization loss that together achieve a 100x speedup and stable open topology without image input. These disentangled 3D representations are then optimized by specialized expert diffusion models tailored to each domain, ensuring high-fidelity outputs. To mitigate geometric artifacts and texture conflicts when combining different expert models, we further propose several effective geometric losses and strategies. Extensive experiments demonstrate that DreamBarbie outperforms existing methods in both dressed human and outfit generation. Our framework further enables diverse applications, including apparel combination, editing, expressive animation, and physical simulation. Project page: https://xiaokunsun.github.io/DreamBarbie.github.io/.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 63 of its 85 references that are in the map. First posted on arXiv 17 Aug 2024.
Builds on
63 of 85 references.
References · 63
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
38 more
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
- 2020BCNet: Learning Body and Cloth Shape from A Single Imagecited by 118
- 2023TADA! Text to Animatable Digital Avatarscited by 109
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
- 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
- 2023LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluationcited by 85
- 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
- 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
- 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
- 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
- 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
- 2022LAVIS: A Library for Language-Vision Intelligencecited by 55
- 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Promptscited by 51
- 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
- 2023Text-Guided Generation and Editing of Compositional 3D Avatarscited by 39
- 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
- 2023Ghost on the Shell: An Expressive Representation of General 3D Shapescited by 24
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2025Disentangled Clothed Avatar Generation with Layered Representationcited by 7
- 2024StrandHead: Text to Hair-Disentangled 3D Head Avatars Using Human-Centric Priorscited by 3
- 2025Creating Your Editable 3D Photorealistic Avatar with Tetrahedron-constrained Gaussian Splattingcited by 3
- 2025A Text-to-3D Framework for Joint Generation of CG-Ready Humans and Compatible Garmentscited by 2
- 2025Creating Your Editable 3D Photorealistic Avatar with Tetrahedron-constrained Gaussian Splatting29 Apr 2025
- 2025A Text-to-3D Framework for Joint Generation of CG-Ready Humans and Compatible Garments15 Mar 2025
- 2025Disentangled Clothed Avatar Generation with Layered Representation8 Jan 2025
- 2024StrandHead: Text to Hair-Disentangled 3D Head Avatars Using Human-Centric Priors16 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models
- 2024DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion
- 2024DivAvatar: Diverse 3D Avatar Generation with a Single Prompt
- 2025Text-based Animatable 3D Avatars with Morphable Model Alignment
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion
- 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance
- 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models