DivAvatar: Diverse 3D Avatar Generation with a Single Prompt
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Text-to-Avatar generation has recently made significant strides due to advancements in diffusion models. However, most existing work remains constrained by limited diversity, producing avatars with subtle differences in appearance for a given text prompt. We design DivAvatar, a novel framework that generates diverse avatars, empowering 3D creatives with a multitude of distinct and richly varied 3D avatars from a single text prompt. Different from most existing work that exploits scene-specific 3D representations such as NeRF, DivAvatar finetunes a 3D generative model (i.e., EVA3D), allowing diverse avatar generation from simply noise sampling in inference time. DivAvatar has two key designs that help achieve generation diversity and visual quality. The first is a noise sampling technique during training phase which is critical in generating diverse appearances. The second is a semantic-aware zoom mechanism and a novel depth loss, the former producing appearances of high textual fidelity by separate fine-tuning of specific body parts and the latter improving geometry quality greatly by smoothing the generated mesh in the features space. Extensive experiments show that DivAvatar is highly versatile in generating avatars of diverse appearances.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 31 of its 39 references that are in the map. First posted on arXiv 27 Feb 2024.
Builds on
31 of 39 references.
Closest ancestors · 7
Same direction, newest first
- 2023DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priors28 Dec
- 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text29 Nov
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models3 Apr
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2021Vision Transformers for Dense Predictioncited by 1,789
12 more
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84
- 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
- 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space
- 2026Dual Diffusion Models for Multi-modal Guided 3D Avatar Generation
- 2024Instant 3D Human Avatar Generation using Image Diffusion Models
- 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing
- 2023Guide3D: Create 3D Avatars from Text and Image Guidance
- 2023StyleAvatar3D: Leveraging Image-Text Diffusion Models for High-Fidelity 3D Avatar Generation
- 2025Text-based Animatable 3D Avatars with Morphable Model Alignment
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation