mlsanityData to 7 Oct 2026

DivAvatar: Diverse 3D Avatar Generation with a Single Prompt

arXiv 2402.17292 ↗First posted 27 Feb 2024cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Text-to-Avatar generation has recently made significant strides due to advancements in diffusion models. However, most existing work remains constrained by limited diversity, producing avatars with subtle differences in appearance for a given text prompt. We design DivAvatar, a novel framework that generates diverse avatars, empowering 3D creatives with a multitude of distinct and richly varied 3D avatars from a single text prompt. Different from most existing work that exploits scene-specific 3D representations such as NeRF, DivAvatar finetunes a 3D generative model (i.e., EVA3D), allowing diverse avatar generation from simply noise sampling in inference time. DivAvatar has two key designs that help achieve generation diversity and visual quality. The first is a noise sampling technique during training phase which is critical in generating diverse appearances. The second is a semantic-aware zoom mechanism and a novel depth loss, the former producing appearances of high textual fidelity by separate fine-tuning of specific body parts and the latter improving geometry quality greatly by smoothing the generated mesh in the features space. Extensive experiments show that DivAvatar is highly versatile in generating avatars of diverse appearances.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 31 of its 39 references that are in the map. First posted on arXiv 27 Feb 2024.

Builds on

31 of 39 references.

Closest ancestors · 7

Same direction, newest first

  1. 2023DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priors28 Dec
  2. 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text29 Nov
  3. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  5. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models3 Apr
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  7. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  12. 2021Vision Transformers for Dense Predictioncited by 1,789
12 more
  1. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  2. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  3. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  4. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  5. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  6. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  7. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  8. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  9. 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84
  10. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  11. 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
  12. 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space
  2. 2026Dual Diffusion Models for Multi-modal Guided 3D Avatar Generation
  3. 2024Instant 3D Human Avatar Generation using Image Diffusion Models
  4. 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing
  5. 2023Guide3D: Create 3D Avatars from Text and Image Guidance
  6. 2023StyleAvatar3D: Leveraging Image-Text Diffusion Models for High-Fidelity 3D Avatar Generation
  7. 2025Text-based Animatable 3D Avatars with Morphable Model Alignment
  8. 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation