mlsanityData to 14 Oct 2026

DreamHuman: Animatable 3D Avatars from Text

arXiv 2306.09329 ↗First posted 15 Jun 2023cs.CVcited by 102

Not on the map. Why?

Cited by 34 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present DreamHuman, a method to generate realistic animatable 3D human avatar models solely from textual descriptions. Recent text-to-3D methods have made considerable strides in generation, but are still lacking in important aspects. Control and often spatial resolution remain limited, existing methods produce fixed rather than animated 3D human models, and anthropometric consistency for complex structures like people remains a challenge. DreamHuman connects large text-to-image synthesis models, neural radiance fields, and statistical human body models in a novel modeling and optimization framework. This makes it possible to generate dynamic 3D human avatars with high-quality textures and learned, instance-specific, surface deformations. We demonstrate that our method is capable to generate a wide variety of animatable, realistic 3D human models from text. Our 3D models have diverse appearance, clothing, skin tones and body shapes, and significantly outperform both generic text-to-3D approaches and previous text-based 3D avatar generators in visual fidelity. For more results and animations please check our website at https://dream-human.github.io.

Key facts. Cited by 102 papers in the map (data through 14 Oct 2026). Builds on 55 of its 69 references that are in the map. First posted on arXiv 15 Jun 2023.

Builds on

55 of 69 references.

References · 55

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
38 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  5. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  6. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  7. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  8. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  9. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  10. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  11. 2022Human Motion Diffusion Modelcited by 1,080
  12. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
  13. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  14. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  15. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  16. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  17. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  18. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  19. 2023MusicLM: Generating Music From Textcited by 448
  20. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  21. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
  22. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  23. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  24. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  25. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  26. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  27. 2017Parallel WaveNet: Fast High-Fidelity Speech Synthesiscited by 215
  28. 2023Text-To-4D Dynamic Scene Generationcited by 205
  29. 2021Neural Articulated Radiance Fieldcited by 196
  30. 2022TEACH: Temporal Action Composition for 3D Humanscited by 176
  31. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
  32. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  33. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  34. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
  35. 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
  36. 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 103
  37. 2020Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flowscited by 94
  38. 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 24; 2024: 45; 2025: 28; 2026: 5.

102 papers.

Sort:

By area:

  1. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  2. 2023TADA! Text to Animatable Digital Avatarscited by 110
  3. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  4. 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
  5. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  6. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 76
  7. 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
  8. 2024Advances in 3D Generation: A Surveycited by 63
  9. 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
  10. 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
  11. 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
  12. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
38 more
  1. 2024Generative Gaussian Splatting for Unbounded 3D City Generationcited by 44
  2. 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
  3. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  4. 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
  5. 2023SMPLitex: A Generative Model and Dataset for 3D Human Texture Estimation from Single Imagecited by 30
  6. 2023HAAR: Text-Conditioned Generative Model of 3D Strand-based Human Hairstylescited by 30
  7. 2024A Comprehensive Survey on 3D Content Generationcited by 28
  8. 2024CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalizationcited by 28
  9. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  10. 2024Score Distillation Sampling with Learned Manifold Correctivecited by 27
  11. 2024CityCraft: A Real Crafter for 3D City Generationcited by 26
  12. 2024AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animationcited by 25
  13. 2023SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearancecited by 24
  14. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
  15. 2023HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillationcited by 22
  16. 2024GALA: Generating Animatable Layered Assets from a Single Scancited by 21
  17. 2024TELA: Text to Layer-wise 3D Clothed Human Generationcited by 20
  18. 2023DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priorscited by 19
  19. 2023DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editingcited by 17
  20. 2023Enhancing High-Resolution 3D Generation through Pixel-wise Gradient Clippingcited by 17
  21. 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Textcited by 16
  22. 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albumscited by 16
  23. 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generationcited by 15
  24. 2024Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Priorcited by 15
  25. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 15
  26. 2024En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Datacited by 14
  27. 2024Instant 3D Human Avatar Generation using Image Diffusion Modelscited by 14
  28. 2023HAVE-FUN: Human Avatar Reconstruction from Few-Shot Unconstrained Imagescited by 13
  29. 2024STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargetingcited by 13
  30. 2024DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusioncited by 12
  31. 2025Human-Centric Foundation Models: Perception, Generation and Agentic Modelingcited by 12
  32. 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assetscited by 12
  33. 2024HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformationcited by 11
  34. 2024Diffusion Models in 3D Vision: A Surveycited by 11
  35. 2024ClotheDreamer: Text-Guided Garment Generation with 3D Gaussianscited by 9
  36. 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothingcited by 9
  37. 2025HumanRAM: Feed-forward Human Reconstruction and Animation Model using Transformerscited by 9
  38. 2025VolumetricSMPL: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and Collisionscited by 9

50 most cited of 102 All 102 (JSON)