mlsanityData to 7 Oct 2026

AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control

arXiv 2303.17606 ↗First posted 30 Mar 2023cs.CVcited by 84

Not on the map. Why?

Cited by 39 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Neural implicit fields are powerful for representing 3D scenes and generating high-quality novel views, but it remains challenging to use such implicit representations for creating a 3D human avatar with a specific identity and artistic style that can be easily animated. Our proposed method, AvatarCraft, addresses this challenge by using diffusion models to guide the learning of geometry and texture for a neural avatar based on a single text prompt. We carefully design the optimization framework of neural implicit fields, including a coarse-to-fine multi-bounding box training strategy, shape regularization, and diffusion-based constraints, to produce high-quality geometry and texture. Additionally, we make the human avatar animatable by deforming the neural implicit field with an explicit warping field that maps the target human mesh to a template human mesh, both represented using parametric human models. This simplifies animation and reshaping of the generated avatar by controlling pose and shape parameters. Extensive experiments on various text descriptions show that AvatarCraft is effective and robust in creating human avatars and rendering novel views, poses, and shapes. Our project page is: https://avatar-craft.github.io/.

Key facts. Cited by 84 papers in the map (data through 7 Oct 2026). Builds on 48 of its 63 references that are in the map. First posted on arXiv 30 Mar 2023.

Builds on

48 of 63 references.

References · 48

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  8. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  10. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
36 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  2. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  3. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  5. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  7. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  8. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  9. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  10. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  11. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
  12. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  13. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  14. 2017Neural 3D Mesh Renderercited by 437
  15. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  16. 2019Multi-Garment Net: Learning to Dress 3D People from Imagescited by 244
  17. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  18. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  19. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
  20. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  21. 2017Learning Efficient Point Cloud Generation for Dense 3D Object Reconstructioncited by 133
  22. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  23. 2021Animatable Neural Radiance Fields from Monocular RGB Videoscited by 109
  24. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  25. 2022Human Performance Modeling and Rendering via Neural Animated Meshcited by 64
  26. 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
  27. 2022Understanding Pure CLIP Guidance for Voxel Grid NeRF Modelscited by 56
  28. 2022DiffStyler: Controllable Dual Diffusion for Text-Driven Image Stylizationcited by 45
  29. 2020Interactive Video Stylization Using Few-Shot Patch-Based Trainingcited by 43
  30. 2022CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshescited by 41
  31. 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatarscited by 38
  32. 2021Exemplar-Based 3D Portrait Stylizationcited by 21
  33. 2023Unsupervised Volumetric Animationcited by 18
  34. 2021Cross-Domain and Disentangled Face Manipulation with 3D Guidancecited by 17
  35. 2021Flow Guided Transformable Bottleneck Networks for Motion Retargetingcited by 12
  36. 2022AgileAvatar: Stylized 3D Avatar Creation via Cascaded Domain Bridgingcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 26; 2024: 34; 2025: 19; 2026: 5.

84 papers.

Sort:

By area:

  1. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
  2. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  3. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  4. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  5. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  6. 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
  7. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  8. 2023Improving Tuning-Free Real Image Editing with Proximal Guidancecited by 87
  9. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  10. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  11. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generationcited by 81
  12. 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
38 more
  1. 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
  2. 2024Advances in 3D Generation: A Surveycited by 62
  3. 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
  4. 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
  5. 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
  6. 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 41
  7. 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splattingcited by 33
  8. 2024Mesh-based Gaussian Splatting for Real-time Large-scale Deformationcited by 28
  9. 2024CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalizationcited by 28
  10. 2023Stable Score Distillation for High-Quality 3D Generationcited by 27
  11. 2025DreamDPO: Aligning Text-to-3D Generation with Human Preferences via Direct Preference Optimizationcited by 27
  12. 2024AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animationcited by 25
  13. 2023SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearancecited by 24
  14. 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
  15. 2023DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priorscited by 19
  16. 2024InterFusion: Text-Driven Generation of 3D Human-Object Interactioncited by 18
  17. 2024Urban Architect: Steerable 3D Urban Scene Generation with Layout Priorcited by 17
  18. 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Textcited by 16
  19. 2024Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Priorcited by 15
  20. 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generationcited by 14
  21. 2024Instant 3D Human Avatar Generation using Image Diffusion Modelscited by 14
  22. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  23. 2024STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargetingcited by 13
  24. 2024DeCo: Decoupled Human-Centered Diffusion Video Editing with Motion Consistencycited by 13
  25. 2024DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusioncited by 12
  26. 2024HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformationcited by 11
  27. 2024Diffusion Models in 3D Vision: A Surveycited by 11
  28. 2024ClotheDreamer: Text-Guided Garment Generation with 3D Gaussianscited by 9
  29. 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothingcited by 9
  30. 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusioncited by 9
  31. 2023Text-Guided 3D Face Synthesis -- From Generation to Editingcited by 8
  32. 2024DreamVTON: Customizing 3D Virtual Try-on with Personalized Diffusion Modelscited by 8
  33. 2025AdaHuman: Animatable Detailed 3D Human Generation with Compositional Multiview Diffusioncited by 8
  34. 2023X-Dreamer: Creating High-quality 3D Content by Bridging the Domain Gap Between Text-to-2D and Text-to-3D Generationcited by 7
  35. 2024UVMap-ID: A Controllable and Personalized UV Map Generative Modelcited by 7
  36. 2024LAGA: Layered 3D Avatar Generation and Customization via Gaussian Splattingcited by 7
  37. 2024HumanCoser: Layered 3D Human Generation via Semantic-Aware Diffusion Modelcited by 7
  38. 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Modelscited by 6

50 most cited of 84 All 84 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024HR Human: Modeling Human Avatars with Triangular Mesh and High-Resolution Textures from Videos
  2. 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars
  3. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models
  4. 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation
  5. 2025Hyper Diffusion Avatars: Dynamic Human Avatar Generation using Network Weight Space Diffusion
  6. 2025Text-based Animatable 3D Avatars with Morphable Model Alignment
  7. 2023Reality's Canvas, Language's Brush: Crafting 3D Avatars from Monocular Video
  8. 2023AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion