mlsanityData to 14 Oct 2026

AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation

arXiv 2306.09864 ↗First posted 16 Jun 2023cs.CVcited by 37

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We introduce AvatarBooth, a novel method for generating high-quality 3D avatars using text prompts or specific images. Unlike previous approaches that can only synthesize avatars based on simple text descriptions, our method enables the creation of personalized avatars from casually captured face or body images, while still supporting text-based model generation and editing. Our key contribution is the precise avatar generation control by using dual fine-tuned diffusion models separately for the human face and body. This enables us to capture intricate details of facial appearance, clothing, and accessories, resulting in highly realistic avatar generations. Furthermore, we introduce pose-consistent constraint to the optimization process to enhance the multi-view consistency of synthesized head images from the diffusion model and thus eliminate interference from uncontrolled human poses. In addition, we present a multi-resolution rendering strategy that facilitates coarse-to-fine supervision of 3D avatar generation, thereby enhancing the performance of the proposed system. The resulting avatar model can be further edited using additional text descriptions and driven by motion sequences. Experiments show that AvatarBooth outperforms previous text-to-3D methods in terms of rendering and geometric quality from either text prompts or specific images. Please check our project website at https://zeng-yifei.github.io/avatarbooth_page/.

Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 55 of its 64 references that are in the map. First posted on arXiv 16 Jun 2023.

Builds on

55 of 64 references.

Closest ancestors · 7

Same direction, newest first

  1. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models3 Apr
  2. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  3. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  4. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion12 Dec
  5. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  7. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 48

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  12. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
36 more
  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  2. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  5. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  6. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  7. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  8. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  9. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  10. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  11. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  12. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  13. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  14. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  15. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  16. 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
  17. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  18. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  19. 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
  20. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  21. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  22. 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
  23. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  24. 2022Generative Neural Articulated Radiance Fieldscited by 101
  25. 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidancecited by 80
  26. 2019Detailed Human Shape Estimation from a Single Image by Hierarchical Mesh Deformationcited by 71
  27. 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
  28. 2023DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Modelcited by 43
  29. 2022CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshescited by 41
  30. 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 36
  31. 2022HumanGen: Generating Human Radiance Fields with Explicit Priorscited by 33
  32. 2023High-Fidelity 3D Face Generation from Natural Language Descriptionscited by 33
  33. 2020Self-Supervised Human Depth Estimation from Monocular Videoscited by 17
  34. 2021Detailed Avatar Recovery from Single Imagecited by 16
  35. 2022Detailed Facial Geometry Recovery from Multi-View Images by Learning an Implicit Functioncited by 14
  36. 2018View Extrapolation of Human Body from a Single Imagecited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 8; 2024: 15; 2025: 11; 2026: 3.

37 papers.

Sort:

By area:

  1. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  2. 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
  3. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  4. 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
  5. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  6. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
  7. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  8. 2024AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animationcited by 25
  9. 2023SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearancecited by 24
  10. 2023HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillationcited by 22
  11. 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albumscited by 16
  12. 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generationcited by 15
25 more
  1. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  2. 2024STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargetingcited by 13
  3. 2024Multimodal Latent Diffusion Model for Complex Sewing Pattern Generationcited by 12
  4. 2025UP2You: Fast Reconstruction of Yourself from Unconstrained Photo Collectionscited by 10
  5. 2024ClotheDreamer: Text-Guided Garment Generation with 3D Gaussianscited by 9
  6. 2024SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothingcited by 9
  7. 2024BodyShapeGPT: SMPL Body Shape Manipulation with LLMscited by 6
  8. 2025WonderHuman: Hallucinating Unseen Parts in Dynamic 3D Human Reconstructioncited by 6
  9. 2024X-Oscar: A Progressive Framework for High-quality Text-guided 3D Animatable Avatar Generationcited by 5
  10. 2024ID-to-3D: Expressive ID-guided 3D Heads via Score Distillation Samplingcited by 5
  11. 2025TeRA: Rethinking Text-guided Realistic 3D Avatar Generationcited by 5
  12. 2024MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Spacecited by 4
  13. 2023Directional Texture Editing for 3D Modelscited by 3
  14. 2023PaintHuman: Towards High-fidelity Text-to-3D Human Texturing via Denoised Score Distillationcited by 3
  15. 2025Creating Your Editable 3D Photorealistic Avatar with Tetrahedron-constrained Gaussian Splattingcited by 3
  16. 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentationcited by 2
  17. 2025Memory-Efficient Personalization of Text-to-Image Diffusion Models via Selective Optimization Strategiescited by 2
  18. 2025HART: Human Aligned Reconstruction Transformercited by 2
  19. 2025Sketch2PoseNet: Efficient and Generalized Sketch to 3D Human Pose Predictioncited by 2
  20. 2025Text-driven 3D Human Generation via Contrastive Preference Optimizationcited by 1
  21. 2025PFAvatar: Pose-Fusion 3D Personalized Avatar Reconstruction from Real-World Outfit-of-the-Day Photoscited by 1
  22. 2025DevilSight: Augmenting Monocular Human Avatar Reconstruction through a Virtual Perspectivecited by 0
  23. 2026HandDreamer: Zero-Shot Text to 3D Hand Model Generation using Corrective Hand Shape Guidancecited by 0
  24. 2026Astrolabe: Spherical-Map Guidance Across Diffusion Pipelines for Full-Body Capture from Unconstrained Imagescited by 0
  25. 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Texturescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Instant 3D Human Avatar Generation using Image Diffusion Models
  2. 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Pose
  3. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation
  4. 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models
  5. 2023AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text
  6. 2025GAS: Generative Avatar Synthesis from a Single Image
  7. 2025AdaHuman: Animatable Detailed 3D Human Generation with Compositional Multiview Diffusion
  8. 2025Hyper Diffusion Avatars: Dynamic Human Avatar Generation using Network Weight Space Diffusion