mlsanityData to 14 Oct 2026

ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Image

arXiv 2305.16411 ↗First posted 25 May 2023cs.CVcited by 18

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent advancements in text-to-image generation have enabled significant progress in zero-shot 3D shape generation. This is achieved by score distillation, a methodology that uses pre-trained text-to-image diffusion models to optimize the parameters of a 3D neural presentation, e.g. Neural Radiance Field (NeRF). While showing promising results, existing methods are often not able to preserve the geometry of complex shapes, such as human bodies. To address this challenge, we present ZeroAvatar, a method that introduces the explicit 3D human body prior to the optimization process. Specifically, we first estimate and refine the parameters of a parametric human body from a single image. Then during optimization, we use the posed parametric body as additional geometry constraint to regularize the diffusion model as well as the underlying density field. Lastly, we propose a UV-guided texture regularization term to further guide the completion of texture on invisible body parts. We show that ZeroAvatar significantly enhances the robustness and 3D consistency of optimization-based image-to-3D avatar generation, outperforming existing zero-shot image-to-3D methods.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 42 of its 53 references that are in the map. First posted on arXiv 25 May 2023.

Builds on

42 of 53 references.

Closest ancestors · 10

Same direction, newest first

  1. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models3 Apr
  2. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  3. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  4. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  5. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar
  6. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  7. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec
  8. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  10. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 32

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  9. 2015Fast R-CNNcited by 2,933
  10. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  12. 2017End-to-end Recovery of Human Shape and Posecited by 885
20 more
  1. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  2. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  3. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
  4. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
  5. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
  6. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  7. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  8. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  9. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  10. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  11. 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
  12. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  13. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
  14. 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
  15. 2018The Contextual Loss for Image Transformation with Non-Aligned Datacited by 135
  16. 2020Holistic 3D Human and Scene Mesh Estimation from Single View Imagescited by 54
  17. 2022CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshescited by 41
  18. 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstructioncited by 39
  19. 2022ISS: Image as Stepping Stone for Text-Guided 3D Shape Generationcited by 27
  20. 2022Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recoverycited by 12

Built on by

Cited by year

Citing papers per year: 2023: 7; 2024: 9; 2025: 2.

18 papers.

Sort:

By area:

  1. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  2. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  3. 2023Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Viewscited by 33
  4. 2023Disentangled Clothed Avatar Generation from Text Descriptionscited by 33
  5. 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3Dcited by 28
  6. 2024Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRMcited by 23
  7. 2024Motion Avatar: Generate Human and Animal Avatars with Arbitrary Motioncited by 19
  8. 2024GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Qualitycited by 18
  9. 2024GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understandingcited by 15
  10. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  11. 2024LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priorscited by 12
  12. 2024OccFusion: Rendering Occluded Humans with Generative Diffusion Priorscited by 8
6 more
  1. 2024HumanCoser: Layered 3D Human Generation via Semantic-Aware Diffusion Modelcited by 7
  2. 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
  3. 2025Towards In-the-wild 3D Plane Reconstruction from a Single Imagecited by 6
  4. 2023Layered 3D Human Generation via Semantic-Aware Diffusion Modelcited by 2
  5. 2024TEDRA: Text-based Editing of Dynamic and Photoreal Actorscited by 1
  6. 2023InceptionHuman: Controllable Prompt-to-NeRF for Photorealistic 3D Human Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars
  2. 2023AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion
  3. 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusion
  4. 2023SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearance
  5. 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control
  6. 2025GAS: Generative Avatar Synthesis from a Single Image
  7. 2024UltrAvatar: A Realistic Animatable 3D Avatar Diffusion Model with Authenticity Guided Textures
  8. 2024Instant 3D Human Avatar Generation using Image Diffusion Models