mlsanityData to 7 Oct 2026

A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation

arXiv 2406.04253 ↗First posted 6 Jun 2024cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

3D modeling has long been an important area in computer vision and computer graphics. Recently, thanks to the breakthroughs in neural representations and generative models, we witnessed a rapid development of 3D modeling. 3D human modeling, lying at the core of many real-world applications, such as gaming and animation, has attracted significant attention. Over the past few years, a large body of work on creating 3D human avatars has been introduced, forming a new and abundant knowledge base for 3D human modeling. The scale of the literature makes it difficult for individuals to keep track of all the works. This survey aims to provide a comprehensive overview of these emerging techniques for 3D human avatar modeling, from both reconstruction and generation perspectives. Firstly, we review representative methods for 3D human reconstruction, including methods based on pixel-aligned implicit function, neural radiance field, and 3D Gaussian Splatting, etc. We then summarize representative methods for 3D human generation, especially those using large language models like CLIP, diffusion models, and various 3D representations, which demonstrate state-of-the-art performance. Finally, we discuss our reflection on existing methods and open challenges for 3D human avatar modeling, shedding light on future research.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 218 of its 258 references that are in the map. First posted on arXiv 6 Jun 2024.

Builds on

218 of 258 references.

References · 218

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  9. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  10. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
38 more
  1. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  3. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  5. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  8. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  9. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  10. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  11. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  12. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  13. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  14. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  15. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  16. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  17. 2022Human Motion Diffusion Modelcited by 1,062
  18. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  19. 2022Diffusion Models in Vision: A Surveycited by 1,008
  20. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  21. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  22. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
  23. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  24. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  25. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  26. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  27. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  28. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  29. 2020Convolutional Occupancy Networkscited by 760
  30. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
  31. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  32. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  33. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  34. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  35. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  36. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  37. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  38. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611

50 most cited of 218 All 218 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 4.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024Report on Methods and Applications for Crafting 3D Humans ↗
  2. 2024Instant 3D Human Avatar Generation using Image Diffusion Models
  3. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
  4. 2025GAS: Generative Avatar Synthesis from a Single Image
  5. 2024HR Human: Modeling Human Avatars with Triangular Mesh and High-Resolution Textures from Videos
  6. 2025Hyper Diffusion Avatars: Dynamic Human Avatar Generation using Network Weight Space Diffusion
  7. 2025AdaHuman: Animatable Detailed 3D Human Generation with Compositional Multiview Diffusion
  8. 2025TeRA: Rethinking Text-guided Realistic 3D Avatar Generation