A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation
Not on the map. Why?
Abstract (arXiv)
3D modeling has long been an important area in computer vision and computer graphics. Recently, thanks to the breakthroughs in neural representations and generative models, we witnessed a rapid development of 3D modeling. 3D human modeling, lying at the core of many real-world applications, such as gaming and animation, has attracted significant attention. Over the past few years, a large body of work on creating 3D human avatars has been introduced, forming a new and abundant knowledge base for 3D human modeling. The scale of the literature makes it difficult for individuals to keep track of all the works. This survey aims to provide a comprehensive overview of these emerging techniques for 3D human avatar modeling, from both reconstruction and generation perspectives. Firstly, we review representative methods for 3D human reconstruction, including methods based on pixel-aligned implicit function, neural radiance field, and 3D Gaussian Splatting, etc. We then summarize representative methods for 3D human generation, especially those using large language models like CLIP, diffusion models, and various 3D representations, which demonstrate state-of-the-art performance. Finally, we discuss our reflection on existing methods and open challenges for 3D human avatar modeling, shedding light on future research.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 218 of its 258 references that are in the map. First posted on arXiv 6 Jun 2024.
Builds on
218 of 258 references.
References · 218
- 2017Attention Is All You Needcited by 59,932
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
38 more
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Human Motion Diffusion Modelcited by 1,062
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2020Convolutional Occupancy Networkscited by 760
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
50 most cited of 218 All 218 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 4.
13 papers.
Sort:
By area:
- 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splattingcited by 13
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 2025Neural Radiance Fields for the Real World: A Surveycited by 12
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignmentcited by 3
- 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
- 2026Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretrainingcited by 3
- 2025On the Skinning of Gaussian Avatarscited by 1
- 2025GSAC: Leveraging Gaussian Splatting for Photorealistic Avatar Creation with Unity Integrationcited by 0
- 2025SIE3D: Single-Image Expressive 3D Avatar Generation via Semantic Embedding and Perceptual Expression Losscited by 0
- 2025Towards Efficient 3D Gaussian Human Avatar Compression: A Prior-Guided Frameworkcited by 0
- 2026JOintGS: Joint Optimization of Cameras, Bodies and 3D Gaussians for In-the-Wild Monocular Reconstructioncited by 0
- 2026AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalization2 Jun 2026
- 2026Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining2 Apr 2026
- 2026JOintGS: Joint Optimization of Cameras, Bodies and 3D Gaussians for In-the-Wild Monocular Reconstruction4 Feb 2026
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2025Towards Efficient 3D Gaussian Human Avatar Compression: A Prior-Guided Framework12 Oct 2025
- 2025SIE3D: Single-Image Expressive 3D Avatar Generation via Semantic Embedding and Perceptual Expression Loss28 Sep 2025
- 2025On the Skinning of Gaussian Avatars14 Sep 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment2 Jun 2025
- 2025GSAC: Leveraging Gaussian Splatting for Photorealistic Avatar Creation with Unity Integration17 Apr 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
1 more
- 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splattingcited by 13
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 2025Neural Radiance Fields for the Real World: A Surveycited by 12
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignmentcited by 3
- 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
- 2026Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretrainingcited by 3
- 2025On the Skinning of Gaussian Avatarscited by 1
- 2025GSAC: Leveraging Gaussian Splatting for Photorealistic Avatar Creation with Unity Integrationcited by 0
- 2025SIE3D: Single-Image Expressive 3D Avatar Generation via Semantic Embedding and Perceptual Expression Losscited by 0
- 2025Towards Efficient 3D Gaussian Human Avatar Compression: A Prior-Guided Frameworkcited by 0
- 2026JOintGS: Joint Optimization of Cameras, Bodies and 3D Gaussians for In-the-Wild Monocular Reconstructioncited by 0
- 2026AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalizationcited by 0
- 2026AvatarMix: Identity-Preserving Cross-Avatar Composition for Outfit Personalization2 Jun 2026
- 2026Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining2 Apr 2026
- 2026JOintGS: Joint Optimization of Cameras, Bodies and 3D Gaussians for In-the-Wild Monocular Reconstruction4 Feb 2026
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2025Towards Efficient 3D Gaussian Human Avatar Compression: A Prior-Guided Framework12 Oct 2025
- 2025SIE3D: Single-Image Expressive 3D Avatar Generation via Semantic Embedding and Perceptual Expression Loss28 Sep 2025
- 2025On the Skinning of Gaussian Avatars14 Sep 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment2 Jun 2025
- 2025GSAC: Leveraging Gaussian Splatting for Photorealistic Avatar Creation with Unity Integration17 Apr 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
- 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splatting7 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2024Report on Methods and Applications for Crafting 3D Humans ↗
- 2024Instant 3D Human Avatar Generation using Image Diffusion Models
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
- 2025GAS: Generative Avatar Synthesis from a Single Image
- 2024HR Human: Modeling Human Avatars with Triangular Mesh and High-Resolution Textures from Videos
- 2025Hyper Diffusion Avatars: Dynamic Human Avatar Generation using Network Weight Space Diffusion
- 2025AdaHuman: Animatable Detailed 3D Human Generation with Compositional Multiview Diffusion
- 2025TeRA: Rethinking Text-guided Realistic 3D Avatar Generation