GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstruction
Not on the map. Why?
Abstract (arXiv)
Creating high-fidelity 3D human head avatars is crucial for applications in VR/AR, digital human, and film production. Recent advances have leveraged morphable face models to generate animated head avatars from easily accessible data, representing varying identities and expressions within a low-dimensional parametric space. However, existing methods often struggle with modeling complex appearance details, e.g., hairstyles, and suffer from low rendering quality and efficiency. In this paper we introduce a novel approach, 3D Gaussian Parametric Head Model, which employs 3D Gaussians to accurately represent the complexities of the human head, allowing precise control over both identity and expression. The Gaussian model can handle intricate details, enabling realistic representations of varying appearances and complex expressions. Furthermore, we presents a well-designed training framework to ensure smooth convergence, providing a robust guarantee for learning the rich content. Our method achieves high-quality, photo-realistic rendering with real-time efficiency, making it a valuable contribution to the field of parametric head models. Finally, we apply the 3D Gaussian Parametric Head Model to monocular video or few-shot head avatar reconstruction tasks, which enables instant reconstruction of high-quality 3D head avatars even when input data is extremely limited, surpassing previous methods in terms of reconstruction quality and training speed.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 63 of its 81 references that are in the map. First posted on arXiv 21 Jul 2024.
Builds on
63 of 81 references.
References · 63
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
38 more
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
- 2022Instant Volumetric Head Avatarscited by 157
- 2017Morphable Face Models - An Open Frameworkcited by 138
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
- 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2023Relightable Gaussian Codec Avatarscited by 126
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
- 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2022GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifoldscited by 73
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2022Learning Neural Parametric Head Modelscited by 73
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 4.
10 papers.
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversioncited by 14
- 2025RMAvatar: Photorealistic Human Avatar Reconstruction from Monocular Video Based on Rectified Mesh-embedded Gaussianscited by 7
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animationcited by 4
- 2025AvatarBack: Back-Head Generation for Complete 3D Avatars from Front-View Imagescited by 1
- 2026From Blurry to Believable: Enhancing Low-quality Talking Heads with 3D Generative Priorscited by 1
- 2024TimeWalker: Personalized Neural Space for Lifelong Head Avatarscited by 0
- 2025GLVD: Guided Learned Vertex Descentcited by 0
- 2026Self-Learning Expression Deformations for Data-Efficient Gaussian Avatarscited by 0
- 2026GNM Head: A Generative aNthropometric Model of the human headcited by 0
- 2026GNM Head: A Generative aNthropometric Model of the human head26 Jul 2026
- 2026Self-Learning Expression Deformations for Data-Efficient Gaussian Avatars4 Jun 2026
- 2026From Blurry to Believable: Enhancing Low-quality Talking Heads with 3D Generative Priors5 Feb 2026
- 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animation20 Jan 2026
- 2025GLVD: Guided Learned Vertex Descent7 Oct 2025
- 2025AvatarBack: Back-Head Generation for Complete 3D Avatars from Front-View Images28 Aug 2025
- 2025RMAvatar: Photorealistic Human Avatar Reconstruction from Monocular Video Based on Rectified Mesh-embedded Gaussians13 Jan 2025
- 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversion12 Jan 2025
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion13 Dec 2024
- 2024TimeWalker: Personalized Neural Space for Lifelong Head Avatars3 Dec 2024