mlsanityData to 7 Oct 2026

GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstruction

arXiv 2407.15070 ↗First posted 21 Jul 2024cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Creating high-fidelity 3D human head avatars is crucial for applications in VR/AR, digital human, and film production. Recent advances have leveraged morphable face models to generate animated head avatars from easily accessible data, representing varying identities and expressions within a low-dimensional parametric space. However, existing methods often struggle with modeling complex appearance details, e.g., hairstyles, and suffer from low rendering quality and efficiency. In this paper we introduce a novel approach, 3D Gaussian Parametric Head Model, which employs 3D Gaussians to accurately represent the complexities of the human head, allowing precise control over both identity and expression. The Gaussian model can handle intricate details, enabling realistic representations of varying appearances and complex expressions. Furthermore, we presents a well-designed training framework to ensure smooth convergence, providing a robust guarantee for learning the rich content. Our method achieves high-quality, photo-realistic rendering with real-time efficiency, making it a valuable contribution to the field of parametric head models. Finally, we apply the 3D Gaussian Parametric Head Model to monocular video or few-shot head avatar reconstruction tasks, which enables instant reconstruction of high-quality 3D head avatars even when input data is extremely limited, surpassing previous methods in terms of reconstruction quality and training speed.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 63 of its 81 references that are in the map. First posted on arXiv 21 Jul 2024.

Builds on

63 of 81 references.

References · 63

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  7. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  9. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  10. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  11. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  12. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
38 more
  1. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  2. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  3. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  4. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  5. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  6. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  7. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  8. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  9. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  10. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  11. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  12. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  13. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  14. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  15. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  16. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
  17. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
  18. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
  19. 2020Real-Time High-Resolution Background Mattingcited by 172
  20. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
  21. 2022Instant Volumetric Head Avatarscited by 157
  22. 2017Morphable Face Models - An Open Frameworkcited by 138
  23. 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
  24. 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
  25. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  26. 2023Relightable Gaussian Codec Avatarscited by 126
  27. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  28. 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
  29. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  30. 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
  31. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
  32. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  33. 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
  34. 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
  35. 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
  36. 2022GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifoldscited by 73
  37. 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
  38. 2022Learning Neural Parametric Head Modelscited by 73

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 4.

10 papers.