mlsanityData to 7 Oct 2026

HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priors

arXiv 2408.06019 ↗First posted 12 Aug 2024cs.CVcited by 44

Not on the map. Why?

Abstract (arXiv)

In this paper, we present a novel 3D head avatar creation approach capable of generalizing from few-shot in-the-wild data with high-fidelity and animatable robustness. Given the underconstrained nature of this problem, incorporating prior knowledge is essential. Therefore, we propose a framework comprising prior learning and avatar creation phases. The prior learning phase leverages 3D head priors derived from a large-scale multi-view dynamic dataset, and the avatar creation phase applies these priors for few-shot personalization. Our approach effectively captures these priors by utilizing a Gaussian Splatting-based auto-decoder network with part-based dynamic modeling. Our method employs identity-shared encoding with personalized latent codes for individual identities to learn the attributes of Gaussian primitives. During the avatar creation phase, we achieve fast head avatar personalization by leveraging inversion and fine-tuning strategies. Extensive experiments demonstrate that our model effectively exploits head priors and successfully generalizes them to few-shot personalization, achieving photo-realistic rendering quality, multi-view consistency, and stable animation.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 74 of its 90 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

74 of 90 references.

References · 74

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  5. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  6. 2020First Order Motion Model for Image Animationcited by 698
  7. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  8. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  9. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  10. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  11. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  12. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
38 more
  1. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  2. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  3. 2018Deep Video Portraitscited by 265
  4. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  5. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  6. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  7. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  8. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  9. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  10. 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
  11. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
  12. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
  13. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
  14. 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
  15. 2022Towards Metrical Reconstruction of Human Facescited by 165
  16. 2022Instant Volumetric Head Avatarscited by 157
  17. 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
  18. 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
  19. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  20. 2021Pixel Codec Avatarscited by 125
  21. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  22. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  23. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
  24. 2022Generative Neural Articulated Radiance Fieldscited by 101
  25. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  26. 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
  27. 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
  28. 2023DiffusionRig: Learning Personalized Priors for Facial Appearance Editingcited by 74
  29. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  30. 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
  31. 2022Learning Neural Parametric Head Modelscited by 73
  32. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
  33. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  34. 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
  35. 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
  36. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  37. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
  38. 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 22; 2026: 18.

44 papers.

Sort:

By area:

  1. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
  2. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
  3. 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
  4. 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
  5. 2024PERSE: Personalized 3D Generative Avatars from A Single Portraitcited by 15
  6. 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversioncited by 14
  7. 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 13
  8. 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
  9. 2025Monocular and Generalizable Gaussian Talking Head Animationcited by 10
  10. 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
  11. 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformancecited by 8
  12. 2025HairCUP: Hair Compositional Universal Prior for 3D Gaussian Avatarscited by 7
32 more
  1. 2025FastAvatar: Towards Unified and Fast 3D Avatar Reconstruction with Large Gaussian Reconstruction Transformerscited by 6
  2. 2025Audio-Driven Universal Gaussian Head Avatarscited by 6
  3. 2024Towards Native Generative Model for 3D Head Avatarcited by 5
  4. 2026UIKA: Fast Universal Head Avatar from Pose-Free Imagescited by 5
  5. 2025GGTalker: Talking Head Systhesis with Generalizable Gaussian Priors and Identity-Specific Adaptationcited by 4
  6. 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animationcited by 4
  7. 2025Parametric Gaussian Human Model: Generalizable Prior for Efficient and Realistic Human Avatar Modelingcited by 3
  8. 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatarcited by 3
  9. 2025Text-based Animatable 3D Avatars with Morphable Model Alignmentcited by 2
  10. 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformationcited by 2
  11. 2025VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesiscited by 1
  12. 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatarscited by 1
  13. 2025Pix2NPHM: Learning to Regress NPHM Reconstructions From a Single Imagecited by 1
  14. 2026ELITE: Efficient Gaussian Head Avatar from a Monocular Video via Learned Initialization and TEst-time Generative Adaptationcited by 1
  15. 2026VRGaussianAvatar: Integrating 3D Gaussian Avatars into VRcited by 1
  16. 2026From Blurry to Believable: Enhancing Low-quality Talking Heads with 3D Generative Priorscited by 1
  17. 2026OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatarcited by 1
  18. 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarizationcited by 1
  19. 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generationcited by 1
  20. 2025GRMM: Real-Time High-Fidelity Gaussian Morphable Head Model with Learned Residualscited by 0
  21. 2025GLVD: Guided Learned Vertex Descentcited by 0
  22. 2025HumanCrafter: Synergizing Generalizable Human Reconstruction and Semantic 3D Segmentationcited by 0
  23. 2026GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar Reconstructioncited by 0
  24. 2026FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual Capturescited by 0
  25. 2026DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Videocited by 0
  26. 20263DRealHead: Few-Shot Detailed Head Avatarcited by 0
  27. 2026One-shot Compositional 3D Head Avatars with Deformable Haircited by 0
  28. 2026Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Capturescited by 0
  29. 2026Self-Learning Expression Deformations for Data-Efficient Gaussian Avatarscited by 0
  30. 2026SpatialAvatar-0: High-Quality 4D Head Avatar with Multi-Stage Reconstructioncited by 0
  31. 2026FA-LAM: Focus-Aware Large Avatar Model for One-Shot 4D Animatable Gaussian Headcited by 0
  32. 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Imagecited by 0