mlsanityData to 7 Oct 2026

Generalizable and Animatable Gaussian Head Avatar

arXiv 2410.07971 ↗First posted 10 Oct 2024cs.CV cs.GRcited by 95

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose Generalizable and Animatable Gaussian head Avatar (GAGAvatar) for one-shot animatable head avatar reconstruction. Existing methods rely on neural radiance fields, leading to heavy rendering consumption and low reenactment speeds. To address these limitations, we generate the parameters of 3D Gaussians from a single image in a single forward pass. The key innovation of our work is the proposed dual-lifting method, which produces high-fidelity 3D Gaussians that capture identity and facial details. Additionally, we leverage global image features and the 3D morphable model to construct 3D Gaussians for controlling expressions. After training, our model can reconstruct unseen identities without specific optimizations and perform reenactment rendering at real-time speeds. Experiments show that our method exhibits superior performance compared to previous methods in terms of reconstruction quality and expression accuracy. We believe our method can establish new benchmarks for future research and advance applications of digital avatars. Code and demos are available https://github.com/xg-chu/GAGAvatar.

Key facts. Cited by 95 papers in the map (data through 7 Oct 2026). Builds on 67 of its 79 references that are in the map. First posted on arXiv 10 Oct 2024.

Builds on

67 of 79 references.

References · 67

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  9. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  10. 2020First Order Motion Model for Image Animationcited by 698
  11. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
  12. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
38 more
  1. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  2. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  3. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  4. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  5. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  6. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
  7. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  8. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  9. 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
  10. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
  11. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  12. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  13. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  14. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
  15. 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
  16. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
  17. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
  18. 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
  19. 2017Morphable Face Models - An Open Frameworkcited by 138
  20. 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
  21. 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
  22. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  23. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  24. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  25. 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
  26. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  27. 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
  28. 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
  29. 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
  30. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  31. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
  32. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  33. 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
  34. 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
  35. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  36. 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
  37. 20243D Gaussian Blendshapes for Head Avatar Animationcited by 58
  38. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 47; 2026: 44.

95 papers.

Sort:

By area:

  1. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  2. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
  3. 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
  4. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
  5. 2025ARTalk: Speech-Driven 3D Head Animation via Autoregressive Modelcited by 28
  6. 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
  7. 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
  8. 2025MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatarscited by 17
  9. 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15
  10. 2025Synthetic Prior for Few-Shot Drivable Head Avatar Inversioncited by 14
  11. 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 13
  12. 2025RoGSplat: Learning Robust Generalizable Human Gaussian Splatting from Sparse Multi-View Imagescited by 12
38 more
  1. 2025SEGA: Drivable 3D Gaussian Head Avatar from a Single Imagecited by 11
  2. 2025UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speakingcited by 10
  3. 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
  4. 2025Zero-1-to-A: Zero-Shot One Image to Animatable Head Avatars Using Video Diffusioncited by 9
  5. 2025SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussianscited by 8
  6. 2025Towards Interactive Intelligence for Digital Humanscited by 8
  7. 2025FastAvatar: Instant 3D Gaussian Splatting for Faces from Single Unconstrained Posescited by 7
  8. 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Imagecited by 7
  9. 2025GS-Marker: Generalizable and Robust Watermarking for 3D Gaussian Splattingcited by 6
  10. 2025CGS-GAN: 3D Consistent Gaussian Splatting GANs for High Resolution Human Head Synthesiscited by 6
  11. 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesiscited by 6
  12. 2025PercHead: Perceptual Head Model for Single-Image 3D Head Reconstruction & Editingcited by 6
  13. 2025FaceCraft4D: Animated 3D Facial Avatar Generation from a Single Imagecited by 5
  14. 2026UIKA: Fast Universal Head Avatar from Pose-Free Imagescited by 5
  15. 2025GGTalker: Talking Head Systhesis with Generalizable Gaussian Priors and Identity-Specific Adaptationcited by 4
  16. 2026FastGHA: Generalized Few-Shot 3D Gaussian Head Avatars with Real-Time Animationcited by 4
  17. 2025Controlling Avatar Diffusion with Learnable Gaussian Embeddingcited by 3
  18. 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatarcited by 3
  19. 2025Is It Really You? Exploring Biometric Verification Scenarios in Photorealistic Talking-Head Avatar Videoscited by 3
  20. 2025STAvatar: Soft Binding and Temporal Density Control for Monocular 3D Head Avatars Reconstructioncited by 3
  21. 2025Bringing Your Portrait to 3D Presencecited by 3
  22. 2025AGORA: Adversarial Generation Of Real-time Animatable 3D Gaussian Head Avatarscited by 3
  23. 2025VASA-3D: Lifelike Audio-Driven Gaussian Head Avatars from a Single Imagecited by 3
  24. 2025Snapmoji: Instant Generation of Animatable Dual-Stylized Avatarscited by 2
  25. 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentationcited by 2
  26. 2025Total-Editing: Head Avatar with Editable Appearance, Motion, and Lightingcited by 2
  27. 2025Unmasking Puppeteers: Leveraging Biometric Leakage to Expose Impersonation in AI-Based Videoconferencingcited by 2
  28. 2025GaussianHeadTalk: Wobble-Free 3D Talking Heads with Audio Driven Gaussian Splattingcited by 2
  29. 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformationcited by 2
  30. 2026Weak to Strong: VLM-Based Pseudo-Labeling as a Weakly Supervised Training Strategy in Multimodal Video-based Hidden Emotion Understanding Taskscited by 2
  31. 2026Leveraging Avatar Fingerprinting: A Multi-Generator Photorealistic Talking-Head Public Database and Benchmarkcited by 2
  32. 2025Test-Time Augmentation for Pose-invariant Face Recognitioncited by 1
  33. 2025Durian: Dual Reference Image-Guided Portrait Animation with Attribute Transfercited by 1
  34. 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpointcited by 1
  35. 2026From Blurry to Believable: Enhancing Low-quality Talking Heads with 3D Generative Priorscited by 1
  36. 2026OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatarcited by 1
  37. 2026AvatarPointillist: AutoRegressive 4D Gaussian Avatarizationcited by 1
  38. 2026Any3DAvatar: Fast and High-Quality Full-Head 3D Avatar Reconstruction from Single Portrait Imagecited by 1

50 most cited of 95 All 95 (JSON)