mlsanityData to 14 Oct 2026

Few-Shot Identity Adaptation for 3D Talking Heads via Global Gaussian Field

arXiv 2506.22044 ↗First posted 27 Jun 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Reconstruction and rendering-based talking head synthesis methods achieve high-quality results with strong identity preservation but are limited by their dependence on identity-specific models. Each new identity requires training from scratch, incurring high computational costs and reduced scalability compared to generative model-based approaches. To overcome this limitation, we propose FIAG, a novel 3D speaking head synthesis framework that enables efficient identity-specific adaptation using only a few training footage. FIAG incorporates Global Gaussian Field, which supports the representation of multiple identities within a shared field, and Universal Motion Field, which captures the common motion dynamics across diverse identities. Benefiting from the shared facial structure information encoded in the Global Gaussian Field and the general motion priors learned in the motion field, our framework enables rapid adaptation from canonical identity representations to specific ones with minimal data. Extensive comparative and ablation experiments demonstrate that our method outperforms existing state-of-the-art approaches, validating both the effectiveness and generalizability of the proposed framework. Code is available at: textithttps://github.com/gme-hong/FIAG.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 48 of its 65 references that are in the map. First posted on arXiv 27 Jun 2025.

Builds on

48 of 65 references.

References · 48

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  5. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  7. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  8. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  9. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  10. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  11. 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 312
  12. 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
36 more
  1. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
  2. 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
  3. 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
  4. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  5. 2021Audio-Driven Emotional Video Portraitscited by 180
  6. 2018Lip Movements Generation at a Glancecited by 155
  7. 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 149
  8. 2023Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generationcited by 142
  9. 2023DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animationcited by 136
  10. 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
  11. 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
  12. 2022Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesiscited by 97
  13. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  14. 2020Towards Automatic Face-to-Face Translationcited by 96
  15. 2020Audio-driven Talking Face Video Generation with Learning-based Personalized Head Posecited by 92
  16. 2021FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learningcited by 90
  17. 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
  18. 2018Talking Face Generation by Conditional Recurrent Adversarial Networkcited by 84
  19. 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
  20. 2023Efficient Emotional Adaptation for Audio-Driven Talking-Head Generationcited by 81
  21. 2022DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Renderingcited by 80
  22. 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
  23. 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
  24. 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
  25. 2022Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priorscited by 55
  26. 2020What comprises a good talking-head video generation?: A Survey and Benchmarkcited by 42
  27. 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
  28. 2023GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generationcited by 42
  29. 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
  30. 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
  31. 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
  32. 2024GaussianSpeech: Audio-Driven Gaussian Avatarscited by 9
  33. 2024DEGSTalk: Decomposed Per-Embedding Gaussian Fields for Hair-Preserving Talking Face Synthesiscited by 7
  34. 2023Towards the generation of synchronized and believable non-verbal facial behaviors of a talking virtual agentcited by 5
  35. 2025EmoTalkingGaussian: Continuous Emotion-conditioned Talking Head Synthesiscited by 4
  36. 2024CSTalk: Correlation Supervised Speech-driven 3D Emotional Facial Animation Generationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.