Few-Shot Identity Adaptation for 3D Talking Heads via Global Gaussian Field
Not on the map. Why?
Abstract (arXiv)
Reconstruction and rendering-based talking head synthesis methods achieve high-quality results with strong identity preservation but are limited by their dependence on identity-specific models. Each new identity requires training from scratch, incurring high computational costs and reduced scalability compared to generative model-based approaches. To overcome this limitation, we propose FIAG, a novel 3D speaking head synthesis framework that enables efficient identity-specific adaptation using only a few training footage. FIAG incorporates Global Gaussian Field, which supports the representation of multiple identities within a shared field, and Universal Motion Field, which captures the common motion dynamics across diverse identities. Benefiting from the shared facial structure information encoded in the Global Gaussian Field and the general motion priors learned in the motion field, our framework enables rapid adaptation from canonical identity representations to specific ones with minimal data. Extensive comparative and ablation experiments demonstrate that our method outperforms existing state-of-the-art approaches, validating both the effectiveness and generalizability of the proposed framework. Code is available at: textithttps://github.com/gme-hong/FIAG.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 48 of its 65 references that are in the map. First posted on arXiv 27 Jun 2025.
Builds on
48 of 65 references.
References · 48
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 312
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
36 more
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
- 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2018Lip Movements Generation at a Glancecited by 155
- 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 149
- 2023Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generationcited by 142
- 2023DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animationcited by 136
- 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
- 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
- 2022Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesiscited by 97
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2020Towards Automatic Face-to-Face Translationcited by 96
- 2020Audio-driven Talking Face Video Generation with Learning-based Personalized Head Posecited by 92
- 2021FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learningcited by 90
- 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
- 2018Talking Face Generation by Conditional Recurrent Adversarial Networkcited by 84
- 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
- 2023Efficient Emotional Adaptation for Audio-Driven Talking-Head Generationcited by 81
- 2022DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Renderingcited by 80
- 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
- 2023HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splattingcited by 60
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
- 2022Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priorscited by 55
- 2020What comprises a good talking-head video generation?: A Survey and Benchmarkcited by 42
- 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
- 2023GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generationcited by 42
- 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
- 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
- 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
- 2024GaussianSpeech: Audio-Driven Gaussian Avatarscited by 9
- 2024DEGSTalk: Decomposed Per-Embedding Gaussian Fields for Hair-Preserving Talking Face Synthesiscited by 7
- 2023Towards the generation of synchronized and believable non-verbal facial behaviors of a talking virtual agentcited by 5
- 2025EmoTalkingGaussian: Continuous Emotion-conditioned Talking Head Synthesiscited by 4
- 2024CSTalk: Correlation Supervised Speech-driven 3D Emotional Facial Animation Generationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.