EmoTaG: Emotion-Aware Talking Head Synthesis on Gaussian Splatting with Few-Shot Personalization
Not on the map. Why?
Abstract (arXiv)
Audio-driven 3D talking head synthesis has advanced rapidly with Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS). By leveraging rich pre-trained priors, few-shot methods enable instant personalization from just a few seconds of video. However, under expressive facial motion, existing few-shot approaches often suffer from geometric instability and audio-emotion mismatch, highlighting the need for more effective emotion-aware motion modeling. In this work, we present EmoTaG, a few-shot emotion-aware 3D talking head synthesis framework built on the Pretrain-and-Adapt paradigm. Our key insight is to reformulate motion prediction in a structured FLAME parameter space rather than directly deforming 3D Gaussians, thereby introducing explicit geometric priors that improve motion stability. Building upon this, we propose a Gated Residual Motion Network (GRMN), which captures emotional prosody from audio while supplementing head pose and upper-face cues absent from audio, enabling expressive and coherent motion generation. Extensive experiments demonstrate that EmoTaG achieves state-of-the-art performance in emotional expressiveness, lip synchronization, visual realism, and motion stability.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 44 of its 61 references that are in the map. First posted on arXiv 22 Mar 2026.
Builds on
44 of 61 references.
References · 44
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 202
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 200
32 more
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2022Instant Volumetric Head Avatarscited by 159
- 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
- 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 80
- 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
- 2022Face Relighting with Geometrically Consistent Shadowscited by 43
- 2021Towards High Fidelity Face Relighting with Realistic Shadowscited by 42
- 2023GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generationcited by 42
- 2024FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantizationcited by 39
- 2024Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Stylecited by 33
- 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
- 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
- 2024TAMM: TriAdapter Multi-Modal Learning for 3D Shape Understandingcited by 27
- 2024Say Anything with Any Stylecited by 26
- 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
- 2024EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Headcited by 16
- 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
- 2025FixTalk: Taming Identity Leakage for High-Quality Talking Head Generation in Extreme Casescited by 14
- 2024EmoVOCA: Speech-Driven Emotional 3D Talking Headscited by 13
- 2025Disentangle Identity, Cooperate Emotion: Correlation-Aware Emotional Talking Portrait Generationcited by 11
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognitioncited by 11
- 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detectioncited by 10
- 2026Can Textual Reasoning Improve the Performance of MLLMs on Fine-grained Visual Classification?cited by 8
- 2024COMPOSE: Comprehensive Portrait Shadow Editingcited by 6
- 2025CHARM3R: Towards Unseen Camera Height Robust Monocular 3D Detectorcited by 6
- 2025EDTalk++: Full Disentanglement for Controllable Talking Head Synthesiscited by 5
- 2025GGTalker: Talking Head Systhesis with Generalizable Gaussian Priors and Identity-Specific Adaptationcited by 4
- 2025TRIM: Scalable 3D Gaussian Diffusion Inference with Temporal and Spatial Trimmingcited by 3
- 2025Few-Shot Identity Adaptation for 3D Talking Heads via Global Gaussian Fieldcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splattingcited by 0
- 2026Subtoken Vision Transformer for Fine-grained Recognitioncited by 0
- 2026Proxy Avatar Meets Low-Rank Caching: Real-Time One-Shot Emotion-Controllable Portrait Animationcited by 0
- 2026Proxy Avatar Meets Low-Rank Caching: Real-Time One-Shot Emotion-Controllable Portrait Animation3 Aug 2026
- 2026Subtoken Vision Transformer for Fine-grained Recognition10 Jul 2026
- 2026GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting1 Jul 2026