mlsanityData to 14 Oct 2026

EmoTaG: Emotion-Aware Talking Head Synthesis on Gaussian Splatting with Few-Shot Personalization

arXiv 2603.21332 ↗First posted 22 Mar 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Audio-driven 3D talking head synthesis has advanced rapidly with Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS). By leveraging rich pre-trained priors, few-shot methods enable instant personalization from just a few seconds of video. However, under expressive facial motion, existing few-shot approaches often suffer from geometric instability and audio-emotion mismatch, highlighting the need for more effective emotion-aware motion modeling. In this work, we present EmoTaG, a few-shot emotion-aware 3D talking head synthesis framework built on the Pretrain-and-Adapt paradigm. Our key insight is to reformulate motion prediction in a structured FLAME parameter space rather than directly deforming 3D Gaussians, thereby introducing explicit geometric priors that improve motion stability. Building upon this, we propose a Gated Residual Motion Network (GRMN), which captures emotional prosody from audio while supplementing head pose and upper-face cues absent from audio, enabling expressive and coherent motion generation. Extensive experiments demonstrate that EmoTaG achieves state-of-the-art performance in emotional expressiveness, lip synchronization, visual realism, and motion stability.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 44 of its 61 references that are in the map. First posted on arXiv 22 Mar 2026.

Builds on

44 of 61 references.

References · 44

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  5. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  6. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  7. 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
  8. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  9. 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
  10. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  11. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 202
  12. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 200
32 more
  1. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  2. 2022Instant Volumetric Head Avatarscited by 159
  3. 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
  4. 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
  5. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  6. 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 80
  7. 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
  8. 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
  9. 2022Face Relighting with Geometrically Consistent Shadowscited by 43
  10. 2021Towards High Fidelity Face Relighting with Realistic Shadowscited by 42
  11. 2023GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generationcited by 42
  12. 2024FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantizationcited by 39
  13. 2024Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Stylecited by 33
  14. 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
  15. 2025RGBAvatar: Reduced Gaussian Blendshapes for Online Modeling of Head Avatarscited by 29
  16. 2024TAMM: TriAdapter Multi-Modal Learning for 3D Shape Understandingcited by 27
  17. 2024Say Anything with Any Stylecited by 26
  18. 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
  19. 2024EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Headcited by 16
  20. 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
  21. 2025FixTalk: Taming Identity Leakage for High-Quality Talking Head Generation in Extreme Casescited by 14
  22. 2024EmoVOCA: Speech-Driven Emotional 3D Talking Headscited by 13
  23. 2025Disentangle Identity, Cooperate Emotion: Correlation-Aware Emotional Talking Portrait Generationcited by 11
  24. 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognitioncited by 11
  25. 2025Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detectioncited by 10
  26. 2026Can Textual Reasoning Improve the Performance of MLLMs on Fine-grained Visual Classification?cited by 8
  27. 2024COMPOSE: Comprehensive Portrait Shadow Editingcited by 6
  28. 2025CHARM3R: Towards Unseen Camera Height Robust Monocular 3D Detectorcited by 6
  29. 2025EDTalk++: Full Disentanglement for Controllable Talking Head Synthesiscited by 5
  30. 2025GGTalker: Talking Head Systhesis with Generalizable Gaussian Priors and Identity-Specific Adaptationcited by 4
  31. 2025TRIM: Scalable 3D Gaussian Diffusion Inference with Temporal and Spatial Trimmingcited by 3
  32. 2025Few-Shot Identity Adaptation for 3D Talking Heads via Global Gaussian Fieldcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.