mlsanityData to 14 Oct 2026

EmoDiffTalk:Emotion-aware Diffusion for Editable 3D Gaussian Talking Head

arXiv 2512.05991 ↗First posted 30 Nov 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent photo-realistic 3D talking head via 3D Gaussian Splatting still has significant shortcoming in emotional expression manipulation, especially for fine-grained and expansive dynamics emotional editing using multi-modal control. This paper introduces a new editable 3D Gaussian talking head, i.e. EmoDiffTalk. Our key idea is a novel Emotion-aware Gaussian Diffusion, which includes an action unit (AU) prompt Gaussian diffusion process for fine-grained facial animator, and moreover an accurate text-to-AU emotion controller to provide accurate and expansive dynamic emotional editing using text input. Experiments on public EmoTalk3D and RenderMe-360 datasets demonstrate superior emotional subtlety, lip-sync fidelity, and controllability of our EmoDiffTalk over previous works, establishing a principled pathway toward high-quality, diffusion-driven, multimodal editable 3D talking-head synthesis. To our best knowledge, our EmoDiffTalk is one of the first few 3D Gaussian Splatting talking-head generation framework, especially supporting continuous, multimodal emotional editing within the AU-based expression space.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 56 references that are in the map. First posted on arXiv 30 Nov 2025.

Builds on

43 of 56 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  5. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  6. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  7. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  8. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  9. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 235
  10. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  11. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  12. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
31 more
  1. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  2. 2021MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglementcited by 190
  3. 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
  4. 2018Lip Movements Generation at a Glancecited by 155
  5. 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Modelcited by 151
  6. 2023EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animationcited by 142
  7. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 122
  8. 2022VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wildcited by 106
  9. 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 98
  10. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  11. 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
  12. 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
  13. 2023Efficient Emotional Adaptation for Audio-Driven Talking-Head Generationcited by 81
  14. 2023DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Modelscited by 81
  15. 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
  16. 2023FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Modelscited by 55
  17. 2023VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Priorcited by 47
  18. 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
  19. 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
  20. 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representationscited by 31
  21. 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
  22. 2024EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Headcited by 16
  23. 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
  24. 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 14
  25. 2024DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face Animationcited by 12
  26. 2024Portrait Video Editing Empowered by Multimodal Generative Priorscited by 12
  27. 2025Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained Controlcited by 12
  28. 2025Monocular and Generalizable Gaussian Talking Head Animationcited by 10
  29. 2024Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360degcited by 9
  30. 2025OmniTalker: One-shot Real-time Text-Driven Talking Audio-Video Generation With Multimodal Style Mimickingcited by 9
  31. 2025MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstructioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatarscited by 0