mlsanityData to 14 Oct 2026

CETalk: Continuous Valence-Arousal Control for Audio-Driven 3D Talking Head Generation

arXiv 2608.15110 ↗First posted 15 Aug 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Emotional 3D talking head generation aims to synthesize expressive facial animations with accurate lip synchronization. However, existing methods often rely on discrete emotion categories, which fail to capture the continuous evolution of affect. They also overlook the temporal frequency mismatch between audio articulation and emotional expression. In this paper, we propose CETalk, an audio-driven 3D facial animation framework conditioned on continuous Valence--Arousal (VA) representations for fine-grained emotion control. CETalk predicts a sequence of FLAME parameters through three key components: a Dynamic Emotion Modulation Module that adaptively scales emotional intensity using audio-derived cues; a Multi-Scale Temporal Modeling mechanism that employs parallel branches to decouple high-frequency articulatory movements from low-frequency emotional dynamics; and a Dynamic Fusion Mechanism that integrates these multi-scale features via an adaptive gating network. To support training and evaluation, we construct 3D-VA-MEAD, a large-scale dataset with automatically estimated VA annotations and reconstructed 3D facial motions. Extensive experiments demonstrate that CETalk outperforms state-of-the-art methods in both lip-sync accuracy and emotional expressiveness, while enabling smooth and controllable emotion transitions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 15 Aug 2026.

Builds on

19 of 31 references.

References · 19

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  2. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
  3. 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
  4. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
  5. 2021FaceFormer: Speech-Driven 3D Facial Animation with Transformerscited by 209
  6. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 205
  7. 2021MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglementcited by 190
  8. 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
  9. 2023EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animationcited by 142
  10. 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
  11. 2024Generalizable and Animatable Gaussian Head Avatarcited by 97
  12. 2023DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Modelscited by 81
7 more
  1. 2023FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using Diffusioncited by 78
  2. 2024UniTalker: Scaling up Audio-Driven 3D Facial Animation through A Unified Modelcited by 30
  3. 2024RealTalk: Real-time and Realistic Audio-driven Face Generation with 3D Facial Prior-guided Identity Alignment Networkcited by 14
  4. 2024ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAEcited by 13
  5. 2024DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face Animationcited by 12
  6. 2025GaussianHeadTalk: Wobble-Free 3D Talking Heads with Audio Driven Gaussian Splattingcited by 2
  7. 2024RITA: A Real-time Interactive Talking Avatars Frameworkcited by 1

Built on by

Not cited yet.