mlsanityData to 14 Oct 2026

EmoHead: Emotional Talking Head via Manipulating Semantic Expression Parameters

arXiv 2503.19416 ↗First posted 25 Mar 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Generating emotion-specific talking head videos from audio input is an important and complex challenge for human-machine interaction. However, emotion is highly abstract concept with ambiguous boundaries, and it necessitates disentangled expression parameters to generate emotionally expressive talking head videos. In this work, we present EmoHead to synthesize talking head videos via semantic expression parameters. To predict expression parameter for arbitrary audio input, we apply an audio-expression module that can be specified by an emotion tag. This module aims to enhance correlation from audio input across various emotions. Furthermore, we leverage pre-trained hyperplane to refine facial movements by probing along the vertical direction. Finally, the refined expression parameters regularize neural radiance fields and facilitate the emotion-consistent generation of talking head videos. Experimental results demonstrate that semantic expression parameters lead to better reconstruction quality and controllability.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 44 references that are in the map. First posted on arXiv 25 Mar 2025.

Builds on

32 of 44 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  5. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  6. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  7. 2020BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentationcited by 294
  8. 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
  9. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  10. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
  11. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 205
  12. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
20 more
  1. 2021Audio-Driven Emotional Video Portraitscited by 180
  2. 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Modelcited by 151
  3. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  4. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  5. 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 95
  6. 2020Learning Formation of Physically-Based Face Attributescited by 94
  7. 2023StyleTalk: One-shot Talking Head Generation with Controllable Speaking Stylescited by 92
  8. 2021One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learningcited by 87
  9. 2020Everybody's Talkin': Let Me Talk as You Wantcited by 83
  10. 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
  11. 2023Efficient Emotional Adaptation for Audio-Driven Talking-Head Generationcited by 81
  12. 2022DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Renderingcited by 80
  13. 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 80
  14. 2021A Comparison of Discrete and Soft Speech Units for Improved Voice Conversioncited by 61
  15. 2019Frame attention networks for facial expression recognition in videoscited by 56
  16. 2020Speech Driven Talking Face Generation from a Single Image and an Emotion Conditioncited by 47
  17. 2020High-Fidelity 3D Digital Human Head Creation from RGB-D Selfiescited by 47
  18. 2024Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Stylecited by 33
  19. 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
  20. 2023HyperLips: Hyper Control Lips with High Resolution Decoder for Talking Face Generationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026Cross-Modal Emotion Transfer for Emotion Editing in Talking Face Videocited by 1
  2. 2026Geometry-guided Emotion Modulation for Controllable and Photorealistic Emotional Talking Face Generationcited by 1
  3. 2026Xemo-Talker: Unlock Emotions Explicitly for Audio-Driven Talking Portrait Synthesiscited by 0