mlsanityData to 14 Oct 2026

LaughTalk: Expressive 3D Talking Head Generation with Laughter

arXiv 2311.00994 ↗First posted 2 Nov 2023cs.CV cs.GRcited by 27

Not on the map. Why?

Abstract (arXiv)

Laughter is a unique expression, essential to affirmative social interactions of humans. Although current 3D talking head generation methods produce convincing verbal articulations, they often fail to capture the vitality and subtleties of laughter and smiles despite their importance in social context. In this paper, we introduce a novel task to generate 3D talking heads capable of both articulate speech and authentic laughter. Our newly curated dataset comprises 2D laughing videos paired with pseudo-annotated and human-validated 3D FLAME parameters and vertices. Given our proposed dataset, we present a strong baseline with a two-stage training scheme: the model first learns to talk and then acquires the ability to express laughter. Extensive experiments demonstrate that our method performs favorably compared to existing approaches in both talking head generation and expressing laughter signals. We further explore potential applications on top of our proposed method for rigging realistic avatars.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 27 of its 50 references that are in the map. First posted on arXiv 2 Nov 2023.

Builds on

27 of 50 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
  4. 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
  5. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
  6. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  7. 2018Deep Audio-Visual Speech Recognitioncited by 322
  8. 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
  9. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
  10. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
  11. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
  12. 2016Lip Reading Sentences in the Wildcited by 228
15 more
  1. 2021Neural Head Avatars from Monocular RGB Videoscited by 213
  2. 2021FaceFormer: Speech-Driven 3D Facial Animation with Transformerscited by 209
  3. 2021MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglementcited by 190
  4. 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
  5. 2022Towards Metrical Reconstruction of Human Facescited by 166
  6. 2022Instant Volumetric Head Avatarscited by 159
  7. 2023EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animationcited by 142
  8. 2021Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detectioncited by 113
  9. 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 104
  10. 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
  11. 2022Multiface: A Dataset for Neural Face Renderingcited by 87
  12. 2022Imitator: Personalized Speech-driven 3D Facial Animationcited by 74
  13. 2020Modality Dropout for Improved Performance-driven Talking Facescited by 32
  14. 2019Audio2Face: Generating Speech/Face Animation from Single Audio with Attention-Based Bidirectional LSTM Networkscited by 8
  15. 2023A Large-Scale 3D Face Mesh Video Dataset via Neural Re-parameterized Optimizationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 11; 2025: 11; 2026: 2.

27 papers.

Sort:

By area:

  1. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  2. 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusioncited by 39
  3. 2025DualTalk: Dual-Speaker Interaction for 3D Talking Head Conversationscited by 32
  4. 2023SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Modelscited by 28
  5. 2024MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Datasetcited by 28
  6. 2024EmoVOCA: Speech-Driven Emotional 3D Talking Headscited by 13
  7. 2024DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face Animationcited by 12
  8. 2025KeyFace: Expressive Audio-Driven Facial Animation for Long Sequences via KeyFrame Interpolationcited by 11
  9. 2025VoiceCraft-Dub: Automated Video Dubbing with Neural Codec Language Modelscited by 11
  10. 2025UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speakingcited by 11
  11. 2025Perceptually Accurate 3D Talking Head Generation: New Definitions, Speech-Mesh Representation, and Evaluation Metricscited by 10
  12. 2024Enhancing Speech-Driven 3D Facial Animation with Audio-Visual Guidance from Lip Reading Expertcited by 6
15 more
  1. 2025Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functionscited by 6
  2. 2024A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editingcited by 5
  3. 2024Sound2Vision: Generating Diverse Visuals from Audio through Cross-Modal Latent Alignmentcited by 5
  4. 20253DiFACE: Synthesizing and Editing Holistic 3D Facial Animationcited by 4
  5. 2024JambaTalk: Speech-Driven 3D Talking Head Generation Based on Hybrid Transformer-Mamba Modelcited by 3
  6. 2025Towards Seamless Interaction: Causal Turn-Level Modeling of Interactive 3D Conversational Head Dynamicscited by 3
  7. 2024Diverse Code Query Learning for Speech-Driven Facial Animationcited by 2
  8. 2024When Words Smile: Generating Diverse Emotional Facial Expressions from Textcited by 2
  9. 2025Tiny is not small enough: High-quality, low-resource facial animation models through hybrid knowledge distillationcited by 2
  10. 2024EmoFace: Emotion-Content Disentangled Speech-Driven 3D Talking Face Animationcited by 1
  11. 2024EmoGene: Audio-Driven Emotional 3D Talking-Head Generationcited by 1
  12. 2025RealTalk: Realistic Emotion-Aware Lifelike Talking-Head Synthesiscited by 0
  13. 2025Learning Disentangled Speech- and Expression-Driven Blendshapes for 3D Talking Face Animationcited by 0
  14. 20263DXTalker: Unifying Identity, Lip Sync, Emotion, and Spatial Dynamics in Expressive 3D Talking Avatarscited by 0
  15. 2026Talking Together: Synthesizing Co-Located 3D Conversations from Audiocited by 0