mlsanityData to 7 Oct 2026

Perceptual Conversational Head Generation with Regularized Driver and Enhanced Renderer

arXiv 2206.12837 ↗First posted 26 Jun 2022cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

This paper reports our solution for ACM Multimedia ViCo 2022 Conversational Head Generation Challenge, which aims to generate vivid face-to-face conversation videos based on audio and reference images. Our solution focuses on training a generalized audio-to-head driver using regularization and assembling a high-visual quality renderer. We carefully tweak the audio-to-behavior model and post-process the generated video using our foreground-background fusion module. We get first place in the listening head generation track and second place in the talking head generation track on the official leaderboard. Our code is available at https://github.com/megvii-research/MM2022-ViCoPerceptualHeadGeneration.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 26 Jun 2022.

Builds on

22 of 34 references.

References · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  6. 2017Decoupled Weight Decay Regularizationcited by 1,722
  7. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  8. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
  9. 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
  10. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  11. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
  12. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
10 more
  1. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
  2. 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
  3. 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 249
  4. 2018Talking Face Generation by Adversarially Disentangled Audio-Visual Representationcited by 212
  5. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  6. 2020Talking-head Generation with Rhythmic Head Motioncited by 112
  7. 2020Audio-driven Talking Face Video Generation with Learning-based Personalized Head Posecited by 92
  8. 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
  9. 2018Learning to Run challenge solutions: Adapting reinforcement learning methods for neuromusculoskeletal environmentscited by 19
  10. 2022ML4CO-KIDA: Knowledge Inheritance in Dataset Aggregationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 4; 2026: 2.

11 papers.

  1. 2024INFP: Audio-Driven Interactive Head Generation in Dyadic Conversationscited by 40
  2. 2024CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generationcited by 22
  3. 2023Emotional Listener Portrait: Neural Listener Head Generation with Emotioncited by 17
  4. 2026Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversationcited by 17
  5. 2023MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Modelcited by 16
  6. 2025ARIG: Autoregressive Interactive Head Generation for Real-time Conversationscited by 16
  7. 2025Towards Seamless Interaction: Causal Turn-Level Modeling of Interactive 3D Conversational Head Dynamicscited by 3
  8. 2025Multi-human Interactive Talking Datasetcited by 1
  9. 2024Leveraging WaveNet for Dynamic Listening Head Modeling from Speechcited by 0
  10. 2025Warm Chat: Diffuse Emotion-aware Interactive Talking Head Avatar with Tree-Structured Guidancecited by 0
  11. 2026Listening Deepfake Detection: A New Perspective Beyond Speaking-Centric Forgery Analysiscited by 0