mlsanityData to 7 Oct 2026

Neural Head Reenactment with Latent Pose Descriptors

arXiv 2004.12000 ↗First posted 24 Apr 2020cs.CV cs.LGcited by 106

Not on the map. Why?

Abstract (arXiv)

We propose a neural head reenactment system, which is driven by a latent pose representation and is capable of predicting the foreground segmentation alongside the RGB image. The latent pose representation is learned as a part of the entire reenactment system, and the learning process is based solely on image reconstruction losses. We show that despite its simplicity, with a large and diverse enough training dataset, such learning successfully decomposes pose from identity. The resulting system can then reproduce mimics of the driving person and, furthermore, can perform cross-person reenactment. Additionally, we show that the learned descriptors are useful for other pose-related tasks, such as keypoint prediction and pose-based retrieval.

Key facts. Cited by 106 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 15; 2022: 22; 2023: 30; 2024: 18; 2025: 13; 2026: 8.

106 papers.

Sort:

By area:

  1. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  2. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  3. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
  4. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  5. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
  6. 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
  7. 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Modelcited by 151
  8. 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 148
  9. 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
  10. 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
  11. 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
  12. 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
38 more
  1. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  2. 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 65
  3. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  4. 2021Speech Drives Templates: Co-Speech Gesture Synthesis with Learned Templatescited by 57
  5. 2022Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priorscited by 55
  6. 2023Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Datacited by 55
  7. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  8. 2022SPACE: Speech-driven Portrait Animation with Controllable Expressioncited by 49
  9. 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
  10. 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
  11. 2022Implicit Warping for Animation with Image Setscited by 45
  12. 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editingcited by 45
  13. 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
  14. 2023GAIA: Zero-shot Talking Avatar Generationcited by 43
  15. 2025LAM: Large Avatar Model for One-shot Animatable Gaussian Headcited by 43
  16. 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
  17. 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
  18. 2022Structure-Aware Motion Transfer with Deformable Anchor Modelcited by 34
  19. 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
  20. 2021Learned Spatial Representations for Few-shot Talking-Head Synthesiscited by 32
  21. 2021LOHO: Latent Optimization of Hairstyles via Orthogonalizationcited by 30
  22. 2022Finding Directions in GAN's Latent Space for Neural Face Reenactmentcited by 27
  23. 2022Face Generation and Editing with StyleGAN: A Surveycited by 27
  24. 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
  25. 2021Sparse to Dense Motion Transfer for Face Image Animationcited by 25
  26. 2022FNeVR: Neural Volume Rendering for Face Animationcited by 22
  27. 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Textcited by 21
  28. 2022Few-Shot Head Swapping in the Wildcited by 20
  29. 2023DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 20
  30. 2023InvertAvatar: Incremental GAN Inversion for Generalized Head Avatarscited by 19
  31. 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
  32. 2024TALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Modelcited by 19
  33. 2022Video-driven Neural Physically-based Facial Asset for Productioncited by 17
  34. 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 17
  35. 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesiscited by 16
  36. 2025Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generationcited by 16
  37. 2024SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatarscited by 15
  38. 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15

50 most cited of 106 All 106 (JSON)