mlsanityData to 13 Oct 2026

Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars

arXiv 2008.10174 ↗First posted 24 Aug 2020cs.CV cs.GR cs.LGcited by 118

Not on the map. Why?

Abstract (arXiv)

We propose a neural rendering-based system that creates head avatars from a single photograph. Our approach models a person's appearance by decomposing it into two layers. The first layer is a pose-dependent coarse image that is synthesized by a small neural network. The second layer is defined by a pose-independent texture image that contains high-frequency details. The texture image is generated offline, warped and added to the coarse image to ensure a high effective resolution of synthesized head views. We compare our system to analogous state-of-the-art systems in terms of visual quality and speed. The experiments show significant inference speedup over previous neural head avatar models for a given visual quality. We also report on a real-time smartphone-based implementation of our system.

Key facts. Cited by 118 papers in the map (data through 13 Oct 2026). First posted on arXiv 24 Aug 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2021: 19; 2022: 37; 2023: 25; 2024: 25; 2025: 8; 2026: 4.

118 papers.

Sort:

By area:

  1. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  2. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 247
  3. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  4. 2021Neural Head Avatars from Monocular RGB Videoscited by 213
  5. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  6. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 199
  7. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  8. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
  9. 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
  10. 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Modelcited by 151
  11. 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
  12. 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
38 more
  1. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 121
  2. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  3. 2024GPAvatar: Generalizable and Precise Head Avatar from Image(s)cited by 74
  4. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
  5. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  6. 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
  7. 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 65
  8. 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
  9. 2023Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generationcited by 61
  10. 20223D GAN Inversion for Controllable Portrait Image Animationcited by 53
  11. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  12. 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
  13. 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
  14. 2022Implicit Warping for Animation with Image Setscited by 45
  15. 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editingcited by 45
  16. 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
  17. 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videoscited by 44
  18. 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
  19. 2022FSGANv2: Improved Subject Agnostic Face Swapping and Reenactmentcited by 33
  20. 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
  21. 2021Learned Spatial Representations for Few-shot Talking-Head Synthesiscited by 32
  22. 2022Finding Directions in GAN's Latent Space for Neural Face Reenactmentcited by 27
  23. 2021Efficient Video Compression via Content-Adaptive Super-Resolutioncited by 26
  24. 2021Sparse to Dense Motion Transfer for Face Image Animationcited by 25
  25. 2022Towards Realistic Visual Dubbing with Heterogeneous Sourcescited by 24
  26. 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
  27. 2022FNeVR: Neural Volume Rendering for Face Animationcited by 22
  28. 2023Generalizable One-shot Neural Head Avatarcited by 21
  29. 2021VoxCeleb Enrichment for Age and Gender Recognitioncited by 20
  30. 2021SAFA: Structure Aware Face Animationcited by 20
  31. 2022Few-Shot Head Swapping in the Wildcited by 20
  32. 2022DINER: Depth-aware Image-based NEural Radiance fieldscited by 19
  33. 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
  34. 2021Multi-Exit Semantic Segmentation Networkscited by 18
  35. 2023Unsupervised Volumetric Animationcited by 18
  36. 2025MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesiscited by 18
  37. 2022StyleMask: Disentangling the Style Space of StyleGAN2 for Neural Face Reenactmentcited by 17
  38. 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 17

50 most cited of 118 All 118 (JSON)