HeadGAN: One-shot Neural Head Synthesis and Editing
Not on the map. Why?
Abstract (arXiv)
Recent attempts to solve the problem of head reenactment using a single reference image have shown promising results. However, most of them either perform poorly in terms of photo-realism, or fail to meet the identity preservation problem, or do not fully transfer the driving pose and expression. We propose HeadGAN, a novel system that conditions synthesis on 3D face representations, which can be extracted from any driving video and adapted to the facial geometry of any reference image, disentangling identity from expression. We further improve mouth movements, by utilising audio features as a complementary input. The 3D face representation enables HeadGAN to be further used as an efficient method for compression and reconstruction and a tool for expression and pose editing.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 20; 2023: 33; 2024: 26; 2025: 17; 2026: 9.
105 papers.
Sort:
By area:
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 81
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2023DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution Videocited by 73
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
- 2023FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Modelscited by 55
38 more
- 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
- 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
- 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesiscited by 48
- 2022Implicit Warping for Animation with Image Setscited by 45
- 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editingcited by 45
- 2023GAIA: Zero-shot Talking Avatar Generationcited by 43
- 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2023VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head Reenactmentcited by 33
- 2025MoCha: Towards Movie-Grade Talking Character Synthesiscited by 31
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
- 2023CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformercited by 24
- 2022PV3D: A 3D Generative Model for Portrait Video Generationcited by 23
- 20233D Cinemagraphy from a Single Imagecited by 23
- 2022FNeVR: Neural Volume Rendering for Face Animationcited by 22
- 2023InvertAvatar: Incremental GAN Inversion for Generalized Head Avatarscited by 19
- 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresencecited by 19
- 2022StyleMask: Disentangling the Style Space of StyleGAN2 for Neural Face Reenactmentcited by 17
- 2023Interactive Face Video Coding: A Generative Compression Frameworkcited by 17
- 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 17
- 2023AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collectionscited by 16
- 2024PersonaTalk: Bring Attention to Your Persona in Visual Dubbingcited by 15
- 2024Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communicationcited by 14
- 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Viewscited by 11
- 2022Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Controlcited by 10
- 2024DEGAS: Detailed Expressions on Full-Body Gaussian Avatarscited by 10
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2022StableFace: Analyzing and Improving Motion Stability for Talking Face Generationcited by 9
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generatorcited by 9
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2024Continuous Piecewise-Affine Based Motion Model for Image Animationcited by 8
- 2022Learning Detailed Radiance Manifolds for High-Fidelity and 3D-Consistent Portrait Synthesis from Monocular Imagecited by 7
- 2023Learning Motion Refinement for Unsupervised Face Animationcited by 7
- 2024A Review of Human Emotion Synthesis Based on Generative Technologycited by 7
- 2023Perceptual Quality Improvement in Videoconferencing using Keyframes-based GANcited by 6
50 most cited of 105 All 105 (JSON)
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images29 Jun 2026
- 2026MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation8 May 2026
- 2026PerformRecast: Expression and Head Pose Disentanglement for Portrait Video Editing20 Mar 2026
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editing16 Mar 2026
- 2026Motion Manipulation via Unsupervised Keypoint Positioning in Face Animation4 Mar 2026
- 2026ExpPortrait: Expressive Portrait Generation via Personalized Representation23 Feb 2026
- 2026MIRRORTALK: Forging Personalized Avatars Via Disentangled Style and Hierarchical Motion Control30 Jan 2026
- 2026One-Shot Feed-Forward 360circ Animatable Avatar via Inpainted UV-Space Gaussian Modeling19 Jan 2026
- 2026Instruction-Driven 3D Facial Expression Generation and Transition13 Jan 2026
- 2025SyncAnyone: Implicit Disentanglement via Progressive Self-Correction for Lip-Syncing in the wild25 Dec 2025
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint12 Dec 2025
38 more
- 2025AGORA: Adversarial Generation Of Real-time Animatable 3D Gaussian Head Avatars6 Dec 2025
- 2025Gaze Estimation for Human-Robot Interaction: Analysis Using the NICO Platform28 Sep 2025
- 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesis20 Sep 2025
- 2025Bitrate-Controlled Diffusion for Disentangling Motion and Content in Video10 Sep 2025
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attention30 Jul 2025
- 2025JOLT3D: Joint Learning of Talking Heads and 3DMM Parameters with Application to Lip-Sync28 Jul 2025
- 2025MirrorMe: Towards Realtime and High Fidelity Audio-Driven Halfbody Animation27 Jun 2025
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos27 Apr 2025
- 2025Exploiting Temporal Audio-Visual Correlation Embedding for Audio-Driven One-Shot Talking Head Animation8 Apr 2025
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance2 Apr 2025
- 2025MoCha: Towards Movie-Grade Talking Character Synthesis30 Mar 2025
- 2025Unlock Pose Diversity: Accurate and Efficient Implicit Keypoint-based Spatiotemporal Diffusion for Audio-driven Talking Portrait17 Mar 2025
- 2025Removing Averaging: Personalized Lip-Sync Driven Characters Based on Identity Adapter9 Mar 2025
- 2025Towards Consistent and Controllable Image Synthesis for Face Editing4 Feb 2025
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Models16 Dec 2024
- 2024Coherent3D: Coherent 3D Portrait Video Reconstruction via Triplane Fusion11 Dec 2024
- 2024A Review of Human Emotion Synthesis Based on Generative Technology10 Dec 2024
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024Towards High-Fidelity 3D Portrait Generation with Rich Details by Cross-View Prior-Aware Diffusion15 Nov 2024
- 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressions21 Oct 2024
- 2024PersonaTalk: Bring Attention to Your Persona in Visual Dubbing9 Sep 2024
- 2024DEGAS: Detailed Expressions on Full-Body Gaussian Avatars20 Aug 2024
- 2024FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model18 Aug 2024
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Models19 Jun 2024
- 2024A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editing15 Jun 2024
- 2024VOODOO XP: Expressive One-Shot Head Reenactment for VR Telepresence25 May 2024
- 2024Coherent 3D Portrait Video Reconstruction via Triplane Fusion1 May 2024
- 2024In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocol1 May 2024
- 20243DFlowRenderer: One-shot Face Re-enactment via Dense 3D Facial Flow Estimation23 Apr 2024
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesis5 Apr 2024
- 2024Beyond Talking -- Generating Holistic 3D Human Dyadic Motion for Communication28 Mar 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024DiffFAE: Advancing High-fidelity One-shot Facial Appearance Editing with Space-sensitive Customization and Semantic Preservation26 Mar 2024
- 2024AniArtAvatar: Animatable 3D Art Avatar from a Single Image26 Mar 2024
- 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis13 Mar 2024
- 2024One-shot Neural Face Reenactment via Finding Directions in GAN's Latent Space5 Feb 2024
- 2024EmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation2 Feb 2024
- 2024Personality Perception in Human Videos Altered by Motion Transfer Networks26 Jan 2024
50 newest of 105 All 105 (JSON)
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
- 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesiscited by 48
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generatorcited by 9
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2023DiT-Head: High-Resolution Talking Head Synthesis using Diffusion Transformerscited by 4
- 2024FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Modelcited by 3
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Modelscited by 1
- 2024Towards High-Fidelity 3D Portrait Generation with Rich Details by Cross-View Prior-Aware Diffusioncited by 1
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videoscited by 1
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpointcited by 1
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPScited by 0
12 most cited of 13 All 13 (JSON)
- 2026ExpPortrait: Expressive Portrait Generation via Personalized Representation23 Feb 2026
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint12 Dec 2025
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos27 Apr 2025
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Models16 Dec 2024
- 2024Towards High-Fidelity 3D Portrait Generation with Rich Details by Cross-View Prior-Aware Diffusion15 Nov 2024
- 2024FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model18 Aug 2024
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Models19 Jun 2024
- 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis13 Mar 2024
- 2023DiT-Head: High-Resolution Talking Head Synthesis using Diffusion Transformers11 Dec 2023
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications30 Aug 2023
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generator4 May 2023
12 newest of 13 All 13 (JSON)
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 81
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2023DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution Videocited by 73
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
- 2023FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Modelscited by 55
12 most cited of 91 All 91 (JSON)
- 2026FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images29 Jun 2026
- 2026MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation8 May 2026
- 2026PerformRecast: Expression and Head Pose Disentanglement for Portrait Video Editing20 Mar 2026
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editing16 Mar 2026
- 2026Motion Manipulation via Unsupervised Keypoint Positioning in Face Animation4 Mar 2026
- 2026MIRRORTALK: Forging Personalized Avatars Via Disentangled Style and Hierarchical Motion Control30 Jan 2026
- 2026One-Shot Feed-Forward 360circ Animatable Avatar via Inpainted UV-Space Gaussian Modeling19 Jan 2026
- 2026Instruction-Driven 3D Facial Expression Generation and Transition13 Jan 2026
- 2025SyncAnyone: Implicit Disentanglement via Progressive Self-Correction for Lip-Syncing in the wild25 Dec 2025
- 2025AGORA: Adversarial Generation Of Real-time Animatable 3D Gaussian Head Avatars6 Dec 2025
- 2025Gaze Estimation for Human-Robot Interaction: Analysis Using the NICO Platform28 Sep 2025
- 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesis20 Sep 2025
12 newest of 91 All 91 (JSON)