Head2Head: Video-based Neural Head Synthesis
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel machine learning architecture for facial reenactment. In particular, contrary to the model-based approaches or recent frame-based methods that use Deep Convolutional Neural Networks (DCNNs) to generate individual frames, we propose a novel method that (a) exploits the special structure of facial motion (paying particular attention to mouth motion) and (b) enforces temporal consistency. We demonstrate that the proposed method can transfer facial expressions, pose and gaze of a source actor to a target video in a photo-realistic fashion more accurately than state-of-the-art methods.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 12; 2023: 10; 2024: 8; 2025: 3; 2026: 1.
40 papers.
Sort:
By area:
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
- 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
- 2023HAvatar: High-fidelity Head Avatar via Facial Model Conditioned Neural Radiance Fieldcited by 37
28 more
- 2021FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animationcited by 33
- 2022Self-supervised Transformer for Deepfake Detectioncited by 22
- 2022FNeVR: Neural Volume Rendering for Face Animationcited by 22
- 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesiscited by 16
- 2024Tri2-plane: Thinking Head Avatar via Feature Pyramidcited by 16
- 2024Adaptive Super Resolution For One-Shot Talking-Head Generationcited by 15
- 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Viewscited by 11
- 2022Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Controlcited by 10
- 2023Text-image guided Diffusion Model for generating Deepfake celebrity interactionscited by 8
- 2024Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapescited by 8
- 2024FacialFlowNet: Advancing Facial Optical Flow Estimation with a Diverse Dataset and a Decomposed Modelcited by 7
- 2021Deep Semantic Manipulation of Facial Videoscited by 6
- 2022CoNFies: Controllable Neural Face Avatarscited by 4
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warpingcited by 4
- 2023MyPortrait: Morphable Prior-Guided Personalized Portrait Generationcited by 3
- 2024JEAN: Joint Expression and Audio-guided NeRF-based Talking Face Generationcited by 3
- 2022Geometry Driven Progressive Warping for One-Shot Face Animationcited by 2
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detectioncited by 2
- 2021Head2HeadFS: Video-based Head Reenactment with Few-shot Learningcited by 1
- 2022Dynamic Neural Portraitscited by 1
- 2023Controllable One-Shot Face Video Synthesis With Semantic Aware Priorcited by 1
- 2023Building an Invisible Shield for Your Portrait against Deepfakescited by 1
- 2024Low-Quality Image Detection by Hierarchical VAEcited by 1
- 2025Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Facescited by 1
- 2022Thinking the Fusion Strategy of Multi-reference Face Reenactmentcited by 0
- 2023Controllable Dynamic Appearance for Neural 3D Portraitscited by 0
- 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localizationcited by 0
- 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detectioncited by 0
- 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detection2 Jan 2026
- 2025Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Faces9 Oct 2025
- 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization3 Aug 2025
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detection16 Jan 2025
- 2024JEAN: Joint Expression and Audio-guided NeRF-based Talking Face Generation18 Sep 2024
- 2024FacialFlowNet: Advancing Facial Optical Flow Estimation with a Diverse Dataset and a Decomposed Model9 Sep 2024
- 2024Low-Quality Image Detection by Hierarchical VAE20 Aug 2024
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping20 May 2024
- 2024Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapes2 Apr 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024Adaptive Super Resolution For One-Shot Talking-Head Generation23 Mar 2024
- 2024Tri2-plane: Thinking Head Avatar via Feature Pyramid17 Jan 2024
28 more
- 2023MyPortrait: Morphable Prior-Guided Personalized Portrait Generation5 Dec 2023
- 2023HAvatar: High-fidelity Head Avatar via Facial Model Conditioned Neural Radiance Field29 Sep 2023
- 2023Text-image guided Diffusion Model for generating Deepfake celebrity interactions26 Sep 2023
- 2023Controllable Dynamic Appearance for Neural 3D Portraits20 Sep 2023
- 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Faces20 Jul 2023
- 2023Building an Invisible Shield for Your Portrait against Deepfakes22 May 2023
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatar2 May 2023
- 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Video1 May 2023
- 2023Controllable One-Shot Face Video Synthesis With Semantic Aware Prior27 Apr 2023
- 2023Face Animation with an Attribute-Guided Diffusion Model6 Apr 2023
- 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Views6 Dec 2022
- 2022Dynamic Neural Portraits25 Nov 2022
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxels23 Nov 2022
- 2022CoNFies: Controllable Neural Face Avatars16 Nov 2022
- 2022Geometry Driven Progressive Warping for One-Shot Face Animation5 Oct 2022
- 2022FNeVR: Neural Volume Rendering for Face Animation21 Sep 2022
- 2022Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Control3 Aug 2022
- 2022Delving into Sequential Patches for Deepfake Detection6 Jul 2022
- 2022RigNeRF: Fully Controllable Neural 3D Portraits13 Jun 2022
- 2022Voice-Face Homogeneity Tells Deepfake4 Mar 2022
- 2022Self-supervised Transformer for Deepfake Detection2 Mar 2022
- 2022Thinking the Fusion Strategy of Multi-reference Face Reenactment22 Feb 2022
- 2021Deep Semantic Manipulation of Facial Videos15 Nov 2021
- 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis5 Sep 2021
- 2021FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animation10 Aug 2021
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection20 Apr 2021
- 2021Head2HeadFS: Video-based Head Reenactment with Few-shot Learning30 Mar 2021
- 2021Multi-attentional Deepfake Detection3 Mar 2021
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detectioncited by 2
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detection16 Jan 2025
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
- 2023HAvatar: High-fidelity Head Avatar via Facial Model Conditioned Neural Radiance Fieldcited by 37
- 2021FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animationcited by 33
12 most cited of 37 All 37 (JSON)
- 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detection2 Jan 2026
- 2025Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Faces9 Oct 2025
- 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization3 Aug 2025
- 2024JEAN: Joint Expression and Audio-guided NeRF-based Talking Face Generation18 Sep 2024
- 2024FacialFlowNet: Advancing Facial Optical Flow Estimation with a Diverse Dataset and a Decomposed Model9 Sep 2024
- 2024Low-Quality Image Detection by Hierarchical VAE20 Aug 2024
- 2024Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping20 May 2024
- 2024Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapes2 Apr 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024Adaptive Super Resolution For One-Shot Talking-Head Generation23 Mar 2024
- 2024Tri2-plane: Thinking Head Avatar via Feature Pyramid17 Jan 2024
- 2023MyPortrait: Morphable Prior-Guided Personalized Portrait Generation5 Dec 2023
12 newest of 37 All 37 (JSON)