ReenactGAN: Learning to Reenact Faces via Boundary Transfer
Not on the map. Why?
Abstract (arXiv)
We present a novel learning-based framework for face reenactment. The proposed method, known as ReenactGAN, is capable of transferring facial movements and expressions from monocular video input of an arbitrary person to a target person. Instead of performing a direct transfer in the pixel space, which could result in structural artifacts, we first map the source face onto a boundary latent space. A transformer is subsequently used to adapt the boundary of source face to the boundary of target face. Finally, a target-specific decoder is used to generate the reenacted target face. Thanks to the effective and reliable boundary-based transfer, our method can perform photo-realistic face reenactment. In addition, ReenactGAN is appealing in that the whole reenactment process is purely feed-forward, and thus the reenactment process can run in real-time (30 FPS on one GTX 1080 GPU). Dataset and model will be publicly available at https://wywu.github.io/projects/ReenactGAN/ReenactGAN.html
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 27; 2023: 15; 2024: 10; 2025: 7; 2026: 1.
85 papers.
Sort:
By area:
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Modelcited by 151
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 103
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2021Face Forensics in the Wildcited by 87
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
38 more
- 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
- 2023Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generationcited by 61
- 2022MARLIN: Masked Autoencoder for facial video Representation LearnINgcited by 55
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 48
- 2021Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generationcited by 46
- 2022Implicit Warping for Animation with Image Setscited by 45
- 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editingcited by 45
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 37
- 2024Generative Artificial Intelligence: A Systematic Review and Applicationscited by 37
- 2021Initiative Defense against Facial Manipulationcited by 36
- 2022FSGANv2: Improved Subject Agnostic Face Swapping and Reenactmentcited by 33
- 2021Learned Spatial Representations for Few-shot Talking-Head Synthesiscited by 32
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarkscited by 21
- 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesiscited by 16
- 2023Emotionally Enhanced Talking Face Generationcited by 14
- 2024FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Featurescited by 14
- 2021Image-to-Video Generation via 3D Facial Dynamicscited by 13
- 2021One-shot Face Reenactment Using Appearance Adaptive Normalizationcited by 12
- 2022Learning Disentangled Representation for One-shot Progressive Face Swappingcited by 12
- 2021UniFaceGAN: A Unified Framework for Temporally Consistent Facial Video Editingcited by 11
- 2023AgentAvatar: Disentangling Planning, Driving and Rendering for Photorealistic Avatar Agentscited by 11
- 2021Everything's Talkin': Pareidolia Face Reenactmentcited by 10
- 2022Compressing Video Calls using Synthetic Talking Headscited by 10
- 2023Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesiscited by 10
- 2021Metric Learning for Anti-Compression Facial Forgery Detectioncited by 9
- 2021LI-Net: Large-Pose Identity-Preserving Face Reenactment Networkcited by 9
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generatorcited by 9
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2023POCE: Pose-Controllable Expression Editingcited by 8
- 2023Text-image guided Diffusion Model for generating Deepfake celebrity interactionscited by 8
- 2024Diffusion Deepfakecited by 8
- 2024Thinking Racial Bias in Fair Forgery Detection: Models, Datasets and Evaluationscited by 8
- 2024Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generationcited by 8
- 2021Neural Network Libraries: A Deep Learning Framework Designed from Engineers' Perspectivescited by 6
50 most cited of 85 All 85 (JSON)
- 2026PartNerFace: Part-based Neural Radiance Fields for Animatable Facial Avatar Reconstruction15 Apr 2026
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025FakeParts: a New Family of AI-Generated DeepFakes28 Aug 2025
- 2025EmoCAST: Emotional Talking Portrait via Emotive Text Description28 Aug 2025
- 2025Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functions23 Jun 2025
- 2025Contrastive Desensitization Learning for Cross Domain Face Forgery Detection27 May 2025
- 20253D Engine-ready Photorealistic Avatars via Dynamic Textures19 Mar 2025
- 2025Learning Semantic Facial Descriptors for Accurate Face Animation29 Jan 2025
- 2024Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation1 Dec 2024
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarks26 Nov 2024
- 2024Thinking Racial Bias in Fair Forgery Detection: Models, Datasets and Evaluations19 Jul 2024
- 2024Learning Online Scale Transformation for Talking Head Video Generation13 Jul 2024
38 more
- 2024A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editing15 Jun 2024
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detection13 Jun 2024
- 2024Generative Artificial Intelligence: A Systematic Review and Applications17 May 2024
- 2024FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features15 Apr 2024
- 2024Diffusion Deepfake2 Apr 2024
- 2024AniArtAvatar: Animatable 3D Art Avatar from a Single Image26 Mar 2024
- 2023AgentAvatar: Disentangling Planning, Driving and Rendering for Photorealistic Avatar Agents29 Nov 2023
- 2023Perceptual Quality Improvement in Videoconferencing using Keyframes-based GAN7 Nov 2023
- 2023Text-image guided Diffusion Model for generating Deepfake celebrity interactions26 Sep 2023
- 2023Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis31 Aug 2023
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications30 Aug 2023
- 2023Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generation19 Jul 2023
- 2023IFaceUV: Intuitive Motion Facial Image Generation by Identity Preservation via UV map8 Jun 2023
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars22 May 2023
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generator4 May 2023
- 2023High-Fidelity and Freely Controllable Talking Head Video Generation20 Apr 2023
- 2023POCE: Pose-Controllable Expression Editing18 Apr 2023
- 2023CelebV-Text: A Large-Scale Facial Text-Video Dataset26 Mar 2023
- 2023Emotionally Enhanced Talking Face Generation21 Mar 2023
- 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANs23 Feb 2023
- 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editing16 Jan 2023
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection12 Dec 2022
- 2022GLeaD: Improving GANs with A Generator-Leading Task7 Dec 2022
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunities26 Nov 2022
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesis26 Nov 2022
- 2022CGOF++: Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields23 Nov 2022
- 2022Semantic-aware One-shot Face Re-enactment with Dense Correspondence Estimation23 Nov 2022
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspective20 Nov 2022
- 2022MARLIN: Masked Autoencoder for facial video Representation LearnINg12 Nov 2022
- 2022HOReeNet: 3D-aware Hand-Object Grasping Reenactment11 Nov 2022
- 2022GGViT:Multistream Vision Transformer Network in Face2Face Facial Reenactment Detection12 Oct 2022
- 2022Compressing Video Calls using Synthetic Talking Heads7 Oct 2022
- 2022Implicit Warping for Animation with Image Sets4 Oct 2022
- 2022Synthesizing Photorealistic Virtual Humans Through Cross-modal Disentanglement3 Sep 2022
- 2022FaceOff: A Video-to-Video Face Swapping System21 Aug 2022
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Dataset25 Jul 2022
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields16 Jun 2022
- 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model30 May 2022
50 newest of 85 All 85 (JSON)
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generatorcited by 9
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2023Text-image guided Diffusion Model for generating Deepfake celebrity interactionscited by 8
- 2024Diffusion Deepfakecited by 8
- 2024Diffusion Deepfake2 Apr 2024
- 2023Text-image guided Diffusion Model for generating Deepfake celebrity interactions26 Sep 2023
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications30 Aug 2023
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generator4 May 2023
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Modelcited by 151
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 103
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2021Face Forensics in the Wildcited by 87
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
12 most cited of 79 All 79 (JSON)
- 2026PartNerFace: Part-based Neural Radiance Fields for Animatable Facial Avatar Reconstruction15 Apr 2026
- 2025A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques9 Dec 2025
- 2025FakeParts: a New Family of AI-Generated DeepFakes28 Aug 2025
- 2025EmoCAST: Emotional Talking Portrait via Emotive Text Description28 Aug 2025
- 2025Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functions23 Jun 2025
- 2025Contrastive Desensitization Learning for Cross Domain Face Forgery Detection27 May 2025
- 20253D Engine-ready Photorealistic Avatars via Dynamic Textures19 Mar 2025
- 2025Learning Semantic Facial Descriptors for Accurate Face Animation29 Jan 2025
- 2024Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation1 Dec 2024
- 2024Thinking Racial Bias in Fair Forgery Detection: Models, Datasets and Evaluations19 Jul 2024
- 2024Learning Online Scale Transformation for Talking Head Video Generation13 Jul 2024
- 2024A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editing15 Jun 2024
12 newest of 79 All 79 (JSON)