FSGAN: Subject Agnostic Face Swapping and Reenactment
Not on the map. Why?
Abstract (arXiv)
We present Face Swapping GAN (FSGAN) for face swapping and reenactment. Unlike previous work, FSGAN is subject agnostic and can be applied to pairs of faces without requiring training on those faces. To this end, we describe a number of technical contributions. We derive a novel recurrent neural network (RNN)-based approach for face reenactment which adjusts for both pose and expression variations and can be applied to a single image or a video sequence. For video sequences, we introduce continuous interpolation of the face views based on reenactment, Delaunay Triangulation, and barycentric coordinates. Occluded face regions are handled by a face completion network. Finally, we use a face blending network for seamless blending of the two faces while preserving target skin color and lighting conditions. This network uses a novel Poisson blending loss which combines Poisson optimization with perceptual loss. We compare our approach to existing state-of-the-art systems and show our results to be both qualitatively and quantitatively superior.
Key facts. Cited by 319 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 68; 2022: 66; 2023: 57; 2024: 59; 2025: 44; 2026: 25.
319 papers.
Sort:
By area:
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2021Motion Representations for Articulated Animationcited by 253
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 179
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 148
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
38 more
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
- 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
- 2021Face Forensics in the Wildcited by 87
- 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 84
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
- 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 66
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2021Deepfake Detection by Human Crowds, Machines, and Machine-informed Crowdscited by 58
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2022High-resolution Face Swapping via Latent Semantics Disentanglementcited by 57
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
- 2023Multimodal Automated Fact-Checking: A Surveycited by 51
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 48
- 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesiscited by 48
- 2024Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detectioncited by 47
- 2021Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generationcited by 46
- 2022Region-Aware Face Swappingcited by 45
- 2022Implicit Warping for Animation with Image Setscited by 45
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2022FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swappingcited by 44
- 2022Audio-Visual Person-of-Interest DeepFake Detectioncited by 43
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 42
- 2022MobileFaceSwap: A Lightweight Framework for Video Face Swappingcited by 39
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
50 most cited of 319 All 319 (JSON)
- 2026Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos11 Sep 2026
- 2026Foundation Models are Implicit Deepfake Detectors10 Aug 2026
- 2026SRAP: SVD-Refined Adversarial Perturbations for Imperceptible Face-Swap Defense4 Aug 2026
- 2026CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection18 Jun 2026
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detection27 May 2026
- 2026Loki: Representation over Architecture for Diffusion-Based Portrait Animation22 May 2026
- 2026Are DeepFakes Realistic Enough? Exploring Semantic Mismatch as a Novel Challenge30 Apr 2026
- 2026Attribution-Guided Multimodal Deepfake Detection via Cross-Modal Forensic Fingerprints29 Apr 2026
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026Robust Deepfake Detection, NTIRE 2026 Challenge: Report27 Apr 2026
- 2026Unveiling Deepfakes: A Frequency-Aware Triple Branch Network for Deepfake Detection19 Apr 2026
- 2026Generalizable Face Forgery Detection via Separable Prompt Learning19 Apr 2026
38 more
- 2026CIPHER: Counterfeit Image Pattern High-level Examination via Representation31 Mar 2026
- 2026Leave No Stone Unturned: Uncovering Holistic Audio-Visual Intrinsic Coherence for Deepfake Detection25 Mar 2026
- 2026SAiW: Source-Attributable Invisible Watermarking for Proactive Deepfake Defense24 Mar 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026Human-AI Ensembles Improve Deepfake Detection in Low-to-Medium Quality Videos15 Mar 2026
- 2026Improving Generative Adversarial Network Generalization for Facial Expression Synthesis4 Mar 2026
- 2026Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection2 Mar 2026
- 2026AlphaFace: High Fidelity and Real-time Face Swapper Robust to Facial Pose23 Jan 2026
- 2026APPLE: Attribute-Preserving Pseudo-Labeling for Diffusion-Based Face Swapping21 Jan 2026
- 2026Deep Learning Based Facial Retargeting Using Local Patches13 Jan 2026
- 2026GaussianSwap: Animatable Video Face Swapping with 3D Gaussian Splatting9 Jan 2026
- 2026ExposeAnyone: Personalized Audio-to-Expression Diffusion Models Are Robust Zero-Shot Face Forgery Detectors5 Jan 2026
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer4 Jan 2026
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning14 Dec 2025
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint12 Dec 2025
- 2025Towards Robust Protective Perturbation against DeepFake Face Swapping8 Dec 2025
- 2025Open Set Face Forgery Detection via Dual-Level Evidence Collection3 Dec 2025
- 2025Do You See What I Say? Generalizable Deepfake Detection based on Visual Speech Recognition27 Nov 2025
- 2025Towards Generalizable Deepfake Detection via Forgery-aware Audio-Visual Adaptation: A Variational Bayesian Approach24 Nov 2025
- 2025Investigating self-supervised representations for audio-visual deepfake detection21 Nov 2025
- 2025Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localization13 Nov 2025
- 2025Referee: Reference-aware Audiovisual Deepfake Detection31 Oct 2025
- 2025PIA: Deepfake Detection Using Phoneme-Temporal and Identity-Dynamic Analysis16 Oct 2025
- 2025R2M: Real-Aware Residual Model Merging for Robust and Generalizable Deepfake Detection29 Sep 2025
- 2025PerFace: Metric Learning in Perceptual Facial Similarity for Enhanced Face Anonymization24 Sep 2025
- 2025Is It Certainly a Deepfake? Reliability Analysis in Detection & Generation Ecosystem22 Sep 2025
- 2025MFFI: Multi-Dimensional Face Forgery Image Dataset for Real-World Scenarios6 Sep 2025
- 2025FakeParts: a New Family of AI-Generated DeepFakes28 Aug 2025
- 2025Improving Generalization in Deepfake Detection with Face Foundation Models and Metric Learning27 Aug 2025
- 2025SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detection13 Aug 2025
- 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization3 Aug 2025
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2025Robust Deepfake Detection for Electronic Know Your Customer Systems Using Registered Images30 Jul 2025
- 2025Visual Language Models as Zero-Shot Deepfake Detectors30 Jul 2025
- 2025Evaluating Deepfake Detectors in the Wild29 Jul 2025
- 2025Seeing Through Deepfakes: A Human-Inspired Framework for Multi-Face Detection20 Jul 2025
- 2025Detecting Deepfake Talking Heads from Facial Biometric Anomalies11 Jul 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
50 newest of 319 All 319 (JSON)
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 66
- 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesiscited by 48
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 35
- 2024Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectorscited by 17
- 2024IDOL: Unified Dual-Modal Latent Diffusion for Human-Centric Joint Video-Depth Generationcited by 11
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformercited by 9
- 2023Text-image guided Diffusion Model for generating Deepfake celebrity interactionscited by 8
- 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunitiescited by 7
12 most cited of 17 All 17 (JSON)
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026CIPHER: Counterfeit Image Pattern High-level Examination via Representation31 Mar 2026
- 2026ExposeAnyone: Personalized Audio-to-Expression Diffusion Models Are Robust Zero-Shot Face Forgery Detectors5 Jan 2026
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer4 Jan 2026
- 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint12 Dec 2025
- 2025My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swapping21 May 2025
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectors12 Nov 2024
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep 2024
- 2024IDOL: Unified Dual-Modal Latent Diffusion for Human-Centric Joint Video-Depth Generation15 Jul 2024
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control21 May 2024
- 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunities25 Apr 2024
12 newest of 17 All 17 (JSON)
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarkscited by 21
- 2022FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakescited by 18
- 2024Social Media Authentication and Combating Deepfakes using Semi-fragile Invisible Image Watermarkingcited by 5
- 2026SAiW: Source-Attributable Invisible Watermarking for Proactive Deepfake Defensecited by 0
- 2026SAiW: Source-Attributable Invisible Watermarking for Proactive Deepfake Defense24 Mar 2026
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarks26 Nov 2024
- 2024Social Media Authentication and Combating Deepfakes using Semi-fragile Invisible Image Watermarking2 Oct 2024
- 2022FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes5 Apr 2022
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detectioncited by 2
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detection16 Jan 2025
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2021Motion Representations for Articulated Animationcited by 253
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 179
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 148
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
12 most cited of 294 All 294 (JSON)
- 2026Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos11 Sep 2026
- 2026Foundation Models are Implicit Deepfake Detectors10 Aug 2026
- 2026SRAP: SVD-Refined Adversarial Perturbations for Imperceptible Face-Swap Defense4 Aug 2026
- 2026CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection18 Jun 2026
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detection27 May 2026
- 2026Loki: Representation over Architecture for Diffusion-Based Portrait Animation22 May 2026
- 2026Are DeepFakes Realistic Enough? Exploring Semantic Mismatch as a Novel Challenge30 Apr 2026
- 2026Attribution-Guided Multimodal Deepfake Detection via Cross-Modal Forensic Fingerprints29 Apr 2026
- 2026Robust Deepfake Detection, NTIRE 2026 Challenge: Report27 Apr 2026
- 2026Unveiling Deepfakes: A Frequency-Aware Triple Branch Network for Deepfake Detection19 Apr 2026
- 2026Generalizable Face Forgery Detection via Separable Prompt Learning19 Apr 2026
- 2026Leave No Stone Unturned: Uncovering Holistic Audio-Visual Intrinsic Coherence for Deepfake Detection25 Mar 2026
12 newest of 294 All 294 (JSON)