Fast Face-swap Using Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
We consider the problem of face swapping in images, where an input identity is transformed into a target identity while preserving pose, facial expression, and lighting. To perform this mapping, we use convolutional neural networks trained to capture the appearance of the target identity from an unstructured collection of his/her photographs.This approach is enabled by framing the face swapping problem in terms of style transfer, where the goal is to render an image in the style of another one. Building on recent advances in this area, we devise a new loss function that enables the network to produce highly photorealistic results. By combining neural networks with simple pre- and post-processing steps, we aim at making face swap work in real-time with no input from the user.
Key facts. Cited by 119 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 22; 2023: 24; 2024: 21; 2025: 16; 2026: 10.
119 papers.
Sort:
By area:
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 179
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
- 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 84
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
38 more
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
- 2022High-resolution Face Swapping via Latent Semantics Disentanglementcited by 57
- 2023LatentAvatar: Learning Latent Expression Code for Expressive Neural Head Avatarcited by 50
- 2021FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learningcited by 43
- 2022Audio-Visual Person-of-Interest DeepFake Detectioncited by 43
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 42
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
- 2021Initiative Defense against Facial Manipulationcited by 36
- 2022On Improving Cross-dataset Generalization of Deepfake Detectorscited by 34
- 2021Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectorscited by 32
- 2021Towards Solving the DeepFake Problem : An Analysis on Improving DeepFake Detection using Dynamic Face Augmentationcited by 25
- 2022Restricted Black-box Adversarial Attack Against DeepFake Face Swappingcited by 25
- 2021Exploring Adversarial Fake Images on Face Manifoldcited by 24
- 2021A Comprehensive Review of Deep Learning-based Single Image Super-resolutioncited by 23
- 2021Deepfake Videos in the Wild: Analysis and Detectioncited by 23
- 2023DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Cluescited by 23
- 2024Circumventing shortcuts in audio-visual deepfake detection datasets with unsupervised learningcited by 23
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarkscited by 21
- 2023Detecting Deepfakes Without Seeing Anycited by 17
- 2024Exposing Lip-syncing Deepfakes from Mouth Inconsistenciescited by 15
- 2022My Face My Choice: Privacy Enhancing Deepfakes for Social Media Anonymizationcited by 14
- 2022Learning Disentangled Representation for One-shot Progressive Face Swappingcited by 12
- 2023GenConViT: Deepfake Video Detection Using Generative Convolutional Vision Transformercited by 12
- 2021UniFaceGAN: A Unified Framework for Temporally Consistent Facial Video Editingcited by 11
- 2021GCA-Net : Utilizing Gated Context Attention for Improving Image Forgery Localization and Detectioncited by 11
- 2023Face Transformer: Towards High Fidelity and Accurate Face Swappingcited by 11
- 2023Reinforced Disentanglement for Face Swapping without Skip Connectioncited by 10
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2021Metric Learning for Anti-Compression Facial Forgery Detectioncited by 9
- 2021Markpainting: Adversarial Machine Learning meets Inpaintingcited by 9
- 2023Information-containing Adversarial Perturbation for Combating Facial Manipulation Systemscited by 9
- 2023Deepfake detection by exploiting surface anomalies: the SurFake approachcited by 9
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detectioncited by 9
- 2023ReliableSwap: Boosting General Face Swapping Via Reliable Supervisioncited by 8
- 2023AVTENet: A Human-Cognition-Inspired Audio-Visual Transformer-Based Ensemble Network for Video Deepfake Detectioncited by 8
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversioncited by 8
- 2024Diffusion Deepfakecited by 8
- 2025NullSwap: Proactive Identity Cloaking Against Deepfake Face Swappingcited by 8
50 most cited of 119 All 119 (JSON)
- 2026Why Fake ? Unveiling the Semantic Vocabulary of Deepfake Detectors8 Jul 2026
- 2026VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detection7 Jul 2026
- 2026CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection18 Jun 2026
- 2026Revealing Artifacts via Noise Amplification: A Novel Perspective for AI-Generated Video Detection15 Jun 2026
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detection27 May 2026
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026Leave No Stone Unturned: Uncovering Holistic Audio-Visual Intrinsic Coherence for Deepfake Detection25 Mar 2026
- 2026Architecture-Agnostic Feature Synergy for Universal Defense Against Heterogeneous Generative Threats16 Mar 2026
- 2026EvolveReason: Self-Evolving Reasoning Paradigm for Explainable Deepfake Facial Image Identification8 Mar 2026
- 2026R2BD: A Reconstruction-Based Method for Generalizable and Efficient Detection of Fake Images11 Jan 2026
- 2025Open Set Face Forgery Detection via Dual-Level Evidence Collection3 Dec 2025
- 2025Do You See What I Say? Generalizable Deepfake Detection based on Visual Speech Recognition27 Nov 2025
38 more
- 2025Investigating self-supervised representations for audio-visual deepfake detection21 Nov 2025
- 2025Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localization13 Nov 2025
- 2025PIA: Deepfake Detection Using Phoneme-Temporal and Identity-Dynamic Analysis16 Oct 2025
- 2025ROFI: A Deep Learning-Based Ophthalmic Sign-Preserving and Reversible Patient Face Anonymizer13 Oct 2025
- 2025Forgery Guided Learning Strategy with Dual Perception Network for Deepfake Cross-domain Detection14 Aug 2025
- 2025SpeechForensics: Audio-Visual Speech Representation Learning for Face Forgery Detection13 Aug 2025
- 2025Robust Deepfake Detection for Electronic Know Your Customer Systems Using Registered Images30 Jul 2025
- 2025ViGText: Deepfake Image Detection with Vision-Language Model Explanations and Graph Neural Networks24 Jul 2025
- 2025CAST: Cross-Attentive Spatio-Temporal feature fusion for deepfake detection26 Jun 2025
- 2025DeepFake Doctor: Diagnosing and Treating Audio-Video Fake Detection6 Jun 2025
- 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillation21 May 2025
- 2025Detecting Lip-Syncing Deepfakes: Vision Temporal Transformer for Analyzing Mouth Inconsistencies2 Apr 2025
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidence26 Mar 2025
- 2025NullSwap: Proactive Identity Cloaking Against Deepfake Face Swapping24 Mar 2025
- 2024Circumventing shortcuts in audio-visual deepfake detection datasets with unsupervised learning29 Nov 2024
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarks26 Nov 2024
- 2024How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and Human Perception14 Nov 2024
- 2024Capture Artifacts via Progressive Disentangling and Purifying Blended Identities for Deepfake Detection14 Oct 2024
- 2024Detecting Audio-Visual Deepfakes with Fine-Grained Inconsistencies13 Aug 2024
- 2024WWW: Where, Which and Whatever Enhancing Interpretability in Multimodal Deepfake Detection6 Aug 2024
- 2024A Multi-Stream Fusion Approach with One-Class Learning for Audio-Visual Deepfake Detection20 Jun 2024
- 2024Principles of Designing Robust Remote Face Anti-Spoofing Systems6 Jun 2024
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection5 Jun 2024
- 2024Exploring AI-based Anonymization of Industrial Image and Video Data in the Context of Feature Preservation29 May 2024
- 2024Unmasking Illusions: Understanding Human Perception of Audiovisual Deepfakes7 May 2024
- 2024Explicit Correlation Learning for Generalizable Cross-Modal Deepfake Detection30 Apr 2024
- 2024Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet19 Apr 2024
- 2024Diffusion Deepfake2 Apr 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024Deepfake for the Good: Generating Avatars through Face-Swapping with Implicit Deepfake Generation9 Feb 2024
- 2024Towards mitigating uncann(eye)ness in face swaps via gaze-centric loss terms5 Feb 2024
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detection1 Feb 2024
- 2024Detecting Multimedia Generated by Large AI Models: A Survey22 Jan 2024
- 2024Exposing Lip-syncing Deepfakes from Mouth Inconsistencies18 Jan 2024
- 2023High-Fidelity Face Swapping with Style Blending17 Dec 2023
- 2023Vulnerability of Automatic Identity Recognition to Audio-Visual Deepfakes29 Nov 2023
- 2023AV-Lip-Sync+: Leveraging AV-HuBERT to Exploit Multimodal Inconsistency for Deepfake Detection of Frontal Face Videos5 Nov 2023
50 newest of 119 All 119 (JSON)
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detectioncited by 9
- 2024Diffusion Deepfakecited by 8
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
- 2026R2BD: A Reconstruction-Based Method for Generalizable and Efficient Detection of Fake Imagescited by 0
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026R2BD: A Reconstruction-Based Method for Generalizable and Efficient Detection of Fake Images11 Jan 2026
- 2024Diffusion Deepfake2 Apr 2024
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detection1 Feb 2024
- 2024Detecting Multimedia Generated by Large AI Models: A Survey22 Jan 2024
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 179
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
- 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 84
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
12 most cited of 109 All 109 (JSON)
- 2026Why Fake ? Unveiling the Semantic Vocabulary of Deepfake Detectors8 Jul 2026
- 2026CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection18 Jun 2026
- 2026Revealing Artifacts via Noise Amplification: A Novel Perspective for AI-Generated Video Detection15 Jun 2026
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detection27 May 2026
- 2026Leave No Stone Unturned: Uncovering Holistic Audio-Visual Intrinsic Coherence for Deepfake Detection25 Mar 2026
- 2026Architecture-Agnostic Feature Synergy for Universal Defense Against Heterogeneous Generative Threats16 Mar 2026
- 2025Open Set Face Forgery Detection via Dual-Level Evidence Collection3 Dec 2025
- 2025Do You See What I Say? Generalizable Deepfake Detection based on Visual Speech Recognition27 Nov 2025
- 2025Investigating self-supervised representations for audio-visual deepfake detection21 Nov 2025
- 2025Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localization13 Nov 2025
- 2025PIA: Deepfake Detection Using Phoneme-Temporal and Identity-Dynamic Analysis16 Oct 2025
- 2025ROFI: A Deep Learning-Based Ophthalmic Sign-Preserving and Reversible Patient Face Anonymizer13 Oct 2025
12 newest of 109 All 109 (JSON)