Deepfake Forensics via An Adversarial Game
Not on the map. Why?
Abstract (arXiv)
With the progress in AI-based facial forgery (i.e., deepfake), people are increasingly concerned about its abuse. Albeit effort has been made for training classification (also known as deepfake detection) models to recognize such forgeries, existing models suffer from poor generalization to unseen forgery technologies and high sensitivity to changes in image/video quality. In this paper, we advocate adversarial training for improving the generalization ability to both unseen facial forgeries and unseen image/video qualities. We believe training with samples that are adversarially crafted to attack the classification models improves the generalization ability considerably. Considering that AI-based face manipulation often leads to high-frequency artifacts that can be easily spotted by models yet difficult to generalize, we further propose a new adversarial training method that attempts to blur out these specific artifacts, by introducing pixel-wise Gaussian blurring models. With adversarial training, the classification models are forced to learn more discriminative and generalizable features, and the effectiveness of our method can be verified by plenty of empirical evidence. Our code will be made publicly available.
Key facts. Cited by 15 papers in the map (data through 13 Oct 2026). Builds on 36 of its 60 references that are in the map. First posted on arXiv 25 Mar 2021.
Builds on
36 of 60 references.
References · 36
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
- 2014Explaining and Harnessing Adversarial Examplescited by 7,336
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,426
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,379
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,457
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,326
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,265
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,097
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2016Adversarial Machine Learning at Scalecited by 935
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 846
24 more
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 769
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 574
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021Multi-attentional Deepfake Detectioncited by 340
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2017Temporal Segment Networks for Action Recognition in Videoscited by 279
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
- 2018Spatially Transformed Adversarial Examplescited by 195
- 2019Are Labels Required for Improving Adversarial Robustness?cited by 163
- 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
- 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 119
- 2017The Numerics of GANscited by 104
- 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
- 2020Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examplescited by 66
- 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
- 2017Recasting Residual-based Local Descriptors as Convolutional Neural Networks: an Application to Image Forgery Detectioncited by 56
- 2016Automatic Face Reenactmentcited by 43
- 2019What Else Can Fool Deep Learning? Addressing Color Constancy Errors on Deep Neural Network Performancecited by 37
- 2019Towards Generalizable Deepfake Detection with Locality-aware AutoEncodercited by 17
Built on by
Citing papers per year: 2022: 3; 2023: 5; 2024: 4; 2025: 2; 2026: 1.
15 papers.
Sort:
By area:
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2026How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark studycited by 15
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Tracescited by 12
- 2022Detecting Deepfake by Creating Spatio-Temporal Regularity Disruptioncited by 3
- 2023Improving Transferability of Adversarial Examples via Bayesian Attackscited by 3
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversioncited by 3
- 2023Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detectioncited by 2
- 2023Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detectioncited by 2
- 2025Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localizationcited by 2
- 2022ARIA: Adversarially Robust Image Attribution for Content Provenancecited by 1
- 2023DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detectioncited by 1
- 2025Cross-Branch Orthogonality for Improved Generalization in Face Deepfake Detectioncited by 1
3 more
- 2023Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Facescited by 0
- 2024Datasets, Clues and State-of-the-Arts for Multimedia Forensics: An Extensive Reviewcited by 0
- 2024Revisiting Face Forgery Detection: From Facial Representation to Forgery Detectioncited by 0
- 2026How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark study8 Feb 2026
- 2025Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localization13 Nov 2025
- 2025Cross-Branch Orthogonality for Improved Generalization in Face Deepfake Detection8 May 2025
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversion3 Oct 2024
- 2024Revisiting Face Forgery Detection: From Facial Representation to Forgery Detection25 Sep 2024
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Traces24 Jan 2024
- 2024Datasets, Clues and State-of-the-Arts for Multimedia Forensics: An Extensive Review13 Jan 2024
- 2023DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection7 Dec 2023
- 2023Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces19 Aug 2023
- 2023Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection21 Jul 2023
- 2023Improving Transferability of Adversarial Examples via Bayesian Attacks21 Jul 2023
- 2023Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detection3 Mar 2023
3 more
- 2022Detecting Deepfake by Creating Spatio-Temporal Regularity Disruption21 Jul 2022
- 2022Voice-Face Homogeneity Tells Deepfake4 Mar 2022
- 2022ARIA: Adversarially Robust Image Attribution for Content Provenance25 Feb 2022
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2026How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark studycited by 15
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Tracescited by 12
- 2022Detecting Deepfake by Creating Spatio-Temporal Regularity Disruptioncited by 3
- 2023Improving Transferability of Adversarial Examples via Bayesian Attackscited by 3
- 2023Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detectioncited by 2
- 2023Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detectioncited by 2
- 2025Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localizationcited by 2
- 2022ARIA: Adversarially Robust Image Attribution for Content Provenancecited by 1
- 2023DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detectioncited by 1
- 2025Cross-Branch Orthogonality for Improved Generalization in Face Deepfake Detectioncited by 1
- 2023Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Facescited by 0
12 most cited of 14 All 14 (JSON)
- 2026How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark study8 Feb 2026
- 2025Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localization13 Nov 2025
- 2025Cross-Branch Orthogonality for Improved Generalization in Face Deepfake Detection8 May 2025
- 2024Revisiting Face Forgery Detection: From Facial Representation to Forgery Detection25 Sep 2024
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Traces24 Jan 2024
- 2024Datasets, Clues and State-of-the-Arts for Multimedia Forensics: An Extensive Review13 Jan 2024
- 2023DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection7 Dec 2023
- 2023Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces19 Aug 2023
- 2023Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection21 Jul 2023
- 2023Improving Transferability of Adversarial Examples via Bayesian Attacks21 Jul 2023
- 2023Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detection3 Mar 2023
- 2022Detecting Deepfake by Creating Spatio-Temporal Regularity Disruption21 Jul 2022
12 newest of 14 All 14 (JSON)