mlsanityData to 13 Oct 2026

Deepfake Forensics via An Adversarial Game

arXiv 2103.13567 ↗First posted 25 Mar 2021cs.CV cs.CR cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

With the progress in AI-based facial forgery (i.e., deepfake), people are increasingly concerned about its abuse. Albeit effort has been made for training classification (also known as deepfake detection) models to recognize such forgeries, existing models suffer from poor generalization to unseen forgery technologies and high sensitivity to changes in image/video quality. In this paper, we advocate adversarial training for improving the generalization ability to both unseen facial forgeries and unseen image/video qualities. We believe training with samples that are adversarially crafted to attack the classification models improves the generalization ability considerably. Considering that AI-based face manipulation often leads to high-frequency artifacts that can be easily spotted by models yet difficult to generalize, we further propose a new adversarial training method that attempts to blur out these specific artifacts, by introducing pixel-wise Gaussian blurring models. With adversarial training, the classification models are forced to learn more discriminative and generalizable features, and the effectiveness of our method can be verified by plenty of empirical evidence. Our code will be made publicly available.

Key facts. Cited by 15 papers in the map (data through 13 Oct 2026). Builds on 36 of its 60 references that are in the map. First posted on arXiv 25 Mar 2021.

Builds on

36 of 60 references.

References · 36

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,336
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,426
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,379
  5. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,457
  6. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,326
  7. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  8. 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,265
  9. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,097
  10. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  11. 2016Adversarial Machine Learning at Scalecited by 935
  12. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 846
24 more
  1. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 769
  2. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  3. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 574
  4. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  5. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  6. 2021Multi-attentional Deepfake Detectioncited by 340
  7. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
  8. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
  9. 2017Temporal Segment Networks for Action Recognition in Videoscited by 279
  10. 2019On the Detection of Digital Face Manipulationcited by 259
  11. 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
  12. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
  13. 2018Spatially Transformed Adversarial Examplescited by 195
  14. 2019Are Labels Required for Improving Adversarial Robustness?cited by 163
  15. 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
  16. 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 119
  17. 2017The Numerics of GANscited by 104
  18. 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
  19. 2020Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examplescited by 66
  20. 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
  21. 2017Recasting Residual-based Local Descriptors as Convolutional Neural Networks: an Application to Image Forgery Detectioncited by 56
  22. 2016Automatic Face Reenactmentcited by 43
  23. 2019What Else Can Fool Deep Learning? Addressing Color Constancy Errors on Deep Neural Network Performancecited by 37
  24. 2019Towards Generalizable Deepfake Detection with Locality-aware AutoEncodercited by 17

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2022: 3; 2023: 5; 2024: 4; 2025: 2; 2026: 1.

15 papers.

Sort:

By area: