mlsanityData to 14 Oct 2026

Where the Devil Hides: Deepfake Detectors Can No Longer Be Trusted

arXiv 2505.08255 ↗First posted 13 May 2025cs.CR cs.CVcited by 2

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

With the advancement of AI generative techniques, Deepfake faces have become incredibly realistic and nearly indistinguishable to the human eye. To counter this, Deepfake detectors have been developed as reliable tools for assessing face authenticity. These detectors are typically developed on Deep Neural Networks (DNNs) and trained using third-party datasets. However, this protocol raises a new security risk that can seriously undermine the trustfulness of Deepfake detectors: Once the third-party data providers insert poisoned (corrupted) data maliciously, Deepfake detectors trained on these datasets will be injected ``backdoors'' that cause abnormal behavior when presented with samples containing specific triggers. This is a practical concern, as third-party providers may distribute or sell these triggers to malicious users, allowing them to manipulate detector performance and escape accountability. This paper investigates this risk in depth and describes a solution to stealthily infect Deepfake detectors. Specifically, we develop a trigger generator, that can synthesize passcode-controlled, semantic-suppression, adaptive, and invisible trigger patterns, ensuring both the stealthiness and effectiveness of these triggers. Then we discuss two poisoning scenarios, dirty-label poisoning and clean-label poisoning, to accomplish the injection of backdoors. Extensive experiments demonstrate the effectiveness, stealthiness, and practicality of our method compared to several baselines.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 39 of its 52 references that are in the map. First posted on arXiv 13 May 2025.

Builds on

39 of 52 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  6. 2016Densely Connected Convolutional Networkscited by 6,720
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  8. 2013Intriguing properties of neural networkscited by 5,155
  9. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  10. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  11. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
  12. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
27 more
  1. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
  2. 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 580
  3. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  4. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  5. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  6. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  7. 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 353
  8. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  9. 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 324
  10. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
  11. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
  12. 2019Label-Consistent Backdoor Attackscited by 296
  13. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 265
  14. 2021Anti-Backdoor Learning: Training Clean Models on Poisoned Datacited by 263
  15. 2019A new Backdoor Attack in CNNs by training set corruption without label poisoningcited by 242
  16. 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
  17. 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 128
  18. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
  19. 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
  20. 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
  21. 2020DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythmscited by 65
  22. 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 50
  23. 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
  24. 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detectioncited by 35
  25. 2023Controllable Guide-Space for Generalizable Face Forgery Detectioncited by 21
  26. 2022Are Deepfakes Concerning? Analyzing Conversations of Deepfakes on Reddit and Exploring Societal Implicationscited by 14
  27. 2024Five Pitfalls When Assessing Synthetic Medical Images with Reference Metricscited by 4

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2021Understanding the Security of Deepfake Detection
  2. 2024Real is not True: Backdoor Attacks Against Deepfake Detection ↗
  3. 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models
  4. 2024Deepfake Generation and Detection: A Benchmark and Survey
  5. 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Face
  6. 2023Is It Possible to Backdoor Face Forgery Detection with Natural Triggers?
  7. 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models
  8. 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion