mlsanityData to 7 Oct 2026

Can We Leave Deepfake Data Behind in Training Deepfake Detector?

arXiv 2408.17052 ↗First posted 30 Aug 2024cs.CVcited by 48

Not on the map. Why?

Abstract (arXiv)

The generalization ability of deepfake detectors is vital for their applications in real-world scenarios. One effective solution to enhance this ability is to train the models with manually-blended data, which we termed "blendfake", encouraging models to learn generic forgery artifacts like blending boundary. Interestingly, current SoTA methods utilize blendfake without incorporating any deepfake data in their training process. This is likely because previous empirical observations suggest that vanilla hybrid training (VHT), which combines deepfake and blendfake data, results in inferior performance to methods using only blendfake data (so-called "1+1<2"). Therefore, a critical question arises: Can we leave deepfake behind and rely solely on blendfake data to train an effective deepfake detector? Intuitively, as deepfakes also contain additional informative forgery clues (e.g., deep generative artifacts), excluding all deepfake data in training deepfake detectors seems counter-intuitive. In this paper, we rethink the role of blendfake in detecting deepfakes and formulate the process from "real to blendfake to deepfake" to be a progressive transition. Specifically, blendfake and deepfake can be explicitly delineated as the oriented pivot anchors between "real-to-fake" transitions. The accumulation of forgery information should be oriented and progressively increasing during this transition process. To this end, we propose an Oriented Progressive Regularizor (OPR) to establish the constraints that compel the distribution of anchors to be discretely arranged. Furthermore, we introduce feature bridging to facilitate the smooth transition between adjacent anchors. Extensive experiments confirm that our design allows leveraging forgery information from both blendfake and deepfake effectively and comprehensively.

Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 42 of its 58 references that are in the map. First posted on arXiv 30 Aug 2024.

Builds on

42 of 58 references.

References · 42

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  3. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  4. 2016Group Equivariant Convolutional Networkscited by 1,154
  5. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  6. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  7. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  8. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  9. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  10. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  11. 2022Detecting Deepfakes with Self-Blended Imagescited by 332
  12. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
30 more
  1. 2018Towards a Definition of Disentangled Representationscited by 294
  2. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
  3. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
  4. 2019On the Detection of Digital Face Manipulationcited by 259
  5. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
  6. 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
  7. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  8. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
  9. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  10. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
  11. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
  12. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  13. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
  14. 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 125
  15. 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
  16. 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
  17. 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 68
  18. 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
  19. 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
  20. 2021Consistency Regularization for Variational Auto-Encoderscited by 50
  21. 2018An Analysis of the t-SNE Algorithm for Data Visualizationcited by 49
  22. 2016Towards Deep Symbolic Reinforcement Learningcited by 42
  23. 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
  24. 2022MobileFaceSwap: A Lightweight Framework for Video Face Swappingcited by 39
  25. 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Modelscited by 39
  26. 2022Exploring Disentangled Content Information for Face Forgery Detectioncited by 36
  27. 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 29
  28. 2021Latent Space Regularization for Unsupervised Domain Adaptation in Semantic Segmentationcited by 10
  29. 2024ED4: Explicit Data-level Debiasing for Deepfake Detectioncited by 8
  30. 2021Organization of a Latent Space structure in VAE/GAN trained by navigation datacited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 20; 2026: 21.

48 papers.

Sort:

By area:

  1. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
  2. 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
  3. 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
  4. 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detectioncited by 20
  5. 2025Deepfake Detection that Generalizes Across Benchmarkscited by 20
  6. 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 18
  7. 2024Stacking Brick by Brick: Aligned Feature Isolation for Incremental Face Forgery Detectioncited by 16
  8. 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
  9. 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasingcited by 14
  10. 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakescited by 7
  11. 2025Fair Deepfake Detectors Can Generalizecited by 7
  12. 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysiscited by 7
36 more
  1. 2025Learning Real Facial Concepts for Independent Deepfake Detectioncited by 6
  2. 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillationcited by 6
  3. 2025Agent4FaceForgery: Multi-Agent LLM Framework for Realistic Face Forgery Detectioncited by 5
  4. 2024A Quality-Centric Framework for Generic Deepfake Detectioncited by 4
  5. 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
  6. 2025Towards Unified Multimodal Misinformation Detection in Social Media: A Benchmark Dataset and Baselinecited by 4
  7. 2024DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencodercited by 2
  8. 2025FORGE: Forensic Reasoning with Grounded Evidencecited by 2
  9. 2025SAGA: Source Attribution of Generative AI Videoscited by 2
  10. 2025SELFI: Selective Fusion of Identity for Generalizable Deepfake Detectioncited by 1
  11. 2025Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentationcited by 1
  12. 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real Worldcited by 1
  13. 2026Explainable Deepfake Detection with RL Enhanced Self-Blended Imagescited by 1
  14. 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detectioncited by 1
  15. 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detectioncited by 1
  16. 2026LOGER: Local--Global Ensemble for Robust Deepfake Detection in the Wildcited by 1
  17. 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
  18. 2026Uncertainty-Aware Deepfake Detection via Multi-View Structural Learningcited by 1
  19. 2025Towards General Visual-Linguistic Face Forgery Detection(V2)cited by 0
  20. 2025Suppressing Gradient Conflict for Generalizable Deepfake Detectioncited by 0
  21. 2025Leveraging Unlabeled Data from Unknown Sources via Dual-Path Guidance for Deepfake Face Detectioncited by 0
  22. 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detectioncited by 0
  23. 2026Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detectioncited by 0
  24. 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
  25. 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correctioncited by 0
  26. 2026Tutor-Student Reinforcement Learning: A Dynamic Curriculum for Robust Deepfake Detectioncited by 0
  27. 2026Unleashing Vision-Language Semantics for Deepfake Video Detectioncited by 0
  28. 2026Generalizable Face Forgery Detection via Separable Prompt Learningcited by 0
  29. 2026Detecting Deepfakes via Hamiltonian Dynamicscited by 0
  30. 2026Exposing and Mitigating Temporal Attack in Deepfake Video Detectioncited by 0
  31. 2026Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptationcited by 0
  32. 2026What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representationscited by 0
  33. 2026Hierarchical Channel Stacking: A Structured Decision Framework for AI-Generated Image Detectioncited by 0
  34. 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detectioncited by 0
  35. 2026DBCF: Dual-Branch Complementary Fusion of Foundation Models for Generalized Deepfake Detectioncited by 0
  36. 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detectioncited by 0