Can We Leave Deepfake Data Behind in Training Deepfake Detector?
Not on the map. Why?
Abstract (arXiv)
The generalization ability of deepfake detectors is vital for their applications in real-world scenarios. One effective solution to enhance this ability is to train the models with manually-blended data, which we termed "blendfake", encouraging models to learn generic forgery artifacts like blending boundary. Interestingly, current SoTA methods utilize blendfake without incorporating any deepfake data in their training process. This is likely because previous empirical observations suggest that vanilla hybrid training (VHT), which combines deepfake and blendfake data, results in inferior performance to methods using only blendfake data (so-called "1+1<2"). Therefore, a critical question arises: Can we leave deepfake behind and rely solely on blendfake data to train an effective deepfake detector? Intuitively, as deepfakes also contain additional informative forgery clues (e.g., deep generative artifacts), excluding all deepfake data in training deepfake detectors seems counter-intuitive. In this paper, we rethink the role of blendfake in detecting deepfakes and formulate the process from "real to blendfake to deepfake" to be a progressive transition. Specifically, blendfake and deepfake can be explicitly delineated as the oriented pivot anchors between "real-to-fake" transitions. The accumulation of forgery information should be oriented and progressively increasing during this transition process. To this end, we propose an Oriented Progressive Regularizor (OPR) to establish the constraints that compel the distribution of anchors to be discretely arranged. Furthermore, we introduce feature bridging to facilitate the smooth transition between adjacent anchors. Extensive experiments confirm that our design allows leveraging forgery information from both blendfake and deepfake effectively and comprehensively.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 42 of its 58 references that are in the map. First posted on arXiv 30 Aug 2024.
Builds on
42 of 58 references.
References · 42
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
30 more
- 2018Towards a Definition of Disentangled Representationscited by 294
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 125
- 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 68
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2021Consistency Regularization for Variational Auto-Encoderscited by 50
- 2018An Analysis of the t-SNE Algorithm for Data Visualizationcited by 49
- 2016Towards Deep Symbolic Reinforcement Learningcited by 42
- 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
- 2022MobileFaceSwap: A Lightweight Framework for Video Face Swappingcited by 39
- 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Modelscited by 39
- 2022Exploring Disentangled Content Information for Face Forgery Detectioncited by 36
- 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 29
- 2021Latent Space Regularization for Unsupervised Domain Adaptation in Semantic Segmentationcited by 10
- 2024ED4: Explicit Data-level Debiasing for Deepfake Detectioncited by 8
- 2021Organization of a Latent Space structure in VAE/GAN trained by navigation datacited by 2
Built on by
Citing papers per year: 2024: 7; 2025: 20; 2026: 21.
48 papers.
Sort:
By area:
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
- 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detectioncited by 20
- 2025Deepfake Detection that Generalizes Across Benchmarkscited by 20
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 18
- 2024Stacking Brick by Brick: Aligned Feature Isolation for Incremental Face Forgery Detectioncited by 16
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasingcited by 14
- 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakescited by 7
- 2025Fair Deepfake Detectors Can Generalizecited by 7
- 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysiscited by 7
36 more
- 2025Learning Real Facial Concepts for Independent Deepfake Detectioncited by 6
- 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillationcited by 6
- 2025Agent4FaceForgery: Multi-Agent LLM Framework for Realistic Face Forgery Detectioncited by 5
- 2024A Quality-Centric Framework for Generic Deepfake Detectioncited by 4
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
- 2025Towards Unified Multimodal Misinformation Detection in Social Media: A Benchmark Dataset and Baselinecited by 4
- 2024DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencodercited by 2
- 2025FORGE: Forensic Reasoning with Grounded Evidencecited by 2
- 2025SAGA: Source Attribution of Generative AI Videoscited by 2
- 2025SELFI: Selective Fusion of Identity for Generalizable Deepfake Detectioncited by 1
- 2025Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentationcited by 1
- 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real Worldcited by 1
- 2026Explainable Deepfake Detection with RL Enhanced Self-Blended Imagescited by 1
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detectioncited by 1
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detectioncited by 1
- 2026LOGER: Local--Global Ensemble for Robust Deepfake Detection in the Wildcited by 1
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
- 2026Uncertainty-Aware Deepfake Detection via Multi-View Structural Learningcited by 1
- 2025Towards General Visual-Linguistic Face Forgery Detection(V2)cited by 0
- 2025Suppressing Gradient Conflict for Generalizable Deepfake Detectioncited by 0
- 2025Leveraging Unlabeled Data from Unknown Sources via Dual-Path Guidance for Deepfake Face Detectioncited by 0
- 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detectioncited by 0
- 2026Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detectioncited by 0
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correctioncited by 0
- 2026Tutor-Student Reinforcement Learning: A Dynamic Curriculum for Robust Deepfake Detectioncited by 0
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detectioncited by 0
- 2026Generalizable Face Forgery Detection via Separable Prompt Learningcited by 0
- 2026Detecting Deepfakes via Hamiltonian Dynamicscited by 0
- 2026Exposing and Mitigating Temporal Attack in Deepfake Video Detectioncited by 0
- 2026Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptationcited by 0
- 2026What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representationscited by 0
- 2026Hierarchical Channel Stacking: A Structured Decision Framework for AI-Generated Image Detectioncited by 0
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detectioncited by 0
- 2026DBCF: Dual-Branch Complementary Fusion of Foundation Models for Generalized Deepfake Detectioncited by 0
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detectioncited by 0
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detection28 Sep 2026
- 2026DBCF: Dual-Branch Complementary Fusion of Foundation Models for Generalized Deepfake Detection28 Sep 2026
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detection26 Sep 2026
- 2026Hierarchical Channel Stacking: A Structured Decision Framework for AI-Generated Image Detection27 Aug 2026
- 2026Uncertainty-Aware Deepfake Detection via Multi-View Structural Learning30 Jul 2026
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey12 Jul 2026
- 2026What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representations24 Jun 2026
- 2026Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptation3 Jun 2026
- 2026Exposing and Mitigating Temporal Attack in Deepfake Video Detection8 May 2026
- 2026Detecting Deepfakes via Hamiltonian Dynamics6 May 2026
- 2026Generalizable Face Forgery Detection via Separable Prompt Learning19 Apr 2026
- 2026LOGER: Local--Global Ensemble for Robust Deepfake Detection in the Wild4 Apr 2026
36 more
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detection25 Mar 2026
- 2026Tutor-Student Reinforcement Learning: A Dynamic Curriculum for Robust Deepfake Detection25 Mar 2026
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correction14 Mar 2026
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection10 Mar 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection2 Feb 2026
- 2026Explainable Deepfake Detection with RL Enhanced Self-Blended Images22 Jan 2026
- 2026Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detection17 Jan 2026
- 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detection2 Jan 2026
- 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real World4 Dec 2025
- 2025SAGA: Source Attribution of Generative AI Videos16 Nov 2025
- 2025Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentation10 Nov 2025
- 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysis29 Oct 2025
- 2025Towards Unified Multimodal Misinformation Detection in Social Media: A Benchmark Dataset and Baseline30 Sep 2025
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasing26 Sep 2025
- 2025Agent4FaceForgery: Multi-Agent LLM Framework for Realistic Face Forgery Detection16 Sep 2025
- 2025Leveraging Unlabeled Data from Unknown Sources via Dual-Path Guidance for Deepfake Face Detection12 Aug 2025
- 2025Deepfake Detection that Generalizes Across Benchmarks8 Aug 2025
- 2025Suppressing Gradient Conflict for Generalizable Deepfake Detection29 Jul 2025
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics24 Jul 2025
- 2025Fair Deepfake Detectors Can Generalize3 Jul 2025
- 2025SELFI: Selective Fusion of Identity for Generalizable Deepfake Detection21 Jun 2025
- 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakes26 May 2025
- 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillation21 May 2025
- 2025Learning Real Facial Concepts for Independent Deepfake Detection7 May 2025
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakes7 Apr 2025
- 2025FORGE: Forensic Reasoning with Grounded Evidence20 Mar 2025
- 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detection19 Mar 2025
- 2025Towards General Visual-Linguistic Face Forgery Detection(V2)28 Feb 2025
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Content16 Dec 2024
- 2024DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencoder10 Dec 2024
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey26 Nov 2024
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detection23 Nov 2024
- 2024Stacking Brick by Brick: Aligned Feature Isolation for Incremental Face Forgery Detection18 Nov 2024
- 2024A Quality-Centric Framework for Generic Deepfake Detection8 Nov 2024
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detection8 Oct 2024
- 2025FORGE: Forensic Reasoning with Grounded Evidencecited by 2
- 2025FORGE: Forensic Reasoning with Grounded Evidence20 Mar 2025
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
- 2025Deepfake Detection that Generalizes Across Benchmarkscited by 20
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 18
- 2024Stacking Brick by Brick: Aligned Feature Isolation for Incremental Face Forgery Detectioncited by 16
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasingcited by 14
- 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakescited by 7
- 2025Fair Deepfake Detectors Can Generalizecited by 7
- 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysiscited by 7
- 2025Learning Real Facial Concepts for Independent Deepfake Detectioncited by 6
12 most cited of 43 All 43 (JSON)
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detection28 Sep 2026
- 2026DBCF: Dual-Branch Complementary Fusion of Foundation Models for Generalized Deepfake Detection28 Sep 2026
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detection26 Sep 2026
- 2026Hierarchical Channel Stacking: A Structured Decision Framework for AI-Generated Image Detection27 Aug 2026
- 2026Uncertainty-Aware Deepfake Detection via Multi-View Structural Learning30 Jul 2026
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey12 Jul 2026
- 2026What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representations24 Jun 2026
- 2026Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptation3 Jun 2026
- 2026Exposing and Mitigating Temporal Attack in Deepfake Video Detection8 May 2026
- 2026Detecting Deepfakes via Hamiltonian Dynamics6 May 2026
- 2026Generalizable Face Forgery Detection via Separable Prompt Learning19 Apr 2026
- 2026LOGER: Local--Global Ensemble for Robust Deepfake Detection in the Wild4 Apr 2026
12 newest of 43 All 43 (JSON)