DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
The rapid progress of Deepfake technology has made face swapping highly realistic, raising concerns about the malicious use of fabricated facial content. Existing methods often struggle to generalize to unseen domains due to the diverse nature of facial manipulations. In this paper, we revisit the generation process and identify a universal principle: Deepfake images inherently contain information from both source and target identities, while genuine faces maintain a consistent identity. Building upon this insight, we introduce DiffusionFake, a novel plug-and-play framework that reverses the generative process of face forgeries to enhance the generalization of detection models. DiffusionFake achieves this by injecting the features extracted by the detection model into a frozen pre-trained Stable Diffusion model, compelling it to reconstruct the corresponding target and source images. This guided reconstruction process constrains the detection network to capture the source and target related features to facilitate the reconstruction, thereby learning rich and disentangled representations that are more resilient to unseen forgeries. Extensive experiments demonstrate that DiffusionFake significantly improves cross-domain generalization of various detector architectures without introducing additional parameters during inference. Our Codes are available in https://github.com/skJack/DiffusionFake.git.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 42 of its 56 references that are in the map. First posted on arXiv 6 Oct 2024.
Builds on
42 of 56 references.
Closest ancestors · 1
Same direction, newest first
Other references · 41
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2021Multi-attentional Deepfake Detectioncited by 339
29 more
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 125
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 122
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2022Exploring Disentangled Content Information for Face Forgery Detectioncited by 36
- 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
- 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
- 2023Quality-Agnostic Deepfake Detection with Intra-model Collaborative Learningcited by 32
- 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 29
- 2023Controllable Guide-Space for Generalizable Face Forgery Detectioncited by 21
- 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakescited by 17
- 2023Real Face Foundation Representation Learning for Generalized Deepfake Detectioncited by 8
Built on by
Citing papers per year: 2024: 3; 2025: 13; 2026: 13.
29 papers.
Sort:
By area:
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 38
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
- 2025Dual Frequency Branch Framework with Reconstructed Sliding Windows Attention for AI-Generated Image Detectioncited by 10
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detectioncited by 8
- 2025SpecXNet: A Dual-Domain Convolutional Network for Robust Deepfake Detectioncited by 5
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
- 2025DDL: A Large-Scale Dataset for Deepfake Detection and Localization in Diversified Real-World Scenarioscited by 4
- 2025Rethinking Individual Fairness in Deepfake Detectioncited by 4
- 2025FakeChain: Exposing Shallow Cues in Multi-Step Deepfake Detectioncited by 3
- 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attackcited by 3
- 2025A Data-Driven Diffusion-based Approach for Audio Deepfake Explanationscited by 2
- 2025SocialDF: Benchmark Dataset and Detection Model for Mitigating Harmful Deepfake Content on Social Media Platformscited by 2
17 more
- 2026Motion-Aware Caching for Efficient Autoregressive Video Generationcited by 2
- 2026What if AI systems weren't chatbots?cited by 2
- 2024Forensics Adapter: Unleashing CLIP for Generalizable Face Forgery Detectioncited by 1
- 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real Worldcited by 1
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detectioncited by 1
- 2026ForensicConcept: Transferable Forensic Concepts for AIGI Detectioncited by 1
- 2025Towards General Visual-Linguistic Face Forgery Detection(V2)cited by 0
- 2025Prefill-Guided Thinking for zero-shot detection of AI-generated imagescited by 0
- 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localizationcited by 0
- 2026EvolveReason: Self-Evolving Reasoning Paradigm for Explainable Deepfake Facial Image Identificationcited by 0
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correctioncited by 0
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detectioncited by 0
- 2026Deepfake Detection Generalization with Diffusion Noisecited by 0
- 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualizationcited by 0
- 2026Toward Calibrated, Fair, and accurate Deepfake Detectioncited by 0
- 2026Position: AI/ML Deepfake Research is Misaligned with AI-Generated Non-Consensual Intimate Imagery (AIG-NCII)cited by 0
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detectioncited by 0
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detection28 Sep 2026
- 2026ForensicConcept: Transferable Forensic Concepts for AIGI Detection5 Jun 2026
- 2026Toward Calibrated, Fair, and accurate Deepfake Detection3 Jun 2026
- 2026Position: AI/ML Deepfake Research is Misaligned with AI-Generated Non-Consensual Intimate Imagery (AIG-NCII)16 May 2026
- 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualization12 May 2026
- 2026What if AI systems weren't chatbots?8 May 2026
- 2026Motion-Aware Caching for Efficient Autoregressive Video Generation3 May 2026
- 2026Deepfake Detection Generalization with Diffusion Noise16 Apr 2026
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correction14 Mar 2026
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection10 Mar 2026
- 2026EvolveReason: Self-Evolving Reasoning Paradigm for Explainable Deepfake Facial Image Identification8 Mar 2026
17 more
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detection10 Feb 2026
- 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real World4 Dec 2025
- 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attack14 Oct 2025
- 2025SpecXNet: A Dual-Domain Convolutional Network for Robust Deepfake Detection26 Sep 2025
- 2025FakeChain: Exposing Shallow Cues in Multi-Step Deepfake Detection20 Sep 2025
- 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization3 Aug 2025
- 2025Rethinking Individual Fairness in Deepfake Detection18 Jul 2025
- 2025DDL: A Large-Scale Dataset for Deepfake Detection and Localization in Diversified Real-World Scenarios29 Jun 2025
- 2025SocialDF: Benchmark Dataset and Detection Model for Mitigating Harmful Deepfake Content on Social Media Platforms5 Jun 2025
- 2025A Data-Driven Diffusion-based Approach for Audio Deepfake Explanations3 Jun 2025
- 2025Prefill-Guided Thinking for zero-shot detection of AI-generated images20 May 2025
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector26 Mar 2025
- 2025Towards General Visual-Linguistic Face Forgery Detection(V2)28 Feb 2025
- 2025Dual Frequency Branch Framework with Reconstructed Sliding Windows Attention for AI-Generated Image Detection25 Jan 2025
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Content16 Dec 2024
- 2024Forensics Adapter: Unleashing CLIP for Generalizable Face Forgery Detection29 Nov 2024
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey26 Nov 2024
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
- 2025DDL: A Large-Scale Dataset for Deepfake Detection and Localization in Diversified Real-World Scenarioscited by 4
- 2025Rethinking Individual Fairness in Deepfake Detectioncited by 4
- 2025FakeChain: Exposing Shallow Cues in Multi-Step Deepfake Detectioncited by 3
- 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attackcited by 3
- 2025A Data-Driven Diffusion-based Approach for Audio Deepfake Explanationscited by 2
- 2025SocialDF: Benchmark Dataset and Detection Model for Mitigating Harmful Deepfake Content on Social Media Platformscited by 2
- 2026Motion-Aware Caching for Efficient Autoregressive Video Generationcited by 2
- 2026What if AI systems weren't chatbots?cited by 2
- 2024Forensics Adapter: Unleashing CLIP for Generalizable Face Forgery Detectioncited by 1
- 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real Worldcited by 1
12 most cited of 22 All 22 (JSON)
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detection28 Sep 2026
- 2026ForensicConcept: Transferable Forensic Concepts for AIGI Detection5 Jun 2026
- 2026Toward Calibrated, Fair, and accurate Deepfake Detection3 Jun 2026
- 2026Position: AI/ML Deepfake Research is Misaligned with AI-Generated Non-Consensual Intimate Imagery (AIG-NCII)16 May 2026
- 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualization12 May 2026
- 2026What if AI systems weren't chatbots?8 May 2026
- 2026Motion-Aware Caching for Efficient Autoregressive Video Generation3 May 2026
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correction14 Mar 2026
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection10 Mar 2026
- 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real World4 Dec 2025
- 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attack14 Oct 2025
12 newest of 22 All 22 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion Deepfake
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models
- 2024Deepfake Generation and Detection: A Benchmark and Survey
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detection
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models
- 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection
- 2025My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swapping
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges