mlsanityData to 7 Oct 2026

DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion

arXiv 2410.04372 ↗First posted 6 Oct 2024cs.CVcited by 29

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

The rapid progress of Deepfake technology has made face swapping highly realistic, raising concerns about the malicious use of fabricated facial content. Existing methods often struggle to generalize to unseen domains due to the diverse nature of facial manipulations. In this paper, we revisit the generation process and identify a universal principle: Deepfake images inherently contain information from both source and target identities, while genuine faces maintain a consistent identity. Building upon this insight, we introduce DiffusionFake, a novel plug-and-play framework that reverses the generative process of face forgeries to enhance the generalization of detection models. DiffusionFake achieves this by injecting the features extracted by the detection model into a frozen pre-trained Stable Diffusion model, compelling it to reconstruct the corresponding target and source images. This guided reconstruction process constrains the detection network to capture the source and target related features to facilitate the reconstruction, thereby learning rich and disentangled representations that are more resilient to unseen forgeries. Extensive experiments demonstrate that DiffusionFake significantly improves cross-domain generalization of various detector architectures without introducing additional parameters during inference. Our Codes are available in https://github.com/skJack/DiffusionFake.git.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 42 of its 56 references that are in the map. First posted on arXiv 6 Oct 2024.

Builds on

42 of 56 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb

Other references · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  6. 2017Squeeze-and-Excitation Networkscited by 4,763
  7. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  8. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  9. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  10. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  11. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  12. 2021Multi-attentional Deepfake Detectioncited by 339
29 more
  1. 2022Detecting Deepfakes with Self-Blended Imagescited by 332
  2. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
  3. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
  4. 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 231
  5. 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
  6. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  7. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
  8. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  9. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
  10. 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
  11. 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 125
  12. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 122
  13. 2021Local Relation Learning for Face Forgery Detectioncited by 100
  14. 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
  15. 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
  16. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
  17. 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
  18. 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
  19. 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
  20. 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
  21. 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
  22. 2022Exploring Disentangled Content Information for Face Forgery Detectioncited by 36
  23. 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
  24. 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
  25. 2023Quality-Agnostic Deepfake Detection with Intra-model Collaborative Learningcited by 32
  26. 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 29
  27. 2023Controllable Guide-Space for Generalizable Face Forgery Detectioncited by 21
  28. 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakescited by 17
  29. 2023Real Face Foundation Representation Learning for Generalized Deepfake Detectioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 13; 2026: 13.

29 papers.

Sort:

By area:

  1. 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 38
  2. 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
  3. 2025Dual Frequency Branch Framework with Reconstructed Sliding Windows Attention for AI-Generated Image Detectioncited by 10
  4. 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detectioncited by 8
  5. 2025SpecXNet: A Dual-Domain Convolutional Network for Robust Deepfake Detectioncited by 5
  6. 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
  7. 2025DDL: A Large-Scale Dataset for Deepfake Detection and Localization in Diversified Real-World Scenarioscited by 4
  8. 2025Rethinking Individual Fairness in Deepfake Detectioncited by 4
  9. 2025FakeChain: Exposing Shallow Cues in Multi-Step Deepfake Detectioncited by 3
  10. 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attackcited by 3
  11. 2025A Data-Driven Diffusion-based Approach for Audio Deepfake Explanationscited by 2
  12. 2025SocialDF: Benchmark Dataset and Detection Model for Mitigating Harmful Deepfake Content on Social Media Platformscited by 2
17 more
  1. 2026Motion-Aware Caching for Efficient Autoregressive Video Generationcited by 2
  2. 2026What if AI systems weren't chatbots?cited by 2
  3. 2024Forensics Adapter: Unleashing CLIP for Generalizable Face Forgery Detectioncited by 1
  4. 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real Worldcited by 1
  5. 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detectioncited by 1
  6. 2026ForensicConcept: Transferable Forensic Concepts for AIGI Detectioncited by 1
  7. 2025Towards General Visual-Linguistic Face Forgery Detection(V2)cited by 0
  8. 2025Prefill-Guided Thinking for zero-shot detection of AI-generated imagescited by 0
  9. 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localizationcited by 0
  10. 2026EvolveReason: Self-Evolving Reasoning Paradigm for Explainable Deepfake Facial Image Identificationcited by 0
  11. 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correctioncited by 0
  12. 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detectioncited by 0
  13. 2026Deepfake Detection Generalization with Diffusion Noisecited by 0
  14. 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualizationcited by 0
  15. 2026Toward Calibrated, Fair, and accurate Deepfake Detectioncited by 0
  16. 2026Position: AI/ML Deepfake Research is Misaligned with AI-Generated Non-Consensual Intimate Imagery (AIG-NCII)cited by 0
  17. 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detectioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffusion Deepfake
  2. 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models
  3. 2024Deepfake Generation and Detection: A Benchmark and Survey
  4. 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detection
  5. 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models
  6. 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection
  7. 2025My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swapping
  8. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges