mlsanityData to 7 Oct 2026

Masked Conditional Diffusion Model for Enhancing Deepfake Detection

arXiv 2402.00541 ↗First posted 1 Feb 2024cs.CVcited by 9

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent studies on deepfake detection have achieved promising results when training and testing faces are from the same dataset. However, their results severely degrade when confronted with forged samples that the model has not yet seen during training. In this paper, deepfake data to help detect deepfakes. this paper present we put a new insight into diffusion model-based data augmentation, and propose a Masked Conditional Diffusion Model (MCDM) for enhancing deepfake detection. It generates a variety of forged faces from a masked pristine one, encouraging the deepfake detection model to learn generic and robust representations without overfitting to special artifacts. Extensive experiments demonstrate that forgery images generated with our method are of high quality and helpful to improve the performance of deepfake detection models.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 37 of its 52 references that are in the map. First posted on arXiv 1 Feb 2024.

Builds on

37 of 52 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models5 Sep
  2. 2022Towards the Detection of Diffusion Model Deepfakes26 Oct
  3. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  10. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  11. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  12. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
22 more
  1. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  2. 2022Detecting Deepfakes with Self-Blended Imagescited by 332
  3. 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
  4. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
  5. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  6. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  7. 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
  8. 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
  9. 2018FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Facescited by 118
  10. 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
  11. 2020Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlightscited by 59
  12. 2021Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Facescited by 48
  13. 2023Improving Fairness in Deepfake Detectioncited by 40
  14. 2022Learning Second Order Local Anomaly for General Face Forgery Detectioncited by 36
  15. 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
  16. 2023ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Modelscited by 31
  17. 2021Robust Attentive Deep Neural Network for Exposing GAN-generated Facescited by 28
  18. 2022Rank-based Decomposable Losses in Machine Learning: A Surveycited by 26
  19. 2023Synthetic Augmentation with Large-scale Unconditional Pre-trainingcited by 18
  20. 2023Synthesizing Black-box Anti-forensics DeepFakes with High Visual Qualitycited by 12
  21. 2022Open-Eye: An Open Platform to Study Human Performance on Identifying AI-Synthesized Facescited by 11
  22. 2023Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detectioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 1.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion
  2. 2024Diffusion Deepfake
  3. 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models
  4. 2026Deepfake Detection Generalization with Diffusion Noise
  5. 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization
  6. 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakes
  7. 2024DistilDIRE: A Small, Fast, Cheap and Lightweight Diffusion Synthesized Deepfake Detection
  8. 2026ExposeAnyone: Personalized Audio-to-Expression Diffusion Models Are Robust Zero-Shot Face Forgery Detectors