Masked Conditional Diffusion Model for Enhancing Deepfake Detection
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent studies on deepfake detection have achieved promising results when training and testing faces are from the same dataset. However, their results severely degrade when confronted with forged samples that the model has not yet seen during training. In this paper, deepfake data to help detect deepfakes. this paper present we put a new insight into diffusion model-based data augmentation, and propose a Masked Conditional Diffusion Model (MCDM) for enhancing deepfake detection. It generates a variety of forged faces from a masked pristine one, encouraging the deepfake detection model to learn generic and robust representations without overfitting to special artifacts. Extensive experiments demonstrate that forgery images generated with our method are of high quality and helpful to improve the performance of deepfake detection models.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 37 of its 52 references that are in the map. First posted on arXiv 1 Feb 2024.
Builds on
37 of 52 references.
Closest ancestors · 3
Same direction, newest first
- 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models5 Sep
- 2022Towards the Detection of Diffusion Model Deepfakes26 Oct
- 2021Palette: Image-to-Image Diffusion Models10 Nov
Other references · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
22 more
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
- 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
- 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
- 2018FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Facescited by 118
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2020Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlightscited by 59
- 2021Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Facescited by 48
- 2023Improving Fairness in Deepfake Detectioncited by 40
- 2022Learning Second Order Local Anomaly for General Face Forgery Detectioncited by 36
- 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
- 2023ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Modelscited by 31
- 2021Robust Attentive Deep Neural Network for Exposing GAN-generated Facescited by 28
- 2022Rank-based Decomposable Losses in Machine Learning: A Surveycited by 26
- 2023Synthetic Augmentation with Large-scale Unconditional Pre-trainingcited by 18
- 2023Synthesizing Black-box Anti-forensics DeepFakes with High Visual Qualitycited by 12
- 2022Open-Eye: An Open Platform to Study Human Performance on Identifying AI-Synthesized Facescited by 11
- 2023Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detectioncited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 7; 2026: 1.
9 papers.
- 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
- 2025Improving Generalization of Medical Image Registration Foundation Modelcited by 6
- 2025Robust AI-Generated Face Detection with Imbalanced Datacited by 5
- 2025Rethinking Individual Fairness in Deepfake Detectioncited by 4
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2025Revisiting Deepfake Detection: Chronological Continual Learning and the Limits of Generalizationcited by 0
- 2025SynthGuard: An Open Platform for Detecting AI-Generated Multimedia with Multimodal LLMscited by 0
- 2025Towards Sustainable Universal Deepfake Detection with Frequency-Domain Maskingcited by 0
- 2026A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generatorscited by 0
- 2026A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators12 Jun 2026
- 2025Towards Sustainable Universal Deepfake Detection with Frequency-Domain Masking8 Dec 2025
- 2025SynthGuard: An Open Platform for Detecting AI-Generated Multimedia with Multimodal LLMs16 Nov 2025
- 2025Revisiting Deepfake Detection: Chronological Continual Learning and the Limits of Generalization29 Aug 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025Rethinking Individual Fairness in Deepfake Detection18 Jul 2025
- 2025Improving Generalization of Medical Image Registration Foundation Model10 May 2025
- 2025Robust AI-Generated Face Detection with Imbalanced Data4 May 2025
- 2024Preserving Fairness Generalization in Deepfake Detection27 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion
- 2024Diffusion Deepfake
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models
- 2026Deepfake Detection Generalization with Diffusion Noise
- 2025DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization
- 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakes
- 2024DistilDIRE: A Small, Fast, Cheap and Lightweight Diffusion Synthesized Deepfake Detection
- 2026ExposeAnyone: Personalized Audio-to-Expression Diffusion Models Are Robust Zero-Shot Face Forgery Detectors