Diffusion Facial Forgery Detection
Not on the map. Why?
Abstract (arXiv)
Detecting diffusion-generated images has recently grown into an emerging research area. Existing diffusion-based datasets predominantly focus on general image generation. However, facial forgeries, which pose a more severe social risk, have remained less explored thus far. To address this gap, this paper introduces DiFF, a comprehensive dataset dedicated to face-focused diffusion-generated images. DiFF comprises over 500,000 images that are synthesized using thirteen distinct generation methods under four conditions. In particular, this dataset leverages 30,000 carefully collected textual and visual prompts, ensuring the synthesis of images with both high fidelity and semantic consistency. We conduct extensive experiments on the DiFF dataset via a human test and several representative forgery detection methods. The results demonstrate that the binary detection accuracy of both human observers and automated detectors often falls below 30%, shedding light on the challenges in detecting diffusion-generated facial forgeries. Furthermore, we propose an edge graph regularization approach to effectively enhance the generalization capability of existing detectors.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 67 of its 82 references that are in the map. First posted on arXiv 29 Jan 2024.
Builds on
67 of 82 references.
References · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
38 more
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 526
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2023DIRE for Diffusion-Generated Image Detectioncited by 386
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 331
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
- 2022On the detection of synthetic images generated by diffusion modelscited by 282
- 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
- 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generatorcited by 208
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 125
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
- 2023Collaborative Diffusion for Multi-Modal Face Generation and Editingcited by 116
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2024: 9; 2025: 17; 2026: 15.
41 papers.
Sort:
By area:
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2024Beyond Deepfake Images: Detecting AI-Generated Videoscited by 22
- 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learningcited by 21
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Modelscited by 13
- 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Modelscited by 12
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detectioncited by 10
- 2025OpenFake: An Open Dataset and Platform Toward Real-World Deepfake Detectioncited by 9
- 2025The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contextscited by 8
- 2024Open-Set Deepfake Detection: A Parameter-Efficient Adaptation Method with Forgery Style Mixturecited by 7
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
29 more
- 2025Learning Real Facial Concepts for Independent Deepfake Detectioncited by 6
- 2024Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approachcited by 4
- 2024The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methodscited by 4
- 2025Bi-Level Optimization for Self-Supervised AI-Generated Face Detectioncited by 4
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detectioncited by 3
- 2025Self-Supervised Learning for Detecting AI-Generated Faces as Anomaliescited by 3
- 2025Model Discrepancy Learning: Synthetic Faces Detection Based on Multi-Reconstructioncited by 3
- 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Facecited by 2
- 2025Generalized Design Choices for Deepfake Detectorscited by 2
- 2026RCDN: Real-Centered Detection Network for Robust Face Forgery Identificationcited by 2
- 2026RealHD: A High-Quality Dataset for Robust Detection of State-of-the-Art AI-Generated Imagescited by 2
- 2025PVLM: Parsing-Aware Vision Language Model with Dynamic Contrastive Learning for Zero-Shot Deepfake Attributioncited by 1
- 2025Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Facescited by 1
- 2025A Dual-Branch CNN for Robust Detection of AI-Generated Facial Forgeriescited by 1
- 2025NeXT-IMDL: Build Benchmark for NeXT-Generation Image Manipulation Detection & Localizationcited by 1
- 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tamperingcited by 1
- 2026LRD-Net: A Lightweight Real-Centered Detection Network for Cross-Domain Face Forgery Detectioncited by 1
- 2026EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detectioncited by 1
- 2025Suppressing Gradient Conflict for Generalizable Deepfake Detectioncited by 0
- 2026DiffFace-Edit: A Diffusion-Based Facial Dataset for Forgery-Semantic Driven Deepfake Detection Analysiscited by 0
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correctioncited by 0
- 2026GazeCLIP: Gaze-Guided CLIP with Adaptive-Enhanced Fine-Grained Language Prompt for Deepfake Attribution and Detectioncited by 0
- 2026Detecting Deepfakes via Hamiltonian Dynamicscited by 0
- 2026Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detectioncited by 0
- 2026FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detectioncited by 0
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detectioncited by 0
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detectioncited by 0
- 2026Look Closer: Patch-wise Supervision for AI-Generated Image Detectioncited by 0
- 2026Look Closer: Patch-wise Supervision for AI-Generated Image Detection29 Sep 2026
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detection26 Sep 2026
- 2026EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detection24 Sep 2026
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detection18 Aug 2026
- 2026FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detection3 Aug 2026
- 2026Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detection28 Jul 2026
- 2026Detecting Deepfakes via Hamiltonian Dynamics6 May 2026
- 2026LRD-Net: A Lightweight Real-Centered Detection Network for Cross-Domain Face Forgery Detection13 Apr 2026
- 2026GazeCLIP: Gaze-Guided CLIP with Adaptive-Enhanced Fine-Grained Language Prompt for Deepfake Attribution and Detection31 Mar 2026
- 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tampering20 Mar 2026
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correction14 Mar 2026
- 2026RealHD: A High-Quality Dataset for Robust Detection of State-of-the-Art AI-Generated Images11 Feb 2026
29 more
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2026DiffFace-Edit: A Diffusion-Based Facial Dataset for Forgery-Semantic Driven Deepfake Detection Analysis20 Jan 2026
- 2026RCDN: Real-Centered Detection Network for Robust Face Forgery Identification17 Jan 2026
- 2025NeXT-IMDL: Build Benchmark for NeXT-Generation Image Manipulation Detection & Localization29 Dec 2025
- 2025Generalized Design Choices for Deepfake Detectors26 Nov 2025
- 2025A Dual-Branch CNN for Robust Detection of AI-Generated Facial Forgeries28 Oct 2025
- 2025Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Faces9 Oct 2025
- 2025OpenFake: An Open Dataset and Platform Toward Real-World Deepfake Detection11 Sep 2025
- 2025Bi-Level Optimization for Self-Supervised AI-Generated Face Detection30 Jul 2025
- 2025Suppressing Gradient Conflict for Generalizable Deepfake Detection29 Jul 2025
- 2025The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contexts23 May 2025
- 2025Learning Real Facial Concepts for Independent Deepfake Detection7 May 2025
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detection29 Apr 2025
- 2025PVLM: Parsing-Aware Vision Language Model with Dynamic Contrastive Learning for Zero-Shot Deepfake Attribution19 Apr 2025
- 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Face15 Apr 2025
- 2025Model Discrepancy Learning: Synthetic Faces Detection Based on Multi-Reconstruction10 Apr 2025
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakes7 Apr 2025
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models19 Mar 2025
- 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Models8 Mar 2025
- 2025Self-Supervised Learning for Detecting AI-Generated Faces as Anomalies4 Jan 2025
- 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learning16 Dec 2024
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model5 Dec 2024
- 2024The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methods24 Oct 2024
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detection8 Oct 2024
- 2024Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approach29 Aug 2024
- 2024Open-Set Deepfake Detection: A Parameter-Efficient Adaptation Method with Forgery Style Mixture23 Aug 2024
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detection13 Jun 2024
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges11 Jun 2024
- 2024Beyond Deepfake Images: Detecting AI-Generated Videos24 Apr 2024
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Modelscited by 13
- 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Modelscited by 12
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2025PVLM: Parsing-Aware Vision Language Model with Dynamic Contrastive Learning for Zero-Shot Deepfake Attributioncited by 1
- 2025PVLM: Parsing-Aware Vision Language Model with Dynamic Contrastive Learning for Zero-Shot Deepfake Attribution19 Apr 2025
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models19 Mar 2025
- 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Models8 Mar 2025
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model5 Dec 2024
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges11 Jun 2024
- 2024The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methodscited by 4
- 2026LRD-Net: A Lightweight Real-Centered Detection Network for Cross-Domain Face Forgery Detectioncited by 1
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
- 2026LRD-Net: A Lightweight Real-Centered Detection Network for Cross-Domain Face Forgery Detection13 Apr 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2024The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methods24 Oct 2024
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2024Beyond Deepfake Images: Detecting AI-Generated Videoscited by 22
- 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learningcited by 21
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detectioncited by 10
- 2025OpenFake: An Open Dataset and Platform Toward Real-World Deepfake Detectioncited by 9
- 2025The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contextscited by 8
- 2024Open-Set Deepfake Detection: A Parameter-Efficient Adaptation Method with Forgery Style Mixturecited by 7
- 2025Learning Real Facial Concepts for Independent Deepfake Detectioncited by 6
- 2024Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approachcited by 4
- 2025Bi-Level Optimization for Self-Supervised AI-Generated Face Detectioncited by 4
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detectioncited by 3
12 most cited of 33 All 33 (JSON)
- 2026Look Closer: Patch-wise Supervision for AI-Generated Image Detection29 Sep 2026
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detection26 Sep 2026
- 2026EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detection24 Sep 2026
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detection18 Aug 2026
- 2026FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detection3 Aug 2026
- 2026Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detection28 Jul 2026
- 2026Detecting Deepfakes via Hamiltonian Dynamics6 May 2026
- 2026GazeCLIP: Gaze-Guided CLIP with Adaptive-Enhanced Fine-Grained Language Prompt for Deepfake Attribution and Detection31 Mar 2026
- 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tampering20 Mar 2026
- 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correction14 Mar 2026
- 2026RealHD: A High-Quality Dataset for Robust Detection of State-of-the-Art AI-Generated Images11 Feb 2026
- 2026DiffFace-Edit: A Diffusion-Based Facial Dataset for Forgery-Semantic Driven Deepfake Detection Analysis20 Jan 2026
12 newest of 33 All 33 (JSON)