mlsanityData to 7 Oct 2026

Diffusion Facial Forgery Detection

arXiv 2401.15859 ↗First posted 29 Jan 2024cs.CV cs.AIcited by 41

Not on the map. Why?

Abstract (arXiv)

Detecting diffusion-generated images has recently grown into an emerging research area. Existing diffusion-based datasets predominantly focus on general image generation. However, facial forgeries, which pose a more severe social risk, have remained less explored thus far. To address this gap, this paper introduces DiFF, a comprehensive dataset dedicated to face-focused diffusion-generated images. DiFF comprises over 500,000 images that are synthesized using thirteen distinct generation methods under four conditions. In particular, this dataset leverages 30,000 carefully collected textual and visual prompts, ensuring the synthesis of images with both high fidelity and semantic consistency. We conduct extensive experiments on the DiFF dataset via a human test and several representative forgery detection methods. The results demonstrate that the binary detection accuracy of both human observers and automated detectors often falls below 30%, shedding light on the challenges in detecting diffusion-generated facial forgeries. Furthermore, we propose an edge graph regularization approach to effectively enhance the generalization capability of existing detectors.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 67 of its 82 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

67 of 82 references.

References · 67

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2017Neural Discrete Representation Learningcited by 4,650
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,276
38 more
  1. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  3. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  4. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  5. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  6. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  7. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  8. 2022Diffusion Models in Vision: A Surveycited by 1,008
  9. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  10. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  11. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  12. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  13. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
  14. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  15. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 526
  16. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  17. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  18. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
  19. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  20. 2023DIRE for Diffusion-Generated Image Detectioncited by 386
  21. 2018HiDDeN: Hiding Data With Deep Networkscited by 384
  22. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 331
  23. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
  24. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
  25. 2022On the detection of synthetic images generated by diffusion modelscited by 282
  26. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
  27. 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generatorcited by 208
  28. 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
  29. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  30. 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
  31. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  32. 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
  33. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  34. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  35. 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 125
  36. 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
  37. 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
  38. 2023Collaborative Diffusion for Multi-Modal Face Generation and Editingcited by 116

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 17; 2026: 15.

41 papers.

Sort:

By area:

  1. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
  2. 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
  3. 2024Beyond Deepfake Images: Detecting AI-Generated Videoscited by 22
  4. 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learningcited by 21
  5. 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
  6. 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Modelscited by 13
  7. 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Modelscited by 12
  8. 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detectioncited by 10
  9. 2025OpenFake: An Open Dataset and Platform Toward Real-World Deepfake Detectioncited by 9
  10. 2025The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contextscited by 8
  11. 2024Open-Set Deepfake Detection: A Parameter-Efficient Adaptation Method with Forgery Style Mixturecited by 7
  12. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
29 more
  1. 2025Learning Real Facial Concepts for Independent Deepfake Detectioncited by 6
  2. 2024Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approachcited by 4
  3. 2024The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methodscited by 4
  4. 2025Bi-Level Optimization for Self-Supervised AI-Generated Face Detectioncited by 4
  5. 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detectioncited by 3
  6. 2025Self-Supervised Learning for Detecting AI-Generated Faces as Anomaliescited by 3
  7. 2025Model Discrepancy Learning: Synthetic Faces Detection Based on Multi-Reconstructioncited by 3
  8. 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Facecited by 2
  9. 2025Generalized Design Choices for Deepfake Detectorscited by 2
  10. 2026RCDN: Real-Centered Detection Network for Robust Face Forgery Identificationcited by 2
  11. 2026RealHD: A High-Quality Dataset for Robust Detection of State-of-the-Art AI-Generated Imagescited by 2
  12. 2025PVLM: Parsing-Aware Vision Language Model with Dynamic Contrastive Learning for Zero-Shot Deepfake Attributioncited by 1
  13. 2025Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Facescited by 1
  14. 2025A Dual-Branch CNN for Robust Detection of AI-Generated Facial Forgeriescited by 1
  15. 2025NeXT-IMDL: Build Benchmark for NeXT-Generation Image Manipulation Detection & Localizationcited by 1
  16. 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tamperingcited by 1
  17. 2026LRD-Net: A Lightweight Real-Centered Detection Network for Cross-Domain Face Forgery Detectioncited by 1
  18. 2026EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detectioncited by 1
  19. 2025Suppressing Gradient Conflict for Generalizable Deepfake Detectioncited by 0
  20. 2026DiffFace-Edit: A Diffusion-Based Facial Dataset for Forgery-Semantic Driven Deepfake Detection Analysiscited by 0
  21. 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
  22. 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correctioncited by 0
  23. 2026GazeCLIP: Gaze-Guided CLIP with Adaptive-Enhanced Fine-Grained Language Prompt for Deepfake Attribution and Detectioncited by 0
  24. 2026Detecting Deepfakes via Hamiltonian Dynamicscited by 0
  25. 2026Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detectioncited by 0
  26. 2026FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detectioncited by 0
  27. 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detectioncited by 0
  28. 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detectioncited by 0
  29. 2026Look Closer: Patch-wise Supervision for AI-Generated Image Detectioncited by 0