DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization
Not on the map. Why?
Abstract (arXiv)
The rapid evolution of deepfake technologies demands robust and reliable face forgery detection algorithms. While determining whether an image has been manipulated remains essential, the ability to precisely localize forgery clues is also important for enhancing model explainability and building user trust. To address this dual challenge, we introduce DiffusionFF, a diffusion-based framework that simultaneously performs face forgery detection and fine-grained artifact localization. Our key idea is to establish a novel encoder-decoder architecture: a pretrained forgery detector serves as a powerful "artifact encoder", and a denoising diffusion model is repurposed as an "artifact decoder". Conditioned on multi-scale forgery-related features extracted by the encoder, the decoder progressively synthesizes a detailed artifact localization map. We then fuse this fine-grained localization map with high-level semantic features from the forgery detector, leading to substantial improvements in detection capability. Extensive experiments show that DiffusionFF achieves state-of-the-art (SOTA) performance across multiple benchmarks, underscoring its superior effectiveness and explainability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 64 references that are in the map. First posted on arXiv 3 Aug 2025.
Builds on
39 of 64 references.
References · 39
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022A ConvNet for the 2020scited by 3,579
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
27 more
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 89
- 2021Face Forensics in the Wildcited by 87
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
- 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
- 2020Head2Head: Video-based Neural Head Synthesiscited by 40
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
- 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 38
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
- 2025Exploring Unbiased Deepfake Detection via Token-Level Shuffling and Mixingcited by 27
- 2024Learning Natural Consistency Representation for Face Forgery Video Detectioncited by 26
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Tracescited by 12
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detectioncited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localization
- 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysis
- 2026IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector
- 2024GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detection
- 2026ExposeAnyone: Personalized Audio-to-Expression Diffusion Models Are Robust Zero-Shot Face Forgery Detectors
- 2026Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection