Towards Sustainable Universal Deepfake Detection with Frequency-Domain Masking
Not on the map. Why?
Abstract (arXiv)
Universal deepfake detection aims to identify AI-generated images across a broad range of generative models, including unseen ones. This requires robust generalization to new and unseen deepfakes, which emerge frequently, while minimizing computational overhead to enable large-scale deepfake screening, a critical objective in the era of Green AI. In this work, we explore frequency-domain masking as a training strategy for deepfake detectors. Unlike traditional methods that rely heavily on spatial features or large-scale pretrained models, our approach introduces random masking and geometric transformations, with a focus on frequency masking due to its superior generalization properties. We demonstrate that frequency masking not only enhances detection accuracy across diverse generators but also maintains performance under significant model pruning, offering a scalable and resource-conscious solution. Our method achieves state-of-the-art generalization on GAN- and diffusion-generated image datasets and exhibits consistent robustness under structured pruning. These results highlight the potential of frequency-based masking as a practical step toward sustainable and generalizable deepfake detection. Code and models are available at https://github.com/chandlerbing65nm/FakeImageDetection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
32 of 49 references.
References · 32
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 673
- 2016Learning Structured Sparsity in Deep Neural Networkscited by 538
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2022On the detection of synthetic images generated by diffusion modelscited by 282
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
20 more
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2021Are GAN generated images easy to detect? A critical analysis of the state-of-the-artcited by 139
- 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
- 2020Layer-adaptive sparsity for the Magnitude-based Pruningcited by 122
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 121
- 2020Neural Pruning via Growing Regularizationcited by 97
- 2022FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbationscited by 75
- 2022Masked Frequency Modeling for Self-Supervised Visual Pre-Trainingcited by 70
- 2021ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Imagescited by 48
- 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
- 2022Green Learning: Introduction, Examples and Outlookcited by 30
- 2022Discovering Transferable Forensic Features for CNN-generated Images Detectioncited by 24
- 2024Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learningcited by 20
- 2023A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shotcited by 19
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detectioncited by 9
- 2024DistilDIRE: A Small, Fast, Cheap and Lightweight Diffusion Synthesized Deepfake Detectioncited by 9
- 2021A-PixelHop: A Green, Robust and Explainable Fake-Image Detectorcited by 7
- 2022DefakeHop++: An Enhanced Lightweight Deepfake Detectorcited by 5
- 2024Deepfake Detection without Deepfakes: Generalization via Synthetic Frequency Patterns Injectioncited by 5
- 2023Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for Enhanced Video Forgery Detectioncited by 4
Built on by
Not cited yet.