Frequency Masking for Universal Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
We study universal deepfake detection. Our goal is to detect synthetic images from a range of generative AI approaches, particularly from emerging ones which are unseen during training of the deepfake detector. Universal deepfake detection requires outstanding generalization capability. Motivated by recently proposed masked image modeling which has demonstrated excellent generalization in self-supervised pre-training, we make the first attempt to explore masked image modeling for universal deepfake detection. We study spatial and frequency domain masking in training deepfake detectors. Based on empirical analysis, we propose a novel deepfake detector via frequency masking. Our focus on frequency domain is different from the majority, which primarily target spatial domain detection. Our comparative analyses reveal substantial performance gains over existing methods. Code and models are publicly available.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 13 of its 17 references that are in the map. First posted on arXiv 12 Jan 2024.
Builds on
13 of 17 references.
References · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2022On the detection of synthetic images generated by diffusion modelscited by 282
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2021Are GAN generated images easy to detect? A critical analysis of the state-of-the-artcited by 139
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 121
- 2022Masked Frequency Modeling for Self-Supervised Visual Pre-Trainingcited by 70
- 2022Discovering Transferable Forensic Features for CNN-generated Images Detectioncited by 24
1 more
Built on by
Citing papers per year: 2024: 8; 2025: 9; 2026: 6.
23 papers.
Sort:
By area:
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 124
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 56
- 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Errorcited by 46
- 2025AI-Generated Video Detection via Perceptual Straighteningcited by 34
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attackscited by 12
- 2025LOTA: Bit-Planes Guided AI-Generated Image Detectioncited by 10
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2026Simplicity Prevails: The Emergence of Generalizable AIGI Detection in Visual Foundation Modelscited by 6
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attributioncited by 5
- 2024DuoCast: Duo-Probabilistic Diffusion for Precipitation Nowcastingcited by 4
- 2025Fully AI-Generated Image Detection: Definition, Recent Advances and Challengescited by 4
- 2025Towards Reliable Identification of Diffusion-based Image Manipulationscited by 4
11 more
- 2026MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuationscited by 2
- 2024The Visual Counter Turing Test (VCT2): A Benchmark for Evaluating AI-Generated Image Detection and the Visual AI Index (VAI)cited by 1
- 2025Knowledge-Guided Prompt Learning for Deepfake Facial Image Detectioncited by 1
- 2025FreqCross: A Multi-Modal Frequency-Spatial Fusion Network for Robust Detection of Stable Diffusion 3.5 Generated Imagescited by 1
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Modelscited by 0
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2025Fair and Interpretable Deepfake Detection in Videoscited by 0
- 2026Detecting Diffusion-generated Images via Dynamic Assembly Forestscited by 0
- 2026An Explainable FFT-Based Spatial-Frequency Fusion Framework for Deepfake Detectioncited by 0
- 2026Mind the Rift: Cross-Scale Coupling Mismatch for AI-Generated Video Detectioncited by 0
- 2026From Detection to Localization: A Unified Forensics Framework for Fully Synthetic and Tampered Imagescited by 0
- 2026From Detection to Localization: A Unified Forensics Framework for Fully Synthetic and Tampered Images2 Sep 2026
- 2026Mind the Rift: Cross-Scale Coupling Mismatch for AI-Generated Video Detection1 Sep 2026
- 2026An Explainable FFT-Based Spatial-Frequency Fusion Framework for Deepfake Detection19 Jul 2026
- 2026Detecting Diffusion-generated Images via Dynamic Assembly Forests10 Apr 2026
- 2026Simplicity Prevails: The Emergence of Generalizable AIGI Detection in Visual Foundation Models2 Feb 2026
- 2026MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuations29 Jan 2026
- 2025Fair and Interpretable Deepfake Detection in Videos20 Oct 2025
- 2025LOTA: Bit-Planes Guided AI-Generated Image Detection16 Oct 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025FreqCross: A Multi-Modal Frequency-Spatial Fusion Network for Robust Detection of Stable Diffusion 3.5 Generated Images1 Jul 2025
- 2025AI-Generated Video Detection via Perceptual Straightening1 Jul 2025
- 2025Towards Reliable Identification of Diffusion-based Image Manipulations5 Jun 2025
11 more
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attribution7 May 2025
- 2025Fully AI-Generated Image Detection: Definition, Recent Advances and Challenges27 Feb 2025
- 2025Knowledge-Guided Prompt Learning for Deepfake Facial Image Detection1 Jan 2025
- 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Error10 Dec 2024
- 2024DuoCast: Duo-Probabilistic Diffusion for Precipitation Nowcasting2 Dec 2024
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learning28 Nov 2024
- 2024The Visual Counter Turing Test (VCT2): A Benchmark for Evaluating AI-Generated Image Detection and the Visual AI Index (VAI)24 Nov 2024
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Models13 Nov 2024
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attacks30 Jul 2024
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges11 Jun 2024
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models10 Mar 2024
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 124
- 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Errorcited by 46
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attackscited by 12
- 2025LOTA: Bit-Planes Guided AI-Generated Image Detectioncited by 10
- 2025Towards Reliable Identification of Diffusion-based Image Manipulationscited by 4
- 2025FreqCross: A Multi-Modal Frequency-Spatial Fusion Network for Robust Detection of Stable Diffusion 3.5 Generated Imagescited by 1
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Modelscited by 0
- 2026Detecting Diffusion-generated Images via Dynamic Assembly Forestscited by 0
- 2026Detecting Diffusion-generated Images via Dynamic Assembly Forests10 Apr 2026
- 2025LOTA: Bit-Planes Guided AI-Generated Image Detection16 Oct 2025
- 2025FreqCross: A Multi-Modal Frequency-Spatial Fusion Network for Robust Detection of Stable Diffusion 3.5 Generated Images1 Jul 2025
- 2025Towards Reliable Identification of Diffusion-based Image Manipulations5 Jun 2025
- 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Error10 Dec 2024
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Models13 Nov 2024
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attacks30 Jul 2024
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models10 Mar 2024
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 56
- 2025AI-Generated Video Detection via Perceptual Straighteningcited by 34
- 2026Simplicity Prevails: The Emergence of Generalizable AIGI Detection in Visual Foundation Modelscited by 6
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attributioncited by 5
- 2024DuoCast: Duo-Probabilistic Diffusion for Precipitation Nowcastingcited by 4
- 2025Fully AI-Generated Image Detection: Definition, Recent Advances and Challengescited by 4
- 2026MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuationscited by 2
- 2024The Visual Counter Turing Test (VCT2): A Benchmark for Evaluating AI-Generated Image Detection and the Visual AI Index (VAI)cited by 1
- 2025Knowledge-Guided Prompt Learning for Deepfake Facial Image Detectioncited by 1
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2025Fair and Interpretable Deepfake Detection in Videoscited by 0
- 2026An Explainable FFT-Based Spatial-Frequency Fusion Framework for Deepfake Detectioncited by 0
12 most cited of 14 All 14 (JSON)
- 2026From Detection to Localization: A Unified Forensics Framework for Fully Synthetic and Tampered Images2 Sep 2026
- 2026Mind the Rift: Cross-Scale Coupling Mismatch for AI-Generated Video Detection1 Sep 2026
- 2026An Explainable FFT-Based Spatial-Frequency Fusion Framework for Deepfake Detection19 Jul 2026
- 2026Simplicity Prevails: The Emergence of Generalizable AIGI Detection in Visual Foundation Models2 Feb 2026
- 2026MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuations29 Jan 2026
- 2025Fair and Interpretable Deepfake Detection in Videos20 Oct 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025AI-Generated Video Detection via Perceptual Straightening1 Jul 2025
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attribution7 May 2025
- 2025Fully AI-Generated Image Detection: Definition, Recent Advances and Challenges27 Feb 2025
- 2025Knowledge-Guided Prompt Learning for Deepfake Facial Image Detection1 Jan 2025
- 2024DuoCast: Duo-Probabilistic Diffusion for Precipitation Nowcasting2 Dec 2024
12 newest of 14 All 14 (JSON)