Towards Generalizable Deepfake Detection with Spatial-Frequency Collaborative Learning and Hierarchical Cross-Modal Fusion
Not on the map. Why?
Abstract (arXiv)
The rapid evolution of deep generative models poses a critical challenge to deepfake detection, as detectors trained on forgery-specific artifacts often suffer significant performance degradation when encountering unseen forgeries. While existing methods predominantly rely on spatial domain analysis, frequency domain operations are primarily limited to feature-level augmentation, leaving frequency-native artifacts and spatial-frequency interactions insufficiently exploited. To address this limitation, we propose a novel detection framework that integrates multi-scale spatial-frequency analysis for universal deepfake detection. Our framework comprises three key components: (1) a local spectral feature extraction pipeline that combines block-wise discrete cosine transform with cascaded multi-scale convolutions to capture subtle spectral artifacts; (2) a global spectral feature extraction pipeline utilizing scale-invariant differential accumulation to identify holistic forgery distribution patterns; and (3) a multi-stage cross-modal fusion mechanism that incorporates shallow-layer attention enhancement and deep-layer dynamic modulation to model spatial-frequency interactions. Extensive evaluations on widely adopted benchmarks demonstrate that our method outperforms state-of-the-art deepfake detection methods in both accuracy and generalizability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 48 references that are in the map. First posted on arXiv 24 Apr 2025.
Builds on
29 of 48 references.
References · 29
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
17 more
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
- 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 89
- 2019Unmasking DeepFakes with simple Featurescited by 78
- 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
- 2020DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythmscited by 65
- 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
- 2024Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detectioncited by 47
- 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
- 2020DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimationcited by 29
Built on by
Not cited yet.