mlsanityData to 14 Oct 2026

Towards Generalizable Deepfake Detection with Spatial-Frequency Collaborative Learning and Hierarchical Cross-Modal Fusion

arXiv 2504.17223 ↗First posted 24 Apr 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The rapid evolution of deep generative models poses a critical challenge to deepfake detection, as detectors trained on forgery-specific artifacts often suffer significant performance degradation when encountering unseen forgeries. While existing methods predominantly rely on spatial domain analysis, frequency domain operations are primarily limited to feature-level augmentation, leaving frequency-native artifacts and spatial-frequency interactions insufficiently exploited. To address this limitation, we propose a novel detection framework that integrates multi-scale spatial-frequency analysis for universal deepfake detection. Our framework comprises three key components: (1) a local spectral feature extraction pipeline that combines block-wise discrete cosine transform with cascaded multi-scale convolutions to capture subtle spectral artifacts; (2) a global spectral feature extraction pipeline utilizing scale-invariant differential accumulation to identify holistic forgery distribution patterns; and (3) a multi-stage cross-modal fusion mechanism that incorporates shallow-layer attention enhancement and deep-layer dynamic modulation to model spatial-frequency interactions. Extensive evaluations on widely adopted benchmarks demonstrate that our method outperforms state-of-the-art deepfake detection methods in both accuracy and generalizability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 48 references that are in the map. First posted on arXiv 24 Apr 2025.

Builds on

29 of 48 references.

References · 29

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  5. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  7. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  8. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
  9. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  10. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  11. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  12. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
17 more
  1. 2021Multi-attentional Deepfake Detectioncited by 341
  2. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
  3. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
  4. 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
  5. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  6. 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
  7. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
  8. 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
  9. 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
  10. 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 89
  11. 2019Unmasking DeepFakes with simple Featurescited by 78
  12. 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
  13. 2020DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythmscited by 65
  14. 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
  15. 2024Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detectioncited by 47
  16. 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
  17. 2020DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimationcited by 29

Built on by

Not cited yet.