Data Diversity, Not Frequency Invariance: A Controlled and Self-Audited Study of Compression-Robust Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Frequency features and compression-invariant representation learning are widely assumed to be key to deepfake detection that survives video compression. We test this with CAFRL - block-DCT and FFT-phase streams, compression-level-conditioned band attention, and adversarial (gradient-reversal) compression invariance - and report a controlled negative. Under a pre-registered protocol with capacity- and augmentation-matched controls, a plain EfficientNet-B0 on multi-quality data beat CAFRL as specified at every compression level on the FaceForensics++ test split, by 3.66 AUC points at CRF 40 (paired, single seed). A self-audit of our own negative found four defects biased against the frequency hypothesis, and pre-specified re-tests repairing all four showed the deficit to be a recipe artifact, not an architecture failure: the baseline recipe recovered 3.96 points over the matching shipped-recipe variant. The frequency path made no detectable difference: discriminative alone (standalone validation AUC 0.91-0.98 late in training) but of no marginal value under this fusion, at two feature widths of one 4.0 M trunk, every seed-pooled interval for the intra-dataset compression contrasts including zero; on the single held-out manipulation tested, the fair variants sat below the plain backbone. The adversarial branch, as specified, added nothing and degraded its own conditioning estimator; at the fair recipe it is untested. Robustness under single-pass H.264 re-encoding came instead from data diversity: real constant-rate-factor variants beat synthetic JPEG augmentation by 7.3 points (single runs, non-overlapping intervals). The evidence is FaceForensics++-family, GAN-era and single-codec. Match controls on training recipe as well as capacity, and buy compression robustness with codec diversity before architecture.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 36 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
25 of 36 references.
References · 25
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
13 more
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2021Sample and Computation Redistribution for Efficient Face Detectioncited by 89
- 2023Pre-registration for Predictive Modelingcited by 13
- 2021Metric Learning for Anti-Compression Facial Forgery Detectioncited by 9
- 2024Position: Embracing Negative Results in Machine Learningcited by 6
- 2024Sensitivity Decouple Learning for Image Compression Artifacts Reductioncited by 5
- 2025Pay Less Attention to Deceptive Artifacts: Robust Detection of Compressed Deepfakes on Online Social Networkscited by 5
Built on by
Not cited yet.