Lightweight Complementary-Cue Fusion for Robust Video Face Forgery Detection
Not on the map. Why?
Abstract (arXiv)
Current face video forgery detectors use wide or dual-stream backbones. We show that a single, lightweight fusion of two handcrafted cues can achieve higher accuracy with a much smaller model. Based on the Xception baseline model (21.9 million parameters), we build two detectors: LFWS, which adds a 1x1 convolution to combine a low-frequency Wavelet-Denoised Feature (WDF) with a phase-spectrum channel derived from Spatial-Phase Shallow Learning (SPSL), and LFWL, which merges WDF with Local Binary Patterns (LBP) in the same way. This extra module adds only 292 parameters, keeping the total at 21.9 million, smaller than F3Net (22.5 million) and less than half the size of SRM (55.3 million). Even with this minimal overhead, the fused models increase the average area under the curve (AUC) from 74.8% to 78.6% on FaceForensics++ and from 70.5% to 74.9% on DFDC-Preview, gains of 3.8% and 4.4% over the Xception baseline. They also consistently outperform F3Net, SRM, and SPSL in eight public benchmarks, without extra data or test-time augmentation. These results show that carefully paired, handcrafted features, combined through the lightweight fusion block, can provide competitive robustness at a significantly lower cost than comparable frequency-based detectors. Our findings suggest a need to reevaluate scale-driven design choices in face video forgery detection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 22 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
17 of 22 references.
References · 17
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 208
5 more
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2019Fourier Spectrum Discrepancies in Deep Network Generated Imagescited by 138
- 2021On the Frequency Bias of Generative Modelscited by 60
- 2021Wavelet-Packets for Deepfake Image Analysis and Detectioncited by 25
- 2020Channel Compression: Rethinking Information Redundancy among Channels in CNN Architecturecited by 6
Built on by
Not cited yet.