Unveiling Deepfakes: A Frequency-Aware Triple Branch Network for Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Advanced deepfake technologies are blurring the lines between real and fake, presenting both revolutionary opportunities and alarming threats. While it unlocks novel applications in fields like entertainment and education, its malicious use has sparked urgent ethical and societal concerns ranging from identity theft to the dissemination of misinformation. To tackle these challenges, feature analysis using frequency features has emergedas a promising direction for deepfake detection. However, oneaspect that has been overlooked so far is that existing methodstend to concentrate on one or a few specific frequency domains,which risks overfitting to particular artifacts and significantlyundermines their robustness when facing diverse forgery patterns. Another underexplored aspect we observe is that different features often attend to the same forged region, resulting in redundant feature representations and limiting the diversity of the extracted clues. This may undermine the ability of a model to capture complementary information across different facets, thereby compromising its generalization capability to diverse manipulations. In this paper, we seek to tackle these challenges from two aspects: (1) we propose a triple-branch network that jointly captures spatial and frequency features by learning from both original image and image reconstructed by different frequency channels, and (2) we mathematically derive feature decoupling and fusion losses grounded in the mutual information theory, which enhances the model to focus on task-relevant features across the original image and the image reconstructed by different frequency channels. Extensive experiments on six large-scale benchmark datasets demonstrate that our method consistently achieves state-of-the-art performance. Our code is released at https://github.com/injooker/Unveiling Deepfake.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 59 references that are in the map. First posted on arXiv 19 Apr 2026.
Builds on
41 of 59 references.
References · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
29 more
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
- 2020Learning in the Frequency Domaincited by 198
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2020FcaNet: Frequency Channel Attention Networkscited by 179
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2018Auxiliary Tasks in Multi-task Learningcited by 108
- 2021Representative Forgery Mining for Fake Face Detectioncited by 108
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 74
- 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
- 2020Detecting Deep-Fake Videos from Appearance and Behaviorcited by 66
- 2021Deep Dual Consecutive Network for Human Pose Estimationcited by 51
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
- 2024Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detectioncited by 47
- 2022Learning Second Order Local Anomaly for General Face Forgery Detectioncited by 36
- 2022Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domaincited by 28
- 2023Locate and Verify: A Two-Stream Network for Improved Deepfake Detectioncited by 26
- 2023DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Cluescited by 23
- 2021DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learningcited by 20
- 2022Copy Motion From One to Another: Fake Motion Video Generationcited by 13
- 2023Bi-directional Distribution Alignment for Transductive Zero-Shot Learningcited by 7
Built on by
Not cited yet.