Capture Artifacts via Progressive Disentangling and Purifying Blended Identities for Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
The Deepfake technology has raised serious concerns regarding privacy breaches and trust issues. To tackle these challenges, Deepfake detection technology has emerged. Current methods over-rely on the global feature space, which contains redundant information independent of the artifacts. As a result, existing Deepfake detection techniques suffer performance degradation when encountering unknown datasets. To reduce information redundancy, the current methods use disentanglement techniques to roughly separate the fake faces into artifacts and content information. However, these methods lack a solid disentanglement foundation and cannot guarantee the reliability of their disentangling process. To address these issues, a Deepfake detection method based on progressive disentangling and purifying blended identities is innovatively proposed in this paper. Based on the artifact generation mechanism, the coarse- and fine-grained strategies are combined to ensure the reliability of the disentanglement method. Our method aims to more accurately capture and separate artifact features in fake faces. Specifically, we first perform the coarse-grained disentangling on fake faces to obtain a pair of blended identities that require no additional annotation to distinguish between source face and target face. Then, the artifact features from each identity are separated to achieve fine-grained disentanglement. To obtain pure identity information and artifacts, an Identity-Artifact Correlation Compression module (IACC) is designed based on the information bottleneck theory, effectively reducing the potential correlation between identity information and artifacts. Additionally, an Identity-Artifact Separation Contrast Loss is designed to enhance the independence of artifact features post-disentangling. Finally, the classifier only focuses on pure artifact features to achieve a generalized Deepfake detector.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 52 references that are in the map. First posted on arXiv 14 Oct 2024.
Builds on
32 of 52 references.
References · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2015Deep Learning and the Information Bottleneck Principlecited by 802
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 718
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
20 more
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 198
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 74
- 2020DeepFake Detection: Current Challenges and Next Stepscited by 44
- 2022Exploring Disentangled Content Information for Face Forgery Detectioncited by 36
Built on by
Citing papers per year: 2025: 1.
1 paper.