Suppressing Gradient Conflict for Generalizable Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Robust deepfake detection models must be capable of generalizing to ever-evolving manipulation techniques beyond training data. A promising strategy is to augment the training data with online synthesized fake images containing broadly generalizable artifacts. However, in the context of deepfake detection, it is surprising that jointly training on both original and online synthesized forgeries may result in degraded performance. This contradicts the common belief that incorporating more source-domain data should enhance detection accuracy. Through empirical analysis, we trace this degradation to gradient conflicts during backpropagation which force a trade-off between source domain accuracy and target domain generalization. To overcome this issue, we propose a Conflict-Suppressed Deepfake Detection (CS-DFD) framework that explicitly mitigates the gradient conflict via two synergistic modules. First, an Update Vector Search (UVS) module searches for an alternative update vector near the initial gradient vector to reconcile the disparities of the original and online synthesized forgeries. By further transforming the search process into an extremum optimization problem, UVS yields the uniquely update vector, which maximizes the simultaneous loss reductions for each data type. Second, a Conflict Gradient Reduction (CGR) module enforces a low-conflict feature embedding space through a novel Conflict Descent Loss. This loss penalizes misaligned gradient directions and guides the learning of representations with aligned, non-conflicting gradients. The synergy of UVS and CGR alleviates gradient interference in both parameter optimization and representation learning. Experiments on multiple deepfake benchmarks demonstrate that CS-DFD achieves state-of-the-art performance in both in-domain detection accuracy and cross-domain generalization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 73 references that are in the map. First posted on arXiv 29 Jul 2025.
Builds on
56 of 73 references.
References · 56
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
38 more
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 334
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
- 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 132
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2022gDDIM: Generalized denoising diffusion implicit modelscited by 125
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
- 2020Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cuescited by 111
- 2021Representative Forgery Mining for Fake Face Detectioncited by 108
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2023Sharpness-Aware Gradient Matching for Domain Generalizationcited by 102
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 74
- 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesiscited by 64
- 2024Exploiting Style Latent Flows for Generalizing Deepfake Video Detectioncited by 59
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 59
- 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
- 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
- 2024Can We Leave Deepfake Data Behind in Training Deepfake Detector?cited by 49
- 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
- 2022Region-Aware Face Swappingcited by 45
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2024Diffusion Facial Forgery Detectioncited by 41
- 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 30
- 2023Contrastive Pseudo Learning for Open-World DeepFake Attributioncited by 27
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.