mlsanityData to 14 Oct 2026

Suppressing Gradient Conflict for Generalizable Deepfake Detection

arXiv 2507.21530 ↗First posted 29 Jul 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Robust deepfake detection models must be capable of generalizing to ever-evolving manipulation techniques beyond training data. A promising strategy is to augment the training data with online synthesized fake images containing broadly generalizable artifacts. However, in the context of deepfake detection, it is surprising that jointly training on both original and online synthesized forgeries may result in degraded performance. This contradicts the common belief that incorporating more source-domain data should enhance detection accuracy. Through empirical analysis, we trace this degradation to gradient conflicts during backpropagation which force a trade-off between source domain accuracy and target domain generalization. To overcome this issue, we propose a Conflict-Suppressed Deepfake Detection (CS-DFD) framework that explicitly mitigates the gradient conflict via two synergistic modules. First, an Update Vector Search (UVS) module searches for an alternative update vector near the initial gradient vector to reconcile the disparities of the original and online synthesized forgeries. By further transforming the search process into an extremum optimization problem, UVS yields the uniquely update vector, which maximizes the simultaneous loss reductions for each data type. Second, a Conflict Gradient Reduction (CGR) module enforces a low-conflict feature embedding space through a novel Conflict Descent Loss. This loss penalizes misaligned gradient directions and guides the learning of representations with aligned, non-conflicting gradients. The synergy of UVS and CGR alleviates gradient interference in both parameter optimization and representation learning. Experiments on multiple deepfake benchmarks demonstrate that CS-DFD achieves state-of-the-art performance in both in-domain detection accuracy and cross-domain generalization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 73 references that are in the map. First posted on arXiv 29 Jul 2025.

Builds on

56 of 73 references.

References · 56

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  9. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  10. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  11. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
  12. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
38 more
  1. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  2. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  3. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
  4. 2021Multi-attentional Deepfake Detectioncited by 341
  5. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  6. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 334
  7. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
  8. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
  9. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  10. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
  11. 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 132
  12. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  13. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
  14. 2022gDDIM: Generalized denoising diffusion implicit modelscited by 125
  15. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
  16. 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
  17. 2020Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cuescited by 111
  18. 2021Representative Forgery Mining for Fake Face Detectioncited by 108
  19. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
  20. 2023Sharpness-Aware Gradient Matching for Domain Generalizationcited by 102
  21. 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
  22. 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
  23. 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
  24. 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 74
  25. 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesiscited by 64
  26. 2024Exploiting Style Latent Flows for Generalizing Deepfake Video Detectioncited by 59
  27. 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 59
  28. 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
  29. 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
  30. 2024Can We Leave Deepfake Data Behind in Training Deepfake Detector?cited by 49
  31. 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
  32. 2022Region-Aware Face Swappingcited by 45
  33. 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
  34. 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
  35. 2022Voice-Face Homogeneity Tells Deepfakecited by 44
  36. 2024Diffusion Facial Forgery Detectioncited by 41
  37. 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 30
  38. 2023Contrastive Pseudo Learning for Open-World DeepFake Attributioncited by 27

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.