mlsanityData to 14 Oct 2026

DBCF: Dual-Branch Complementary Fusion of Foundation Models for Generalized Deepfake Detection

arXiv 2609.34720 ↗First posted 28 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

As image generation and editing technologies have progressed substantially, facial forgeries pose significant challenges to privacy and public safety. Due to limited ability to capture forgery cues, existing small-scale forgery detection models often struggle to generalize across various domains and unseen manipulations. To address this limitation, researchers have turned to large-scale foundation models, which can provide richer representations and better generalization. Nevertheless, relying on a single foundation model alone remains insufficient for effective forgery detection. While models like CLIP offer robust global semantic cues, they lack the capacity to capture detailed local facial features. In contrast, DINO excels at capturing local structural features of faces, but provides weaker global semantic context. To fully utilize the synergies among multiple foundation models, we propose a hierarchical multi-granular framework that integrates complementary pretrained representations. Specifically, a Global Context Branch (GCB) based on CLIP captures holistic semantic cues, while a Fine-grained Cue Branch (FCB) built on DINOv3 captures localized structural irregularities. In addition, we design a feature fusion module that enables parameter-efficient adaptation of the frozen foundation backbones by adaptively extracting and integrating complementary features from the two models. By jointly leveraging global context and fine-grained cues, our method learns more comprehensive forgery representations and achieves strong cross-manipulation performance. Extensive experiments on multiple benchmarks demonstrate the benefit of the proposed design, particularly under cross-dataset and cross-manipulation settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 54 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

43 of 54 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  7. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  8. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  9. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  10. 2020First Order Motion Model for Image Animationcited by 704
  11. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  12. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
31 more
  1. 2022Vision Transformer Adapter for Dense Predictionscited by 565
  2. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  3. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  4. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  5. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  6. 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
  7. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
  8. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
  9. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
  10. 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 131
  11. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  12. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
  13. 2020NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofingcited by 105
  14. 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
  15. 2022Domain Generalization via Shuffled Style Assembly for Face Anti-Spoofingcited by 73
  16. 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
  17. 2022PatchNet: A Simple Face Anti-Spoofing Framework via Fine-Grained Patch Recognitioncited by 67
  18. 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
  19. 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
  20. 2024Can We Leave Deepfake Data Behind in Training Deepfake Detector?cited by 49
  21. 2023Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignmentcited by 48
  22. 2024CLIPping the Deception: Adapting Vision-Language Models for Universal Deepfake Detectioncited by 47
  23. 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 40
  24. 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
  25. 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 31
  26. 2023DeepFake-Adapter: Dual-Level Adapter for DeepFake Detectioncited by 26
  27. 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
  28. 2023Real Face Foundation Representation Learning for Generalized Deepfake Detectioncited by 8
  29. 2024Generalized Face Liveness Detection via De-fake Face Generatorcited by 4
  30. 2025Reduced Spatial Dependency for More General Video-level Deepfake Detectioncited by 2
  31. 2025Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentationcited by 1

Built on by

Not cited yet.