mlsanityData to 14 Oct 2026

DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detection

arXiv 2609.35096 ↗First posted 28 Sep 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deepfake detection methods have become increasingly effective yet most provide limited insight into the evidence behind their predictions. However, in forensic settings users also need to know which manipulation cues support the decision and where they appear. Existing explainability methods only partially address this need since localization-based approaches lack semantic descriptions while language-based explanation methods are only weakly grounded in visual evidence. In this work, we propose DF-CBM, a region-aware concept bottleneck model for explainable deepfake detection. DF-CBM builds a compact vocabulary of manipulation-related concepts from textual artifact annotations and links each concept to plausible facial and boundary regions. It then predicts these concepts from visual features using a concept-specific masked attention mechanism guided by parsed facial masks and the final real/fake decision is made from the predicted concept bottleneck. Our experiments show that DF-CBM outperforms concept-based baselines in concept prediction and deepfake classification while remaining competitive with state-of-the-art black-box detectors. Finally, qualitative results and intervention analyses demonstrate that DF-CBM provides spatially grounded concept evidence and enables counterfactual explanations of how individual manipulation concepts influence the final prediction. Our code is available at: https://github.com/GeorgeTsoumplekas/DF-CBM.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 70 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

54 of 70 references.

References · 54

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  7. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  8. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  9. 2020Concept Bottleneck Modelscited by 1,032
  10. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  11. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  12. 2019Face X-ray for More General Face Forgery Detectioncited by 470
38 more
  1. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  2. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
  3. 2022Post-hoc Concept Bottleneck Modelscited by 293
  4. 2023Label-Free Concept Bottleneck Modelscited by 285
  5. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
  6. 2020The Creation and Detection of Deepfakes: A Surveycited by 247
  7. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
  8. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
  9. 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
  10. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  11. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
  12. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 122
  13. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  14. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
  15. 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
  16. 2021Face Forensics in the Wildcited by 87
  17. 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
  18. 2024Common Sense Reasoning for Deepfake Detectioncited by 65
  19. 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
  20. 2023Learning Bottleneck Concepts in Image Classificationcited by 49
  21. 2024Can We Leave Deepfake Data Behind in Training Deepfake Detector?cited by 49
  22. 2024Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detectioncited by 47
  23. 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
  24. 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
  25. 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 31
  26. 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
  27. 2024MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detectioncited by 27
  28. 2025Exploring Unbiased Deepfake Detection via Token-Level Shuffling and Mixingcited by 27
  29. 2023DeepFake-Adapter: Dual-Level Adapter for DeepFake Detectioncited by 26
  30. 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoningcited by 23
  31. 2024SegFace: Face Segmentation of Long-Tail Classescited by 18
  32. 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasingcited by 14
  33. 2025Show and Tell: Visually Explainable Deep Neural Nets via Spatially-Aware Concept Bottleneck Modelscited by 12
  34. 2024Learning to Discover Forgery Cues for Face Forgery Detectioncited by 11
  35. 2025ExDDV: A New Dataset for Explainable Deepfake Detection in Videocited by 10
  36. 2025PersonaLive! Expressive Portrait Image Animation for Live Streamingcited by 9
  37. 2023ProtoExplorer: Interpretable Forensic Analysis of Deepfake Videos using Prototype Exploration and Refinementcited by 5
  38. 2025Locality-aware Concept Bottleneck Modelcited by 4

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.