mlsanityData to 13 Oct 2026

The Alpha Blending Hypothesis: Compositing Shortcut in Deepfake Detection

arXiv 2605.10334 ↗First posted 11 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent deepfake detection methods demonstrate improved cross-dataset generalization, yet the underlying mechanisms remain underexplored. We introduce the Alpha Blending Hypothesis, positing that state-of-the-art frame-based detectors primarily function as alpha blending searchers; rather than learning semantic anomalies or specific generative neural fingerprints, they localize low-level compositing artifacts introduced during the integration of manipulated faces into target frames. We experimentally validate the hypothesis, demonstrating that deepfake detectors exhibit high sensitivity to the so-called self-blended images (SBI) and non-generative manipulations. We propose the method BlenD that leverages a large-scale, diverse dataset of real-only facial images augmented with SBI. This approach achieves the best average cross-dataset generalization on 15 compositional deepfake datasets released between 2019 and 2025 without utilizing explicitly generated deepfakes during training. Furthermore, we show that predictions from explicit blending searchers and models resilient to blending shortcuts are highly complementary, yielding a state-of-the-art AUROC of 94.0% in an ensemble configuration. The code with experiments and the trained model will be publicly released.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 46 of its 60 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

46 of 60 references.

References · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2025DINOv3cited by 1,355
  3. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,097
  4. 2015Cyclical Learning Rates for Training Neural Networkscited by 627
  5. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 574
  6. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 488
  7. 2022Detecting Deepfakes with Self-Blended Imagescited by 333
  8. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 319
  9. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 296
  10. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  11. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
  12. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
34 more
  1. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 204
  2. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 180
  3. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
  4. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 163
  5. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  6. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
  7. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 103
  8. 2021Face Forensics in the Wildcited by 87
  9. 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
  10. 2020Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlightscited by 59
  11. 2024LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervisioncited by 56
  12. 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
  13. 2020Face Forgery Detection by 3D Decompositioncited by 53
  14. 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
  15. 2023Diff2Lip: Audio Conditioned Diffusion Models for Lip-Synchronizationcited by 49
  16. 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
  17. 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generationcited by 38
  18. 2024Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakescited by 32
  19. 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 30
  20. 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learningcited by 22
  21. 2024Learning Spatiotemporal Inconsistency via Thumbnail Layout for Face Deepfake Detectioncited by 21
  22. 2025Deepfake Detection that Generalizes Across Benchmarkscited by 21
  23. 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 20
  24. 2022Parameter-Efficient Tuning on Layer Normalization for Pre-trained Language Modelscited by 19
  25. 2022Model Attribution of Face-swap Deepfake Videoscited by 17
  26. 2024PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Datasetcited by 16
  27. 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Frameworkcited by 14
  28. 2024Identity-Driven Multimedia Forgery Detection via Reference Assistancecited by 14
  29. 2025Beyond Spatial Frequency: Pixel-wise Temporal Frequency-based Deepfake Video Detectioncited by 13
  30. 2025Detecting Lip-Syncing Deepfakes: Vision Temporal Transformer for Analyzing Mouth Inconsistenciescited by 7
  31. 2024HelloMeme: Integrating Spatial Knitting Attentions to Embed High-Level and Fidelity-Rich Conditions in Diffusion Modelscited by 6
  32. 2025Scaling Laws for Deepfake Detectioncited by 5
  33. 2025Towards Real-World Deepfake Detection: A Diverse In-the-wild Dataset of Forgery Facescited by 1
  34. 2025Scalable Face Security Vision Foundation Model for Deepfake, Diffusion, and Spoofing Detectioncited by 1

Built on by

Not cited yet.