mlsanityData to 14 Oct 2026

Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection System

arXiv 2607.13234 ↗First posted 14 Jul 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Deepfake detectors that achieve near-perfect scores on academic benchmarks collapse on real-world content: recent in-the-wild evaluations report AUC drops of 45-50% for state-of-the-art open-source models. We argue this gap is structural: static detectors are trained once against a moving generative frontier. We present BitMind Forensics (BMF), trained through Bittensor SN34, an open adversarial competition that continually refreshes the training distribution. We evaluate one dated export comprising image, general-video, and human-video checkpoints across nineteen public datasets: the canonical face-swap suites (FaceForensics++, Celeb-DF v1/v2/++, DFDC, DFD, UADFV, DF40) and recent in-the-wild and AI-generated-media benchmarks (Sumsub, Deepfake-Eval-2024, WildRF, Community Forensics, AIGCDetectBench, GenImage, AI-GenBench, AIGIBench, RAID, GenVidBench, GenVideo-100K). BMF reaches 0.936 AUC on Sumsub's original images and 0.872 pooled AUC over its full four-condition manipulation battery (1.4M images), staying robust under perturbation (0.855 JPEG, 0.799 downscaled), while GPEN enhancement improves detection (0.996). On Deepfake-Eval-2024, it matches the best commercial detector on images (0.915 vs 0.90) and exceeds it on video (0.822 vs 0.79), far above the best open-source detectors (0.56 and 0.63). It reaches 0.991 AUC on a 21-generator AI-image panel and 0.918 on GenVidBench, and exceeds the FF++-trained frontier on DFDC (0.947 vs 0.843) and Celeb-DF v2 (0.9985 vs 0.956), both contamination-audited, with statistical parity on Celeb-DF++. In a temporal study, successive dated exports improve on held-out media from generators absent from the static baseline's training (image 0.842 to 0.902; video 0.864 to 0.936). Our evaluation harness is public, and at publication the production API serves the exact evaluated snapshot for independent verification.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 48 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

40 of 48 references.

References · 40

  1. 2022A ConvNet for the 2020scited by 3,579
  2. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  3. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  4. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  5. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  6. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  7. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  8. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
  9. 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
  10. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  11. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  12. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
28 more
  1. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  2. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  3. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  4. 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
  5. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
  6. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  7. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
  8. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
  9. 2024Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformerscited by 118
  10. 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
  11. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  12. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
  13. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
  14. 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 69
  15. 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
  16. 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
  17. 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?cited by 51
  18. 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
  19. 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 45
  20. 2024Fake or JPEG? Revealing Common Biases in Generated Image Detection Datasetscited by 43
  21. 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 21
  22. 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detectioncited by 10
  23. 2023Tracing Hyperparameter Dependencies for Model Parsing via Learnable Graph Pooling Networkcited by 8
  24. 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectorscited by 4
  25. 2025Fit for Purpose? Deepfake Detection in the Real Worldcited by 4
  26. 2025Evaluating Deepfake Detectors in the Wildcited by 3
  27. 2025Performance Decay in Deepfake Detection: The Limitations of Training on Outdated Datacited by 1
  28. 2026How Effective Are Publicly Accessible Deepfake Detection Tools? A Comparative Evaluation of Open-Source and Free-to-Use Platformscited by 1

Built on by

Not cited yet.