Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection System
Not on the map. Why?
Abstract (arXiv)
Deepfake detectors that achieve near-perfect scores on academic benchmarks collapse on real-world content: recent in-the-wild evaluations report AUC drops of 45-50% for state-of-the-art open-source models. We argue this gap is structural: static detectors are trained once against a moving generative frontier. We present BitMind Forensics (BMF), trained through Bittensor SN34, an open adversarial competition that continually refreshes the training distribution. We evaluate one dated export comprising image, general-video, and human-video checkpoints across nineteen public datasets: the canonical face-swap suites (FaceForensics++, Celeb-DF v1/v2/++, DFDC, DFD, UADFV, DF40) and recent in-the-wild and AI-generated-media benchmarks (Sumsub, Deepfake-Eval-2024, WildRF, Community Forensics, AIGCDetectBench, GenImage, AI-GenBench, AIGIBench, RAID, GenVidBench, GenVideo-100K). BMF reaches 0.936 AUC on Sumsub's original images and 0.872 pooled AUC over its full four-condition manipulation battery (1.4M images), staying robust under perturbation (0.855 JPEG, 0.799 downscaled), while GPEN enhancement improves detection (0.996). On Deepfake-Eval-2024, it matches the best commercial detector on images (0.915 vs 0.90) and exceeds it on video (0.822 vs 0.79), far above the best open-source detectors (0.56 and 0.63). It reaches 0.991 AUC on a 21-generator AI-image panel and 0.918 on GenVidBench, and exceeds the FF++-trained frontier on DFDC (0.947 vs 0.843) and Celeb-DF v2 (0.9985 vs 0.956), both contamination-audited, with statistical parity on Celeb-DF++. In a temporal study, successive dated exports improve on held-out media from generators absent from the static baseline's training (image 0.842 to 0.902; video 0.864 to 0.936). Our evaluation harness is public, and at publication the production API serves the exact evaluated snapshot for independent verification.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 48 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
40 of 48 references.
References · 40
- 2022A ConvNet for the 2020scited by 3,579
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
28 more
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2024Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformerscited by 118
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 69
- 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
- 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
- 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?cited by 51
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
- 2025Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024cited by 45
- 2024Fake or JPEG? Revealing Common Biases in Generated Image Detection Datasetscited by 43
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 21
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detectioncited by 10
- 2023Tracing Hyperparameter Dependencies for Model Parsing via Learnable Graph Pooling Networkcited by 8
- 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectorscited by 4
- 2025Fit for Purpose? Deepfake Detection in the Real Worldcited by 4
- 2025Evaluating Deepfake Detectors in the Wildcited by 3
- 2025Performance Decay in Deepfake Detection: The Limitations of Training on Outdated Datacited by 1
- 2026How Effective Are Publicly Accessible Deepfake Detection Tools? A Comparative Evaluation of Open-Source and Free-to-Use Platformscited by 1
Built on by
Not cited yet.