mlsanityData to 14 Oct 2026

The Deepfakes We Missed: We Built Detectors for a Threat That Didn't Arrive

arXiv 2605.12075 ↗First posted 12 May 2026cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Nearly a decade of Machine Learning (ML) research on deepfake detection has been organized around a threat model inherited from 2017--2019, revolving around face-swap and talking-head manipulation of public figures, motivated by concerns about large-scale misinformation and video-evidence fraud. This position paper argues that the threat the field prepared for did not arrive, and the threats that did arrive are substantially different. An accounting of deepfake incidents in 2022--2026 shows that the dominant observed harms are peer-generated Non-Consensual Intimate Imagery (NCII), voice-clone scam calls targeting families and finance workers, and emotional-manipulation fraud. The predicted large-scale public-figure deepfake catastrophe did not materialize during the 2024 global information environment despite extensive preparation. Meanwhile, research effort, benchmarks, and detection methods remain concentrated on the inherited threat model. The central claim of this paper is that this misalignment is now the dominant bottleneck on real-world deepfake defense, not model capability. We argue the ML research community should substantially rebalance its research agenda toward the harm categories that are actually growing. We support this position with empirical accounting of research effort and harm distribution, identify the structural reasons the misalignment persists, and outline three concrete technical research agendas for the under-defended harm categories.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

15 of 32 references.

References · 15

  1. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  2. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  3. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
  4. 2020The Creation and Detection of Deepfakes: A Surveycited by 247
  5. 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
  6. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
  7. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
  8. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  9. 2021Face Forensics in the Wildcited by 87
  10. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
  11. 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
  12. 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 43
3 more
  1. 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 30
  2. 2024GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learningcited by 12
  3. 2022Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Reviewcited by 6

Built on by

Not cited yet.