mlsanityData to 7 Oct 2026

Deep-Fake CAPTCHA: Mitigating Next-Generation Social Engineering Attacks

arXiv 2609.11404 ↗First posted 10 Sep 2026cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents DF-CAPTCHA, an active defense against real-time deepfake impersonation in voice and video calls. Instead of passively searching for artifacts, DF-CAPTCHA prompts the caller to perform simple challenge-response tasks that are easy for humans but difficult for current real-time deepfake systems to generate convincingly. The framework verifies the response using four criteria: realism, identity consistency, task completion, and response time. We evaluate the approach across both audio and video modalities using user studies and experiments with real-time deepfake models. Results show that people often struggle to distinguish real-time deepfakes from authentic media, while DF-CAPTCHA substantially improves detection performance over passive methods, reaching high accuracy in both modalities. These findings suggest that active challenge-based verification is a practical and robust defense against next-generation social engineering attacks based on real-time deepfakes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 91 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

43 of 91 references.

References · 43

  1. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
  2. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  3. 2020First Order Motion Model for Image Animationcited by 698
  4. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  5. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  6. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
  7. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
  8. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
  9. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
  10. 2019On the Detection of Digital Face Manipulationcited by 259
  11. 2020The Creation and Detection of Deepfakes: A Surveycited by 246
  12. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
31 more
  1. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
  2. 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
  3. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
  4. 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 173
  5. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
  6. 2020End-to-end anti-spoofing with RawNet2cited by 160
  7. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 157
  8. 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 143
  9. 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 129
  10. 2022Does Audio Deepfake Detection Generalize?cited by 129
  11. 2019One-shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalizationcited by 82
  12. 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
  13. 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
  14. 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
  15. 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
  16. 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
  17. 2021StarGANv2-VC: A Diverse, Unsupervised, Non-parallel Framework for Natural-Sounding Voice Conversioncited by 57
  18. 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
  19. 2020FragmentVC: Any-to-Any Voice Conversion by End-to-End Extracting and Fusing Fine-Grained Voice Fragments With Attentioncited by 37
  20. 2024VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignmentcited by 37
  21. 2020Deepfakes Detection with Automatic Face Weightingcited by 35
  22. 2020Deepfake Detection using Spatiotemporal Convolutional Networkscited by 32
  23. 2019ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworkscited by 23
  24. 2021Raw Differentiable Architecture Search for Speech Deepfake and Spoofing Detectioncited by 22
  25. 2021Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniquescited by 11
  26. 2022Deepfake audio detection by speaker verificationcited by 11
  27. 2022Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detectioncited by 9
  28. 2022SpecRNet: Towards Faster and More Accessible Audio DeepFake Detectioncited by 9
  29. 2021MediumVC: Any-to-any voice conversion using synthetic specific-speaker speeches as intermedium featurescited by 8
  30. 2019We Need No Pixels: Video Manipulation Detection Using Stream Descriptorscited by 7
  31. 2023Deepfake CAPTCHA: A Method for Preventing Fake Callscited by 7

Built on by

Not cited yet.