Deep-Fake CAPTCHA: Mitigating Next-Generation Social Engineering Attacks
Not on the map. Why?
Abstract (arXiv)
This paper presents DF-CAPTCHA, an active defense against real-time deepfake impersonation in voice and video calls. Instead of passively searching for artifacts, DF-CAPTCHA prompts the caller to perform simple challenge-response tasks that are easy for humans but difficult for current real-time deepfake systems to generate convincingly. The framework verifies the response using four criteria: realism, identity consistency, task completion, and response time. We evaluate the approach across both audio and video modalities using user studies and experiments with real-time deepfake models. Results show that people often struggle to distinguish real-time deepfakes from authentic media, while DF-CAPTCHA substantially improves detection performance over passive methods, reaching high accuracy in both modalities. These findings suggest that active challenge-based verification is a practical and robust defense against next-generation social engineering attacks based on real-time deepfakes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 91 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
43 of 91 references.
References · 43
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2020First Order Motion Model for Image Animationcited by 698
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
31 more
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 173
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2020End-to-end anti-spoofing with RawNet2cited by 160
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 157
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 143
- 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 129
- 2022Does Audio Deepfake Detection Generalize?cited by 129
- 2019One-shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalizationcited by 82
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
- 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 73
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
- 2021StarGANv2-VC: A Diverse, Unsupervised, Non-parallel Framework for Natural-Sounding Voice Conversioncited by 57
- 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
- 2020FragmentVC: Any-to-Any Voice Conversion by End-to-End Extracting and Fusing Fine-Grained Voice Fragments With Attentioncited by 37
- 2024VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignmentcited by 37
- 2020Deepfakes Detection with Automatic Face Weightingcited by 35
- 2020Deepfake Detection using Spatiotemporal Convolutional Networkscited by 32
- 2019ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworkscited by 23
- 2021Raw Differentiable Architecture Search for Speech Deepfake and Spoofing Detectioncited by 22
- 2021Assem-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniquescited by 11
- 2022Deepfake audio detection by speaker verificationcited by 11
- 2022Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detectioncited by 9
- 2022SpecRNet: Towards Faster and More Accessible Audio DeepFake Detectioncited by 9
- 2021MediumVC: Any-to-any voice conversion using synthetic specific-speaker speeches as intermedium featurescited by 8
- 2019We Need No Pixels: Video Manipulation Detection Using Stream Descriptorscited by 7
- 2023Deepfake CAPTCHA: A Method for Preventing Fake Callscited by 7
Built on by
Not cited yet.