DF-Captcha: A Deepfake Captcha for Preventing Fake Calls
Not on the map. Why?
Abstract (arXiv)
Social engineering (SE) is a form of deception that aims to trick people into giving access to data, information, networks and even money. For decades SE has been a key method for attackers to gain access to an organization, virtually skipping all lines of defense. Attackers also regularly use SE to scam innocent people by making threatening phone calls which impersonate an authority or by sending infected emails which look like they have been sent from a loved one. SE attacks will likely remain a top attack vector for criminals because humans are the weakest link in cyber security. Unfortunately, the threat will only get worse now that a new technology called deepfakes as arrived. A deepfake is believable media (e.g., videos) created by an AI. Although the technology has mostly been used to swap the faces of celebrities, it can also be used to `puppet' different personas. Recently, researchers have shown how this technology can be deployed in real-time to clone someone's voice in a phone call or reenact a face in a video call. Given that any novice user can download this technology to use it, it is no surprise that criminals have already begun to monetize it to perpetrate their SE attacks. In this paper, we propose a lightweight application which can protect organizations and individuals from deepfake SE attacks. Through a challenge and response approach, we leverage the technical and theoretical limitations of deepfake technologies to expose the attacker. Existing defence solutions are too heavy as an end-point solution and can be evaded by a dynamic attacker. In contrast, our approach is lightweight and breaks the reactive arms race, putting the attacker at a disadvantage.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 47 of its 94 references that are in the map. First posted on arXiv 17 Aug 2022.
Builds on
47 of 94 references.
References · 47
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2020First Order Motion Model for Image Animationcited by 704
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2016Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samplescited by 446
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2018Everybody Dance Nowcited by 315
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
35 more
- 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 282
- 2019On the Detection of Digital Face Manipulationcited by 260
- 2018Adversarial Attacks and Defences: A Surveycited by 259
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
- 2019Few-shot Video-to-Video Synthesiscited by 197
- 2018Do GANs leave artificial fingerprints?cited by 190
- 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
- 2018Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detectioncited by 121
- 2018FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Facescited by 119
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
- 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
- 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
- 2019Unmasking DeepFakes with simple Featurescited by 78
- 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
- 2018N-BaIoT: Network-based Detection of IoT Botnet Attacks Using Deep Autoencoderscited by 67
- 2020Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examplescited by 66
- 2018Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPosecited by 42
- 2019On the generalization of GAN image forensicscited by 36
- 2020Deepfake Detection using Spatiotemporal Convolutional Networkscited by 32
- 2019Dance Dance Generation: Motion Transfer for Internet Videoscited by 28
- 2020DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voicescited by 24
- 2019Towards Generalizable Deepfake Detection with Locality-aware AutoEncodercited by 17
- 2019Swapped Face Detection using Deep Learning and Subjective Assessmentcited by 14
- 2019MetaPix: Few-Shot Video Retargetingcited by 13
- 2019FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Facescited by 12
- 2019Deep Transfer Across Domains for Face Anti-spoofingcited by 6
- 2019Zooming into Face Forensics: A Pixel-level Analysiscited by 6
- 2020Robust Output Regulation of the Linearized Boussinesq Equations with Boundary Control and Observationcited by 6
- 2018Speech-Driven Facial Reenactment Using Conditional Generative Adversarial Networkscited by 4
- 2019Exploiting Human Social Cognition for the Detection of Fake and Fraudulent Faces via Memory Networkscited by 4
- 2020Fake face detection via adaptive manipulation traces extraction networkcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.