Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examples
Not on the map. Why?
Abstract (arXiv)
Recent advances in video manipulation techniques have made the generation of fake videos more accessible than ever before. Manipulated videos can fuel disinformation and reduce trust in media. Therefore detection of fake videos has garnered immense interest in academia and industry. Recently developed Deepfake detection methods rely on deep neural networks (DNNs) to distinguish AI-generated fake videos from real videos. In this work, we demonstrate that it is possible to bypass such detectors by adversarially modifying fake videos synthesized using existing Deepfake generation methods. We further demonstrate that our adversarial perturbations are robust to image and video compression codecs, making them a real-world threat. We present pipelines in both white-box and black-box attack scenarios that can fool DNN based Deepfake detectors into classifying fake videos as real.
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 16; 2023: 13; 2024: 14; 2025: 7; 2026: 6.
66 papers.
Sort:
By area:
- 2023Factuality Challenges in the Era of Large Language Modelscited by 125
- 2023Art and the science of generative AI: A deeper divecited by 93
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2022Audio-Visual Person-of-Interest DeepFake Detectioncited by 43
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
- 2021Cross-modal Adversarial Reprogrammingcited by 34
- 2022FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakescited by 18
- 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakescited by 17
- 2022Digital and Physical Face Attacks: Reviewing and One Step Furthercited by 17
- 2022Making DeepFakes more spurious: evading deep face forgery detection via trace removal attackcited by 16
38 more
- 2021Deepfake Forensics via An Adversarial Gamecited by 15
- 2022Testing Human Ability To Detect Deepfake Images of Human Facescited by 15
- 2023Challenges and Remedies to Privacy and Security in AIGC: Exploring the Potential of Privacy Computing, Blockchain, and Beyondcited by 14
- 2024Generative AI Literacy: Twelve Defining Competenciescited by 13
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detectioncited by 12
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attackscited by 12
- 2022D4: Detection of Adversarial Diffusion Deepfakes Using Disjoint Ensemblescited by 11
- 2024Exploring the Adversarial Robustness of CLIP for AI-generated Image Detectioncited by 11
- 2022Generalizable Deepfake Detection with Phase-Based Motion Analysiscited by 10
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2021Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Trackingcited by 9
- 2024XAI-Based Detection of Adversarial Attacks on Deepfake Detectorscited by 9
- 2023An adversarial attack approach for eXplainable AI evaluation on deepfake detection modelscited by 7
- 2021Understanding the Security of Deepfake Detectioncited by 6
- 2022Consistent Attack: Universal Adversarial Perturbation on Embodied Vision Navigationcited by 6
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Modelscited by 6
- 2021Adversarially Perturbed Wavelet-based Morphed Face Generationcited by 4
- 2023Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Modelscited by 4
- 2024Is JPEG AI going to change image forensics?cited by 4
- 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectorscited by 4
- 2022Publishing Efficient On-device Models Increases Adversarial Vulnerabilitycited by 3
- 2023Turn Fake into Real: Adversarial Head Turn Attacks Against Deepfake Detectioncited by 3
- 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attackcited by 3
- 2021Automated Deepfake Detectioncited by 2
- 2022Robust Deepfake On Unrestricted Media: Generation And Detectioncited by 2
- 2022Metamorphic Testing-based Adversarial Attack to Fool Deepfake Detectorscited by 2
- 2022ReFace: Real-time Adversarial Attacks on Face Recognition Systemscited by 2
- 2022FastStamp: Accelerating Neural Steganography and Digital Watermarking of Images on FPGAscited by 2
- 2023NetFlick: Adversarial Flickering Attacks on Deep Learning Based Video Compressioncited by 2
- 20242D-Malafide: Adversarial Attacks Against Face Deepfake Detection Systemscited by 2
- 2024Take Fake as Real: Realistic-like Robust Black-box Adversarial Attack to Evade AIGC Detectioncited by 2
- 2025Improving the Perturbation-Based Explanation of Deepfake Detectors Through the Use of Adversarially-Generated Samplescited by 2
- 2021DeepFakes: Detecting Forged and Synthetic Media Content Using Machine Learningcited by 1
- 2024Adversarially Robust Deepfake Detection via Adversarial Feature Similarity Learningcited by 1
- 2024GRACE: Graph-Regularized Attentive Convolutional Entanglement with Laplacian Smoothing for Robust DeepFake Video Detectioncited by 1
- 2025CAE-Net: Generalized Deepfake Image Detection using Convolution and Attention Mechanisms with Spatial and Frequency Domain Featurescited by 1
- 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancementcited by 1
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detectioncited by 1
50 most cited of 66 All 66 (JSON)
- 2026Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance25 Sep 2026
- 2026What Makes Adversarial Examples Transfer Across Deepfake Detectors?9 Sep 2026
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detection7 Jul 2026
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulations2 Apr 2026
- 2026Universal Anti-forensics Attack against Image Forgery Detection via Multi-modal Guidance6 Feb 2026
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detection25 Nov 2025
- 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attack14 Oct 2025
- 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancement8 Sep 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectors4 Jun 2025
- 2025CAE-Net: Generalized Deepfake Image Detection using Convolution and Attention Mechanisms with Spatial and Frequency Domain Features15 Feb 2025
38 more
- 2025Improving the Perturbation-Based Explanation of Deepfake Detectors Through the Use of Adversarially-Generated Samples6 Feb 2025
- 2024Take Fake as Real: Realistic-like Robust Black-box Adversarial Attack to Evade AIGC Detection9 Dec 2024
- 2024Is JPEG AI going to change image forensics?4 Dec 2024
- 2024Generative AI Literacy: Twelve Defining Competencies29 Nov 2024
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024Deep Learning Technology for Face Forgery Detection: A Survey22 Sep 2024
- 2024Active Fake: DeepFake Camouflage5 Sep 2024
- 20242D-Malafide: Adversarial Attacks Against Face Deepfake Detection Systems26 Aug 2024
- 2024Current Status and Trends in Image Anti-Forensics Research: A Bibliometric Analysis21 Aug 2024
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attacks30 Jul 2024
- 2024Exploring the Adversarial Robustness of CLIP for AI-generated Image Detection28 Jul 2024
- 2024GRACE: Graph-Regularized Attentive Convolutional Entanglement with Laplacian Smoothing for Robust DeepFake Video Detection28 Jun 2024
- 2024Counterfactual Explanations for Face Forgery Detection via Adversarial Removal of Artifacts12 Apr 2024
- 2024XAI-Based Detection of Adversarial Attacks on Deepfake Detectors5 Mar 2024
- 2024Adversarially Robust Deepfake Detection via Adversarial Feature Similarity Learning6 Feb 2024
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detection14 Dec 2023
- 2023An adversarial attack approach for eXplainable AI evaluation on deepfake detection models8 Dec 2023
- 2023Exploring the Adversarial Robustness of Face Forgery Detection with Decision-based Black-box Attacks18 Oct 2023
- 2023Factuality Challenges in the Era of Large Language Models8 Oct 2023
- 2023Turn Fake into Real: Adversarial Head Turn Attacks Against Deepfake Detection3 Sep 2023
- 2023Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Models18 Aug 2023
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models11 Jul 2023
- 2023Art and the science of generative AI: A deeper dive7 Jun 2023
- 2023Challenges and Remedies to Privacy and Security in AIGC: Exploring the Potential of Privacy Computing, Blockchain, and Beyond1 Jun 2023
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detection10 May 2023
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistency23 Apr 2023
- 2023NetFlick: Adversarial Flickering Attacks on Deep Learning Based Video Compression4 Apr 2023
- 2023Watch Out for the Confusing Faces: Detecting Face Swapping with the Probability Distribution of Face Identification Models23 Mar 2023
- 2022Publishing Efficient On-device Models Increases Adversarial Vulnerability28 Dec 2022
- 2022Testing Human Ability To Detect Deepfake Images of Human Faces7 Dec 2022
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunities26 Nov 2022
- 2022Generalizable Deepfake Detection with Phase-Based Motion Analysis17 Nov 2022
- 2022Digital and Physical Face Attacks: Reviewing and One Step Further29 Sep 2022
- 2022FastStamp: Accelerating Neural Steganography and Digital Watermarking of Images on FPGAs26 Sep 2022
- 2022DF-Captcha: A Deepfake Captcha for Preventing Fake Calls17 Aug 2022
- 2022Consistent Attack: Universal Adversarial Perturbation on Embodied Vision Navigation12 Jun 2022
- 2022ReFace: Real-time Adversarial Attacks on Face Recognition Systems9 Jun 2022
- 2022Metamorphic Testing-based Adversarial Attack to Fool Deepfake Detectors19 Apr 2022
50 newest of 66 All 66 (JSON)
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attackscited by 12
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Modelscited by 6
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulationscited by 1
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectorscited by 0
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulations2 Apr 2026
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attacks30 Jul 2024
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models11 Jul 2023
- 2023Factuality Challenges in the Era of Large Language Modelscited by 125
- 2023Art and the science of generative AI: A deeper divecited by 93
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2022Audio-Visual Person-of-Interest DeepFake Detectioncited by 43
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
- 2021Cross-modal Adversarial Reprogrammingcited by 34
- 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakescited by 17
- 2022Digital and Physical Face Attacks: Reviewing and One Step Furthercited by 17
- 2022Making DeepFakes more spurious: evading deep face forgery detection via trace removal attackcited by 16
- 2021Deepfake Forensics via An Adversarial Gamecited by 15
- 2022Testing Human Ability To Detect Deepfake Images of Human Facescited by 15
12 most cited of 59 All 59 (JSON)
- 2026Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance25 Sep 2026
- 2026What Makes Adversarial Examples Transfer Across Deepfake Detectors?9 Sep 2026
- 2026Universal Anti-forensics Attack against Image Forgery Detection via Multi-modal Guidance6 Feb 2026
- 2025Frequency Bias Matters: Diving into Robust and Generalized Deep Image Forgery Detection25 Nov 2025
- 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attack14 Oct 2025
- 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancement8 Sep 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectors4 Jun 2025
- 2025CAE-Net: Generalized Deepfake Image Detection using Convolution and Attention Mechanisms with Spatial and Frequency Domain Features15 Feb 2025
- 2025Improving the Perturbation-Based Explanation of Deepfake Detectors Through the Use of Adversarially-Generated Samples6 Feb 2025
- 2024Take Fake as Real: Realistic-like Robust Black-box Adversarial Attack to Evade AIGC Detection9 Dec 2024
- 2024Is JPEG AI going to change image forensics?4 Dec 2024
12 newest of 59 All 59 (JSON)