Restricted Black-box Adversarial Attack Against DeepFake Face Swapping
Not on the map. Why?
Abstract (arXiv)
DeepFake face swapping presents a significant threat to online security and social media, which can replace the source face in an arbitrary photo/video with the target face of an entirely different person. In order to prevent this fraud, some researchers have begun to study the adversarial methods against DeepFake or face manipulation. However, existing works focus on the white-box setting or the black-box setting driven by abundant queries, which severely limits the practical application of these methods. To tackle this problem, we introduce a practical adversarial attack that does not require any queries to the facial image forgery model. Our method is built on a substitute model persuing for face reconstruction and then transfers adversarial examples from the substitute model directly to inaccessible black-box DeepFake models. Specially, we propose the Transferable Cycle Adversary Generative Adversarial Network (TCA-GAN) to construct the adversarial perturbation for disrupting unknown DeepFake systems. We also present a novel post-regularization module for enhancing the transferability of generated adversarial examples. To comprehensively measure the effectiveness of our approaches, we construct a challenging benchmark of DeepFake adversarial attacks for future development. Extensive experiments impressively show that the proposed adversarial attack method makes the visual quality of DeepFake face images plummet so that they are easier to be detected by humans and algorithms. Moreover, we demonstrate that the proposed algorithm can be generalized to offer face image protection against various face translation methods.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 47 of its 64 references that are in the map. First posted on arXiv 26 Apr 2022.
Builds on
47 of 64 references.
References · 47
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2016Adversarial examples in the physical worldcited by 1,762
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
35 more
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2016Universal adversarial perturbationscited by 774
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
- 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 656
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 591
- 2017One pixel attack for fooling deep neural networkscited by 579
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 440
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
- 2019Minimally distorted Adversarial Examples with a Fast Adaptive Boundary Attackcited by 333
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2018Generating Adversarial Examples with Adversarial Networkscited by 256
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 208
- 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
- 2019Real Image Denoising with Feature Attentioncited by 176
- 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
- 2019Enhancing Adversarial Example Transferability with an Intermediate Level Attackcited by 139
- 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
- 2019ColorFool: Semantic Adversarial Colorizationcited by 89
- 2020Towards Transferable Adversarial Attack against Deep Face Recognitioncited by 79
- 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
- 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
- 2020Video Face Manipulation Detection Through Ensemble of CNNscited by 63
- 2017Adversarial examples for generative modelscited by 58
- 2017APE-GAN: Adversarial Perturbation Elimination with GANcited by 57
- 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
- 2018Physics-Based Generative Adversarial Models for Image Restoration and Beyondcited by 37
- 2016Adversarial Images for Variational Autoencoderscited by 19
- 2019Walking on the Edge: Fast, Low-Distortion Adversarial Examplescited by 18
- 2020Protecting Against Image Translation Deepfakes by Leaking Universal Perturbations from Black-Box Neural Networkscited by 7
- 2021Landmark Breaker: Obstructing DeepFake By Disturbing Landmark Extractioncited by 5
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 10; 2026: 7.
25 papers.
Sort:
By area:
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challengescited by 16
- 2024Artwork Protection Against Neural Style Transfer Using Locally Adaptive Adversarial Color Attackcited by 9
- 2025NullSwap: Proactive Identity Cloaking Against Deepfake Face Swappingcited by 8
- 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AIcited by 7
- 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identificationcited by 4
- 2025FaceSwapGuard: Safeguarding Facial Privacy from DeepFake Threats through Identity Obfuscationcited by 4
- 2025My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swappingcited by 4
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
- 2023Deep Ensemble Learning with Frame Skipping for Face Anti-Spoofingcited by 3
- 2026CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoningcited by 3
- 2024Enhancing Adversarial Robustness via Uncertainty-Aware Distributional Adversarial Trainingcited by 2
13 more
- 2025AI-based Identity Fraud Detection: A Systematic Reviewcited by 2
- 2025Mind the Trojan Horse: Image Prompt Adapter Enabling Scalable and Deceptive Jailbreakingcited by 2
- 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancementcited by 1
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editingcited by 1
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemescited by 1
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulationscited by 1
- 2026Transferable Attack against Face Swapping in an Extended Spacecited by 1
- 2023Deepfake Detection using Biological Features: A Surveycited by 0
- 2025Defending Deepfake via Texture Feature Perturbationcited by 0
- 2025Learning from Few Samples: A Novel Approach for High-Quality Malcode Generationcited by 0
- 2025Virtual camera detection: Catching video injection attacks in remote biometric systemscited by 0
- 2026ID-Eraser: Proactive Defense Against Face Swapping via Identity Perturbationcited by 0
- 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Studycited by 0
- 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Study22 Sep 2026
- 2026Transferable Attack against Face Swapping in an Extended Space24 Jun 2026
- 2026CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoning28 May 2026
- 2026ID-Eraser: Proactive Defense Against Face Swapping via Identity Perturbation23 Apr 2026
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulations2 Apr 2026
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemes25 Feb 2026
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editing30 Jan 2026
- 2025Virtual camera detection: Catching video injection attacks in remote biometric systems11 Dec 2025
- 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancement8 Sep 2025
- 2025Learning from Few Samples: A Novel Approach for High-Quality Malcode Generation25 Aug 2025
- 2025Defending Deepfake via Texture Feature Perturbation24 Aug 2025
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
13 more
- 2025My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swapping21 May 2025
- 2025Mind the Trojan Horse: Image Prompt Adapter Enabling Scalable and Deceptive Jailbreaking8 Apr 2025
- 2025NullSwap: Proactive Identity Cloaking Against Deepfake Face Swapping24 Mar 2025
- 2025FaceSwapGuard: Safeguarding Facial Privacy from DeepFake Threats through Identity Obfuscation15 Feb 2025
- 2025AI-based Identity Fraud Detection: A Systematic Review16 Jan 2025
- 2024Enhancing Adversarial Robustness via Uncertainty-Aware Distributional Adversarial Training5 Nov 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification20 Sep 2024
- 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AI22 Apr 2024
- 2024Artwork Protection Against Neural Style Transfer Using Locally Adaptive Adversarial Color Attack18 Jan 2024
- 2023Deep Ensemble Learning with Frame Skipping for Face Anti-Spoofing6 Jul 2023
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challenges24 Mar 2023
- 2023Deepfake Detection using Biological Features: A Survey14 Jan 2023
- 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challengescited by 16
- 2024Artwork Protection Against Neural Style Transfer Using Locally Adaptive Adversarial Color Attackcited by 9
- 2025NullSwap: Proactive Identity Cloaking Against Deepfake Face Swappingcited by 8
- 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AIcited by 7
- 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identificationcited by 4
- 2025FaceSwapGuard: Safeguarding Facial Privacy from DeepFake Threats through Identity Obfuscationcited by 4
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
- 2023Deep Ensemble Learning with Frame Skipping for Face Anti-Spoofingcited by 3
- 2024Enhancing Adversarial Robustness via Uncertainty-Aware Distributional Adversarial Trainingcited by 2
- 2025AI-based Identity Fraud Detection: A Systematic Reviewcited by 2
- 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancementcited by 1
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editingcited by 1
12 most cited of 20 All 20 (JSON)
- 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Study22 Sep 2026
- 2026Transferable Attack against Face Swapping in an Extended Space24 Jun 2026
- 2026ID-Eraser: Proactive Defense Against Face Swapping via Identity Perturbation23 Apr 2026
- 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemes25 Feb 2026
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editing30 Jan 2026
- 2025Virtual camera detection: Catching video injection attacks in remote biometric systems11 Dec 2025
- 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancement8 Sep 2025
- 2025Learning from Few Samples: A Novel Approach for High-Quality Malcode Generation25 Aug 2025
- 2025Defending Deepfake via Texture Feature Perturbation24 Aug 2025
- 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systems3 Aug 2025
- 2025NullSwap: Proactive Identity Cloaking Against Deepfake Face Swapping24 Mar 2025
- 2025FaceSwapGuard: Safeguarding Facial Privacy from DeepFake Threats through Identity Obfuscation15 Feb 2025
12 newest of 20 All 20 (JSON)