mlsanityData to 7 Oct 2026

Restricted Black-box Adversarial Attack Against DeepFake Face Swapping

arXiv 2204.12347 ↗First posted 26 Apr 2022cs.CV cs.CRcited by 25

Not on the map. Why?

Abstract (arXiv)

DeepFake face swapping presents a significant threat to online security and social media, which can replace the source face in an arbitrary photo/video with the target face of an entirely different person. In order to prevent this fraud, some researchers have begun to study the adversarial methods against DeepFake or face manipulation. However, existing works focus on the white-box setting or the black-box setting driven by abundant queries, which severely limits the practical application of these methods. To tackle this problem, we introduce a practical adversarial attack that does not require any queries to the facial image forgery model. Our method is built on a substitute model persuing for face reconstruction and then transfers adversarial examples from the substitute model directly to inaccessible black-box DeepFake models. Specially, we propose the Transferable Cycle Adversary Generative Adversarial Network (TCA-GAN) to construct the adversarial perturbation for disrupting unknown DeepFake systems. We also present a novel post-regularization module for enhancing the transferability of generated adversarial examples. To comprehensively measure the effectiveness of our approaches, we construct a challenging benchmark of DeepFake adversarial attacks for future development. Extensive experiments impressively show that the proposed adversarial attack method makes the visual quality of DeepFake face images plummet so that they are easier to be detected by humans and algorithms. Moreover, we demonstrate that the proposed algorithm can be generalized to offer face image protection against various face translation methods.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 47 of its 64 references that are in the map. First posted on arXiv 26 Apr 2022.

Builds on

47 of 64 references.

References · 47

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  5. 2013Intriguing properties of neural networkscited by 5,114
  6. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  7. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  8. 2016Adversarial examples in the physical worldcited by 1,762
  9. 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
  10. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  11. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  12. 2016Practical Black-Box Attacks against Machine Learningcited by 893
35 more
  1. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  2. 2016Universal adversarial perturbationscited by 774
  3. 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
  4. 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 656
  5. 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 591
  6. 2017One pixel attack for fooling deep neural networkscited by 579
  7. 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 440
  8. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  9. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
  10. 2019Minimally distorted Adversarial Examples with a Fast Adaptive Boundary Attackcited by 333
  11. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  12. 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
  13. 2018Generating Adversarial Examples with Adversarial Networkscited by 256
  14. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  15. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
  16. 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
  17. 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 208
  18. 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
  19. 2019Real Image Denoising with Feature Attentioncited by 176
  20. 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
  21. 2019Enhancing Adversarial Example Transferability with an Intermediate Level Attackcited by 139
  22. 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
  23. 2019ColorFool: Semantic Adversarial Colorizationcited by 89
  24. 2020Towards Transferable Adversarial Attack against Deep Face Recognitioncited by 79
  25. 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
  26. 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
  27. 2020Video Face Manipulation Detection Through Ensemble of CNNscited by 63
  28. 2017Adversarial examples for generative modelscited by 58
  29. 2017APE-GAN: Adversarial Perturbation Elimination with GANcited by 57
  30. 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
  31. 2018Physics-Based Generative Adversarial Models for Image Restoration and Beyondcited by 37
  32. 2016Adversarial Images for Variational Autoencoderscited by 19
  33. 2019Walking on the Edge: Fast, Low-Distortion Adversarial Examplescited by 18
  34. 2020Protecting Against Image Translation Deepfakes by Leaking Universal Perturbations from Black-Box Neural Networkscited by 7
  35. 2021Landmark Breaker: Obstructing DeepFake By Disturbing Landmark Extractioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 5; 2025: 10; 2026: 7.

25 papers.

Sort:

By area:

  1. 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 22
  2. 2023Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challengescited by 16
  3. 2024Artwork Protection Against Neural Style Transfer Using Locally Adaptive Adversarial Color Attackcited by 9
  4. 2025NullSwap: Proactive Identity Cloaking Against Deepfake Face Swappingcited by 8
  5. 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AIcited by 7
  6. 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identificationcited by 4
  7. 2025FaceSwapGuard: Safeguarding Facial Privacy from DeepFake Threats through Identity Obfuscationcited by 4
  8. 2025My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swappingcited by 4
  9. 2025Beyond Vulnerabilities: A Survey of Adversarial Attacks as Both Threats and Defenses in Computer Vision Systemscited by 4
  10. 2023Deep Ensemble Learning with Frame Skipping for Face Anti-Spoofingcited by 3
  11. 2026CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoningcited by 3
  12. 2024Enhancing Adversarial Robustness via Uncertainty-Aware Distributional Adversarial Trainingcited by 2
13 more
  1. 2025AI-based Identity Fraud Detection: A Systematic Reviewcited by 2
  2. 2025Mind the Trojan Horse: Image Prompt Adapter Enabling Scalable and Deceptive Jailbreakingcited by 2
  3. 2025Realism to Deception: Investigating Deepfake Detectors Against Face Enhancementcited by 1
  4. 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editingcited by 1
  5. 2026Off-The-Shelf Image-to-Image Models Are All You Need To Defeat Image Protection Schemescited by 1
  6. 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulationscited by 1
  7. 2026Transferable Attack against Face Swapping in an Extended Spacecited by 1
  8. 2023Deepfake Detection using Biological Features: A Surveycited by 0
  9. 2025Defending Deepfake via Texture Feature Perturbationcited by 0
  10. 2025Learning from Few Samples: A Novel Approach for High-Quality Malcode Generationcited by 0
  11. 2025Virtual camera detection: Catching video injection attacks in remote biometric systemscited by 0
  12. 2026ID-Eraser: Proactive Defense Against Face Swapping via Identity Perturbationcited by 0
  13. 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Studycited by 0