Dual Defense: Adversarial, Traceable, and Invisible Robust Watermarking against Face Swapping
Not on the map. Why?
Abstract (arXiv)
The malicious applications of deep forgery, represented by face swapping, have introduced security threats such as misinformation dissemination and identity fraud. While some research has proposed the use of robust watermarking methods to trace the copyright of facial images for post-event traceability, these methods cannot effectively prevent the generation of forgeries at the source and curb their dissemination. To address this problem, we propose a novel comprehensive active defense mechanism that combines traceability and adversariality, called Dual Defense. Dual Defense invisibly embeds a single robust watermark within the target face to actively respond to sudden cases of malicious face swapping. It disrupts the output of the face swapping model while maintaining the integrity of watermark information throughout the entire dissemination process. This allows for watermark extraction at any stage of image tracking for traceability. Specifically, we introduce a watermark embedding network based on original-domain feature impersonation attack. This network learns robust adversarial features of target facial images and embeds watermarks, seeking a well-balanced trade-off between watermark invisibility, adversariality, and traceability through perceptual adversarial encoding strategies. Extensive experiments demonstrate that Dual Defense achieves optimal overall defense success rates and exhibits promising universality in anti-face swapping tasks and dataset generalization ability. It maintains impressive adversariality and traceability in both original and robust settings, surpassing current forgery defense methods that possess only one of these capabilities, including CMUA-Watermark, Anti-Forgery, FakeTagger, or PGD methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 39 references that are in the map. First posted on arXiv 25 Oct 2023.
Builds on
28 of 39 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2014Learning Face Representation from Scratchcited by 451
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
16 more
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
- 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
- 2022FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbationscited by 75
- 2020Adv-watermark: A Novel Watermark Perturbation for Adversarial Examplescited by 56
- 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakescited by 54
- 2018RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spacescited by 50
- 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
- 2019Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translationcited by 39
- 2022Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbationscited by 39
- 2021Initiative Defense against Facial Manipulationcited by 36
- 2018FSNet: An Identity-Aware Generative Model for Image-based Face Swappingcited by 29
- 2020Defending against GAN-based Deepfake Attacks via Transformation-aware Adversarial Facescited by 21
- 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakescited by 17
- 2020AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detectioncited by 16
- 2022UnGANable: Defending Against GAN-based Face Manipulationcited by 15
Built on by
Not cited yet.