Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensics
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
AI-generated content has accelerated the topic of media synthesis, particularly Deepfake, which can manipulate our portraits for positive or malicious purposes. Before releasing these threatening face images, one promising forensics solution is the injection of robust watermarks to track their own provenance. However, we argue that current watermarking models, originally devised for genuine images, may harm the deployed Deepfake detectors when directly applied to forged images, since the watermarks are prone to overlap with the forgery signals used for detection. To bridge this gap, we thus propose AdvMark, on behalf of proactive forensics, to exploit the adversarial vulnerability of passive detectors for good. Specifically, AdvMark serves as a plug-and-play procedure for fine-tuning any robust watermarking into adversarial watermarking, to enhance the forensic detectability of watermarked images; meanwhile, the watermarks can still be extracted for provenance tracking. Extensive experiments demonstrate the effectiveness of the proposed AdvMark, leveraging robust watermarking to fool Deepfake detectors, which can help improve the accuracy of downstream Deepfake detection without tuning the in-the-wild detectors. We believe this work will shed some light on the harmless proactive forensics against Deepfake.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 45 of its 62 references that are in the map. First posted on arXiv 27 Apr 2024.
Builds on
45 of 62 references.
Closest ancestors · 5
Same direction, newest first
- 2023Robust Identity Perceptual Watermark Against Deepfake Face Swapping2 Nov
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detection10 May
- 2023RoSteALS: Robust Steganography using Autoencoder Latent Space6 Apr
- 2022FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes5 Apr
- 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes23 May
Other references · 40
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 950
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2020First Order Motion Model for Image Animationcited by 698
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2021Multi-attentional Deepfake Detectioncited by 339
28 more
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2019Adversarial Examples Improve Image Recognitioncited by 283
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2018Generating Adversarial Examples with Adversarial Networkscited by 256
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2018The relativistic discriminator: a key element missing from standard GANcited by 234
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 163
- 2017Generative Adversarial Perturbationscited by 153
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 109
- 2021Representative Forgery Mining for Fake Face Detectioncited by 108
- 2021MBRS : Enhancing Robustness of DNN-based Watermarking by Mini-Batch of Real and Simulated JPEG Compressioncited by 108
- 2023Regulating ChatGPT and other Large Generative AI Modelscited by 102
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
- 2022Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbationscited by 39
- 2023Evading DeepFake Detectors via Adversarial Statistical Consistencycited by 37
- 2022Proactive Image Manipulation Detectioncited by 35
- 2023MaLP: Manipulation Localization Using a Proactive Schemecited by 26
- 2021Exploring Adversarial Fake Images on Face Manifoldcited by 24
- 2022Watermark Vaccine: Adversarial Attacks to Prevent Watermark Removalcited by 18
- 2021MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakescited by 17
- 2023Information-containing Adversarial Perturbation for Combating Facial Manipulation Systemscited by 9
- 2023Adversarial Machine Learning for Social Good: Reframing the Adversary as an Allycited by 5
- 2023Adversarial Amendment is the Only Force Capable of Transforming an Enemy into a Friendcited by 1
- 2023Building an Invisible Shield for Your Portrait against Deepfakescited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 6; 2026: 4.
12 papers.
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 12
- 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakescited by 7
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2025WaveGuard: Robust Deepfake Detection and Source Tracing via Dual-Tree Complex Wavelet and Graph Neural Networkscited by 5
- 2025Uncovering and Mitigating Destructive Multi-Embedding Attacks in Deepfake Proactive Forensicscited by 3
- 2025Boosting Active Defense Persistence: A Two-Stage Defense Framework Combining Interruption and Poisoning Against Deepfakecited by 2
- 2025Invisible Watermarks, Visible Gains: Steering Machine Unlearning with Bi-Level Watermarking Designcited by 1
- 2026Talk is (Not) Cheap: A Taxonomy and Benchmark Coverage Audit for LLM Attackscited by 1
- 2026The Watermark Shortcut: How Provenance Marking Sabotages Audio Deepfake Detectioncited by 1
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2026GIFGuard: Proactive Forensics against Deepfakes in Facial GIFs via Spatiotemporal Watermarkingcited by 0
- 2026Can Tainted Pixels Expose Deepfake Videos?cited by 0
- 2026Can Tainted Pixels Expose Deepfake Videos?26 Aug 2026
- 2026The Watermark Shortcut: How Provenance Marking Sabotages Audio Deepfake Detection22 Jun 2026
- 2026Talk is (Not) Cheap: A Taxonomy and Benchmark Coverage Audit for LLM Attacks14 May 2026
- 2026GIFGuard: Proactive Forensics against Deepfakes in Facial GIFs via Spatiotemporal Watermarking29 Apr 2026
- 2025Uncovering and Mitigating Destructive Multi-Embedding Attacks in Deepfake Proactive Forensics24 Aug 2025
- 2025Invisible Watermarks, Visible Gains: Steering Machine Unlearning with Bi-Level Watermarking Design13 Aug 2025
- 2025Boosting Active Defense Persistence: A Two-Stage Defense Framework Combining Interruption and Poisoning Against Deepfake11 Aug 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025DiffMark: Diffusion-based Robust Watermark Against Deepfakes2 Jul 2025
- 2025WaveGuard: Robust Deepfake Detection and Source Tracing via Dual-Tree Complex Wavelet and Graph Neural Networks13 May 2025
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authentication15 Jul 2024
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges11 Jun 2024