Mitigating Watermark Forgery in Generative Models via Randomized Key Selection
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Watermarking enables GenAI providers to verify whether content was generated by their models. A watermark is a hidden signal in the content, whose presence can be detected using a secret watermark key. A core security threat are forgery attacks, where adversaries insert the provider's watermark into content not produced by the provider, potentially damaging their reputation and undermining trust. Existing defenses resist forgery by embedding many watermarks with multiple keys into the same content, which can degrade model utility. However, forgery remains a threat when attackers can collect sufficiently many watermarked samples. We propose a defense with a sample-count-independent upper bound on forgery success for blind attackers, conditional on key-symmetric, independent detector outcomes. Our scheme does not further degrade model utility. We randomize the watermark key selection for each query and accept content as genuine only if a watermark is detected by exactly one key. Unlike cryptographic watermarks that rely on computational hardness assumptions and require designing new watermarking schemes from scratch, our method can be applied to any existing watermarking method to improve its forgery resistance. We focus on text watermarking, but our defense is modality-agnostic, since it treats the underlying watermarking method as a black-box. To show this, we include a preliminary study on image watermarking using Tree-Ring. Separately from this conditional guarantee, we empirically observe that, at r=4 keys, harmful-text forgery success drops from as high as 87% with a single key to as low as 1% against the adaptive blind attackers that we evaluate, at negligible computational overhead; a preliminary image study shows a reduction from 100% to 2%.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 43 of its 62 references that are in the map. First posted on arXiv 10 Jul 2025.
Builds on
43 of 62 references.
Closest ancestors · 23
Same direction, newest first
- 2025Forging and Removing Latent-Noise Diffusion Watermarks Using a Single Image27 Apr
- 2024Black-Box Forgery Attacks on Semantic Watermarks for Diffusion Models4 Dec
- 2024SoK: Watermarking for AI-Generated Content27 Nov
- 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization6 Nov
- 2024An Undetectable Watermark for Generative Image Models9 Oct
- 2024Optimizing Adaptive Attacks against Watermarks for Language Models3 Oct
- 2024Bileve: Securing Text Provenance in Large Language Models Against Spoofing with Bi-level Signature4 Jun
- 2024Large Language Model Watermark Stealing With Mixed Integer Programming30 May
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
- 2024Bypassing LLM Watermarks with Color-Aware Substitutions19 Mar
- 2024Watermark Stealing in Large Language Models29 Feb
- 2024No Free Lunch in LLM Watermarking: Trade-offs in Watermarking Design Choices25 Feb
11 more
- 2024Pseudorandom Error-Correcting Codes14 Feb
- 2023On the Learnability of Watermarks for Language Models7 Dec
- 2023Mark My Words: Analyzing and Evaluating Language Model Watermarks1 Dec
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
- 2023On the Reliability of Watermarks for Large Language Models7 Jun
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
- 2023Undetectable Watermarks for Language Models25 May
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
- 2023Can AI-Generated Text be Reliably Detected?17 Mar
- 2023A Watermark for Large Language Models24 Jan
Other references · 20
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2023Mistral 7Bcited by 3,164
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2018HiDDeN: Hiding Data With Deep Networkscited by 397
8 more
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 265
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 194
- 2019Robust Invisible Video Watermarking with Attentioncited by 149
- 2023MGTBench: Benchmarking Machine-Generated Text Detectioncited by 93
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
- 2023Leveraging Optimization for Adaptive Attacks on Image Watermarkscited by 52
- 2024Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attackscited by 33
- 2024On the Reliability of Large Language Models to Misinformed and Demographically-Informed Promptscited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Watermarking Should Be Treated as a Monitoring Primitivecited by 2
- 2026LLM Watermarking as Big Data Provenance: A Deployment-Oriented Systematizationcited by 1
- 2026Constitution-Guided Watermarkingcited by 0
- 2026Could LLM Watermark Detection be Public?cited by 0
- 2026Could LLM Watermark Detection be Public?8 Oct 2026
- 2026Constitution-Guided Watermarking7 Oct 2026
- 2026LLM Watermarking as Big Data Provenance: A Deployment-Oriented Systematization11 Jul 2026
- 2026Watermarking Should Be Treated as a Monitoring Primitive13 May 2026
Similar, not cited
Close in wording, no citation either way
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models
- 2025The Coding Limits of Robust Watermarking for Generative Models
- 2024Forging the Unforgeable: On the Feasibility of Counterfeit Watermarks in Backdoor-Based Dataset Ownership Verification
- 2025Spread them Apart: Towards Robust Watermarking of Generated Content
- 2024RoboSignature: Robust Signature and Watermarking on Network Attacks
- 2026Attribute-based Undetectable Watermarking for Generative AI Models
- 2022Seeds Don't Lie: An Adaptive Watermarking Framework for Computer Vision Models
- 2026Watermark Forensics for Generative Models: An Information-Theoretic Perspective