Watermarks Without Verification: AI Text Watermarking After the EU AI Act
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
On August 2, 2026, the obligations of Article 50 of the EU AI Act took effect, requiring generative AI providers to mark the content their systems produce and ensure it can be detected as AI-generated. Days later, Anthropic disclosed that every Claude model released after that date embeds a watermark based on SynthID-Text in all generated text, enabled by default with no user opt-out; Google has deployed SynthID-Text in Gemini since 2024. Users objected that the watermark degrades quality, particularly for code, that it secretly encodes identifying information, and, in mutual contradiction, that it is easily removable and inescapable; the vendor answered with assurances of unchanged quality, no identifying information, and robustness to light editing. In this work, we argue that neither the objections nor the assurances can currently be verified and that this unverifiability, rather than watermarking itself, is the substantive governance failure. We sort the contested assertions by what it would take to settle each and evaluate the open-source SynthID-Text implementation on two open-weight models, because no public tool can test the deployed systems. On prose, the measured effect of the watermark does not exceed that of changing the sampling seed. On code, the cost is three points of correctness on one model and below measurement on the other, while detection remains near chance, a limitation of detectability rather than quality. The remaining gaps trace to withheld access or missing institutions and we map each to a requirement: release of matched outputs, configuration disclosure, accredited audits, a shared evaluation protocol, and interoperable detection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 30 of its 49 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
30 of 49 references.
Closest ancestors · 20
Same direction, newest first
- 2026Auditing Cross-Lingual Fairness in Language Model Watermarking20 Aug
- 2026Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking15 Apr
- 2025Watermarking Without Standards Is Not AI Governance27 May
- 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
- 2024Topic-Based Watermarks for Large Language Models2 Apr
- 2024Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models21 Feb
- 2023A Survey of Text Watermarking in the Era of Large Language Models13 Dec
- 2023Mark My Words: Analyzing and Evaluating Language Model Watermarks1 Dec
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models7 Nov
- 2023Publicly-Detectable Watermarking for Language Models27 Oct
- 2023Advancing Beyond Identification: Multi-bit Watermark for Large Language Models1 Aug
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
8 more
- 2023Three Bricks to Consolidate Watermarks for Large Language Models26 Jul
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
- 2023On the Reliability of Watermarks for Large Language Models7 Jun
- 2023Undetectable Watermarks for Language Models25 May
- 2023Who Wrote this Code? Watermarking for Code Generation24 May
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
- 2023Can AI-Generated Text be Reliably Detected?17 Mar
- 2023A Watermark for Large Language Models24 Jan
Other references · 10
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
- 2023GPT detectors are biased against non-native English writerscited by 175
- 2025Optimal Watermark Generation under Type I and Type II Errorscited by 3
- 2026Authenticated Contradictions from Desynchronized Provenance and Watermarkingcited by 2
Built on by
Not cited yet.