Linear Ensembles Wash Away Watermarks: On the Fragility of Distributional Perturbations in LLMs
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Watermarking embeds statistical signatures in AI-generated text for detection and attribution. We reveal a fundamental vulnerability: when users access multiple models (today's reality), watermarks trivially fail. Watermarks perturb output distributions away from the original, and in competitive markets, these perturbations are typically independent across providers. We theoretically prove that averaging output probability distributions recovers the unwatermarked distribution with up to a second-order error term. Empirically, simply averaging 3-5 models cancels out these perturbations. We introduce WASH (Watermark Attenuation via Statistical Hybridisation), which solves practical challenges in ensemble generation: vocabulary misalignment and tokenisation differences across heterogeneous models. Experiments across six watermarking schemes and three LLMs show that averaging across 3 models suppresses detection z-scores from 5-300 to below 2 (below the detection threshold of 4) and reduces TPR at 5% FPR to below 50%, while improving quality by 27.5% and running 6 times faster than the best baseline on the long sequence generation. Our results suggest that robust AI-text detection via watermarking requires either accepting this fundamental vulnerability or unprecedented coordination among model providers.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 26 of its 33 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
26 of 33 references.
Closest ancestors · 15
Same direction, newest first
- 2024Debiasing Watermarks for Large Language Models via Maximal Coupling17 Nov
- 2024Can Watermarked LLMs be Identified by Users via Crafted Prompts?4 Oct
- 2024Watermarking Low-entropy Generation for Large Language Models: An Unbiased and Low-risk Method23 May
- 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
- 2024Bypassing LLM Watermarks with Color-Aware Substitutions19 Mar
- 2024Watermark Stealing in Large Language Models29 Feb
- 2024No Free Lunch in LLM Watermarking: Trade-offs in Watermarking Design Choices25 Feb
- 2023A Survey of Text Watermarking in the Era of Large Language Models13 Dec
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models7 Nov
- 2023A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models11 Oct
- 2023Unbiased Watermark for Large Language Models22 Sep
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
3 more
Other references · 11
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2024Large Language Models for Education: A Survey and Outlookcited by 188
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 106
- 2025Harnessing Multiple Large Language Models: A Survey on LLM Ensemblecited by 86
- 2024Breaking the Ceiling of the LLM Community by Treating Token Generation as a Classification for Ensemblingcited by 33
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025An Ensemble Framework for Unbiased Language Model Watermarking
- 2026Signature filtering: a lightweight enhancement for statistical watermark detection in large language models
- 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models
- 2025Optimal Detection for Language Watermarks with Pseudorandom Collision
- 2024A Statistical Framework of Watermarks for Large Language Models: Pivot, Detection Efficiency and Optimal Rules
- 2024Ensemble Watermarks for Large Language Models
- 2026More Haste, Less Speed: Weaker Single-Layer Watermark Improves Distortion-Free Watermark Ensembles
- 2024Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approach