mlsanityData to 14 Oct 2026

Linear Ensembles Wash Away Watermarks: On the Fragility of Distributional Perturbations in LLMs

arXiv 2605.30501 ↗First posted 28 May 2026cs.CLcited by 1

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

Watermarking embeds statistical signatures in AI-generated text for detection and attribution. We reveal a fundamental vulnerability: when users access multiple models (today's reality), watermarks trivially fail. Watermarks perturb output distributions away from the original, and in competitive markets, these perturbations are typically independent across providers. We theoretically prove that averaging output probability distributions recovers the unwatermarked distribution with up to a second-order error term. Empirically, simply averaging 3-5 models cancels out these perturbations. We introduce WASH (Watermark Attenuation via Statistical Hybridisation), which solves practical challenges in ensemble generation: vocabulary misalignment and tokenisation differences across heterogeneous models. Experiments across six watermarking schemes and three LLMs show that averaging across 3 models suppresses detection z-scores from 5-300 to below 2 (below the detection threshold of 4) and reduces TPR at 5% FPR to below 50%, while improving quality by 27.5% and running 6 times faster than the best baseline on the long sequence generation. Our results suggest that robust AI-text detection via watermarking requires either accepting this fundamental vulnerability or unprecedented coordination among model providers.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 26 of its 33 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

26 of 33 references.

Closest ancestors · 15

Same direction, newest first

  1. 2024Debiasing Watermarks for Large Language Models via Maximal Coupling17 Nov
  2. 2024Can Watermarked LLMs be Identified by Users via Crafted Prompts?4 Oct
  3. 2024Watermarking Low-entropy Generation for Large Language Models: An Unbiased and Low-risk Method23 May
  4. 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
  5. 2024Bypassing LLM Watermarks with Color-Aware Substitutions19 Mar
  6. 2024Watermark Stealing in Large Language Models29 Feb
  7. 2024No Free Lunch in LLM Watermarking: Trade-offs in Watermarking Design Choices25 Feb
  8. 2023A Survey of Text Watermarking in the Era of Large Language Models13 Dec
  9. 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models7 Nov
  10. 2023A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models11 Oct
  11. 2023Unbiased Watermark for Large Language Models22 Sep
  12. 2023Robust Distortion-free Watermarks for Language Models28 Jul
3 more
  1. 2023On the Reliability of Watermarks for Large Language Models7 Jun
  2. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
  3. 2023A Watermark for Large Language Models24 Jan

Other references · 11

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  6. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  7. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
  8. 2024Large Language Models for Education: A Survey and Outlookcited by 188
  9. 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 106
  10. 2025Harnessing Multiple Large Language Models: A Survey on LLM Ensemblecited by 86
  11. 2024Breaking the Ceiling of the LLM Community by Treating Token Generation as a Classification for Ensemblingcited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025An Ensemble Framework for Unbiased Language Model Watermarking
  2. 2026Signature filtering: a lightweight enhancement for statistical watermark detection in large language models
  3. 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models
  4. 2025Optimal Detection for Language Watermarks with Pseudorandom Collision
  5. 2024A Statistical Framework of Watermarks for Large Language Models: Pivot, Detection Efficiency and Optimal Rules
  6. 2024Ensemble Watermarks for Large Language Models
  7. 2026More Haste, Less Speed: Weaker Single-Layer Watermark Improves Distortion-Free Watermark Ensembles
  8. 2024Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approach