mlsanityData to 7 Oct 2026

Sample Complexities of Estimating Gumbel--Max Watermark Proportions with and without Reduction to Pivotal Statistics

arXiv 2607.00224 ↗First posted 30 Jun 2026math.ST cs.IT cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Watermarking promises statistical traceability of large language model (LLM) uses, but real documents rarely arrive as purely human-written or purely LLM-generated. This motivates a quantitative question beyond detection: what proportion of a document is generated from a pre-specified watermarked LLM? We study this watermark proportion estimation problem under the Gumbel--max watermarking mechanism, treating the next-token prediction distributions as unknown and arbitrary nuisance parameters subject to a non-degeneracy condition. We compare two observation regimes: in the full observation regime, the estimator observes the pseudorandom vector and the selected token at each position; in the more prevalent setting of pivotal reduction, it observes only a scalar pivot, which follows a one-dimensional Uniform--Beta mixture distribution. Under pivotal reduction, we develop a Laguerre-polynomial estimator and establish a matching information-theoretic lower bound for the sample complexity. For full observation, we introduce an event-counting estimator and show a matching lower bound, yielding a substantially smaller sample complexity. As our results imply, although reducing to pivotal statistics is an elegant and prevalent choice, it is not always sample-efficient for estimating the proportion of watermarks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

20 of 41 references.

References · 20

  1. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  2. 2023A Watermark for Large Language Modelscited by 667
  3. 2023Robust Distortion-free Watermarks for Language Modelscited by 279
  4. 2023Undetectable Watermarks for Language Modelscited by 208
  5. 2014A* Samplingcited by 150
  6. 2019Mean estimation and regression under heavy-tailed distributions--a surveycited by 133
  7. 2023Unbiased Watermark for Large Language Modelscited by 100
  8. 2024A Statistical Framework of Watermarks for Large Language Models: Pivot, Detection Efficiency and Optimal Rulescited by 53
  9. 2024Robust Detection of Watermarks for Large Language Models Under Human Editscited by 29
  10. 2020Optimal estimation of high-dimensional location Gaussian mixturescited by 16
  11. 2019Data Amplification: Instance-Optimal Property Estimationcited by 5
  12. 2025On the Empirical Power of Goodness-of-Fit Tests in Watermark Detectioncited by 5
8 more
  1. 2018Local moment matching: A unified methodology for symmetric functional estimation and distribution estimation under Wasserstein distancecited by 4
  2. 2024On the best approximation by finite Gaussian mixturescited by 3
  3. 2025Optimal Estimation of Watermark Proportions in Hybrid AI-Human Textscited by 3
  4. 2018Optimal Estimation of Simultaneous Signals Using Absolute Inner Product with Applications to Integrative Genomicscited by 2
  5. 2025Optimal Detection for Language Watermarks with Pseudorandom Collisioncited by 2
  6. 2026Refined Detection for Gumbel Watermarkingcited by 2
  7. 2026Sharp Inequalities between Total Variation and Hellinger Distances for Gaussian Mixturescited by 1
  8. 2026Adaptive Confidence Intervals in Efron's Gaussian Two-Groups Modelcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.