Sample Complexities of Estimating Gumbel--Max Watermark Proportions with and without Reduction to Pivotal Statistics
Not on the map. Why?
Abstract (arXiv)
Watermarking promises statistical traceability of large language model (LLM) uses, but real documents rarely arrive as purely human-written or purely LLM-generated. This motivates a quantitative question beyond detection: what proportion of a document is generated from a pre-specified watermarked LLM? We study this watermark proportion estimation problem under the Gumbel--max watermarking mechanism, treating the next-token prediction distributions as unknown and arbitrary nuisance parameters subject to a non-degeneracy condition. We compare two observation regimes: in the full observation regime, the estimator observes the pseudorandom vector and the selected token at each position; in the more prevalent setting of pivotal reduction, it observes only a scalar pivot, which follows a one-dimensional Uniform--Beta mixture distribution. Under pivotal reduction, we develop a Laguerre-polynomial estimator and establish a matching information-theoretic lower bound for the sample complexity. For full observation, we introduce an event-counting estimator and show a matching lower bound, yielding a substantially smaller sample complexity. As our results imply, although reducing to pivotal statistics is an elegant and prevalent choice, it is not always sample-efficient for estimating the proportion of watermarks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
20 of 41 references.
References · 20
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2023A Watermark for Large Language Modelscited by 667
- 2023Robust Distortion-free Watermarks for Language Modelscited by 279
- 2023Undetectable Watermarks for Language Modelscited by 208
- 2014A* Samplingcited by 150
- 2019Mean estimation and regression under heavy-tailed distributions--a surveycited by 133
- 2023Unbiased Watermark for Large Language Modelscited by 100
- 2024A Statistical Framework of Watermarks for Large Language Models: Pivot, Detection Efficiency and Optimal Rulescited by 53
- 2024Robust Detection of Watermarks for Large Language Models Under Human Editscited by 29
- 2020Optimal estimation of high-dimensional location Gaussian mixturescited by 16
- 2019Data Amplification: Instance-Optimal Property Estimationcited by 5
- 2025On the Empirical Power of Goodness-of-Fit Tests in Watermark Detectioncited by 5
8 more
- 2018Local moment matching: A unified methodology for symmetric functional estimation and distribution estimation under Wasserstein distancecited by 4
- 2024On the best approximation by finite Gaussian mixturescited by 3
- 2025Optimal Estimation of Watermark Proportions in Hybrid AI-Human Textscited by 3
- 2018Optimal Estimation of Simultaneous Signals Using Absolute Inner Product with Applications to Integrative Genomicscited by 2
- 2025Optimal Detection for Language Watermarks with Pseudorandom Collisioncited by 2
- 2026Refined Detection for Gumbel Watermarkingcited by 2
- 2026Sharp Inequalities between Total Variation and Hellinger Distances for Gaussian Mixturescited by 1
- 2026Adaptive Confidence Intervals in Efron's Gaussian Two-Groups Modelcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.