Language Model Fingerprinting Requires Rethinking Watermark Teachers
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
LLM fingerprinting via watermark distillation embeds a statistical watermark signal into model weights, enabling model owners to identify their models behind black-box APIs. Revisiting a recent protocol, we find that its utility evaluation understates text quality degradation in open-ended generation, favoring overly strong watermark teachers. Weakening the watermark improves text quality but sacrifices detectability. To move beyond this trade-off, we rethink whether text watermarks designed for verifying generated text are suitable distillation teachers for model fingerprinting. Such watermarks are typically designed to remain detectable from an individual output, limiting how sparse the watermark signal can be. In contrast, fingerprint verification can aggregate signal across queries, making sparser watermark signals viable. This raises a key question: where should the sparse signal be placed? We analyze signal placement through token surprisal and show that, even at comparable watermark strength, different placements can target tokens with different plausibility under the base model. This motivates near-tie restriction, which uses top-1-relative logit gaps to restrict the watermark bias to tokens close to the base model's top prediction. Across multiple models, near-tie improves detection--quality frontiers under deployment changes, preserves higher text quality across query budgets, and further improves existing watermarking schemes when combined with them.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. First posted on arXiv 3 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models
- 2026Fingerprinting Text-to-Image Diffusion Models via Collapsed Generation
- 2024Inevitable Trade-off between Watermark Strength and Speculative Sampling Efficiency for Language Models
- 2024Learning to Watermark LLM-generated Text via Reinforcement Learning
- 2026Antidistillation Fingerprinting
- 2026WaterMoE: Expert-Routing-based Watermarking for High Fidelity and Efficiency
- 2023WatME: Towards Lossless Watermarking Through Lexical Redundancy
- 2025StealthInk: A Multi-bit and Stealthy Watermark for Large Language Models