PURA: Provably Unbiased and Robust Multi-Bit Watermarking for AI-Generated Text Attribution
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Fine-grained attribution of AI-generated text is becoming increasingly important for accountability and auditing, yet existing multi-bit watermarking methods still struggle to simultaneously preserve the base generation distribution, support high-capacity payloads, and remain recoverable after editing. We present PURA, a provably unbiased and robust multi-bit watermarking method for text attribution. Instead of perturbing token probabilities directly, PURA embeds payloads in the latent sampling space via keyed inverse transform sampling, and recovers them by treating observed tokens as soft interval evidence and aggregating such evidence across the sequence. This design preserves the base generation distribution exactly while substantially improving recovery stability under post-editing and channel perturbations. Building on this recovery paradigm, we further develop a unified robustness analysis and show that, under bounded attack strength, the per-bit error probability decays exponentially with sequence length. Extensive experiments show that PURA substantially outperforms existing unbiased baselines in the high-payload regime. For example, when embedding 36 bits in 200 tokens, PURA achieves a 91.7% message match rate, more than three times that of the strongest unbiased baseline, while preserving text quality and remaining statistically close to unwatermarked text, and incurring only millisecond-level verification overhead. Our code is available at
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 20 of its 35 references that are in the map. First posted on arXiv 23 Aug 2026.
Builds on
20 of 35 references.
Closest ancestors · 9
Same direction, newest first
- 2026MC2Mark: Distortion-Free Multi-Bit Watermarking for Long Messages15 Feb
- 2025Character-Level Perturbations Disrupt LLM Watermarks11 Sep
- 2025Revealing Weaknesses in Text Watermarking Through Self-Information Rewrite Attacks8 May
- 2024Optimizing Adaptive Attacks against Watermarks for Language Models3 Oct
- 2024Provably Robust Multi-bit Watermarking for AI-generated Text30 Jan
- 2023Towards Codable Watermarking for Injecting Multi-bits Information to LLMs29 Jul
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
Other references · 11
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
- 2019Neural Linguistic Steganographycited by 78
- 2022Perfectly Secure Steganography Using Minimum Entropy Couplingcited by 44
- 2025SparSamp: Efficient Provably Secure Steganography Based on Sparse Samplingcited by 14
- 2024Provably Robust and Secure Steganography in Asymmetric Resource Scenariocited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CertMark: Distortion-Free Multi-Bit Watermarking with Certified Decoding
- 2025DERMARK: A Dynamic, Efficient and Robust Multi-bit Watermark for Large Language Models
- 2025Improved Unbiased Watermark for Large Language Models
- 2025BiMark: Unbiased Multilayer Watermarking for Large Language Models
- 2024Watermarking Language Models with Error Correcting Codes
- 2023Advancing Beyond Identification: Multi-bit Watermark for Large Language Models
- 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking
- 2025Analyzing and Evaluating Unbiased Language Model Watermark