Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Recent multi-bit watermarking methods for large language models (LLMs) prioritize capacity over reliability, often conflating decoding with detection. Our analysis reveals that existing ECC-based extractors suffer from catastrophic false positive rates (FPR), and applying rejection thresholds merely collapses detection sensitivity (TPR) to random guessing. To resolve this structural limitation, we propose BREW (Block-wise Reliable Embedding for Watermarking), a framework shifting the paradigm to designated verification. BREW employs a two-stage mechanism: (i) blind message estimation via independent block voting, followed by (ii) window-shifting verification that rigorously validates the payload against local edits. Experiments demonstrate that BREW achieves a TPR of 0.965 with an FPR of 0.02 under 10% synonym substitution, demonstrating that the high-FPR issue is not an inherent trade-off of multi-bit watermarking, but a solvable structural flaw of prior decoding-centric designs. Our framework is model-agnostic and theoretically grounded, providing a scalable solution for reliable forensic deployment.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 21 of its 28 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
21 of 28 references.
Closest ancestors · 12
Same direction, newest first
- 2025Multi-use LLM Watermarking and the False Detection Problem19 Jun
- 2024Watermarking Language Models with Error Correcting Codes12 Jun
- 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
- 2024Pseudorandom Error-Correcting Codes14 Feb
- 2024Provably Robust Multi-bit Watermarking for AI-generated Text30 Jan
- 2023A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models11 Oct
- 2023Necessary and Sufficient Watermark for Large Language Models2 Oct
- 2023Advancing Beyond Identification: Multi-bit Watermark for Large Language Models1 Aug
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
- 2023A Watermark for Large Language Models24 Jan
Other references · 9
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
- 2020Attacking Neural Text Detectorscited by 37
Built on by
Citing papers per year: 2026: 1.
1 paper.