Robust LLM Watermarking with Minimal Semantic Distortion for IP Protection
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Proprietary large language models (LLMs) face risks of intellectual property (IP) violation, as adversaries can replicate an LLM by collecting input-output pairs to train a surrogate model, causing financial setbacks. Watermarks offer a promising defense to verify ownership, but existing methods often struggle with semantic distortion, factual inconsistency, and adversarial attacks. In addition, key-conditioned watermarks for provider-specific detection, especially in cross-provider and multi-user scenarios, remain largely underexplored. To address these challenges, we propose SAFESEAL, a novel key-conditioned watermarking framework that achieves strong detectability with minimal impact on model utility, effectively balancing detectability, utility, and robustness. SAFESEAL preserves named entities while substituting linguistic terms with context-aware synonyms through a key-conditioned Tournament sampling mechanism, maintaining semantic fidelity and factual consistency. For detection, we introduce a key-conditioned contrastive detector that jointly encodes the text and key, enabling provider-specific and robust watermark verification. We derive theoretical bounds on the utility-detectability trade-off and significantly reduce latency through lightweight models, batching, and parallelism. Extensive experiments show that SAFESEAL outperforms baselines in utility, detectability, and robustness, achieving a BERTScore of 0.983, entity similarity of 0.963, a 98.2% detection rate, and the highest human ratings for text quality and content preservation, with latency comparable to the fastest baseline. To promote transparency and community-driven progress, we release the first public watermark leaderboard and an interactive demo.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 66 of its 100 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
66 of 100 references.
Closest ancestors · 34
Same direction, newest first
- 2025δ-STEAL: LLM Stealing Attack with Local Differential Privacy24 Oct
- 2025From Trade-off to Synergy: A Versatile Symbiotic Watermarking Framework for Large Language Models15 May
- 2025Revealing Weaknesses in Text Watermarking Through Self-Information Rewrite Attacks8 May
- 2025Improved Unbiased Watermark for Large Language Models16 Feb
- 2024Watermarking Language Models through Language Models7 Nov
- 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
- 2024ModelShield: Adaptive and Robust Watermark against Model Extraction Attack3 May
- 2024Bypassing LLM Watermarks with Color-Aware Substitutions19 Mar
- 2024Learning to Watermark LLM-generated Text via Reinforcement Learning13 Mar
- 2024WaterMax: breaking the LLM watermark detectability-robustness-quality trade-off6 Mar
- 2024EmMark: Robust Watermarks for IP Protection of Embedded Quantized Large Language Models27 Feb
- 2024No Free Lunch in LLM Watermarking: Trade-offs in Watermarking Design Choices25 Feb
22 more
- 2024Watermarking Makes Language Models Radioactive22 Feb
- 2024k-SemStamp: A Clustering-Based Semantic Watermark for Detection of Machine-Generated Text17 Feb
- 2024Provably Robust Multi-bit Watermarking for AI-generated Text30 Jan
- 2024Adaptive Text Watermark for Large Language Models25 Jan
- 2024Cross-Attention Watermarking of Large Language Models12 Jan
- 2023Optimizing watermarks for large language models28 Dec
- 2023Mark My Words: Analyzing and Evaluating Language Model Watermarks1 Dec
- 2023Downstream Trade-offs of a Family of Text Watermarks16 Nov
- 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasing15 Nov
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models7 Nov
- 2023Advancing Beyond Identification: Multi-bit Watermark for Large Language Models1 Aug
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
- 2023Undetectable Watermarks for Language Models25 May
- 2023Who Wrote this Code? Watermarking for Code Generation24 May
- 2023Watermarking Text Generated by Black-Box Language Models14 May
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
- 2023Can AI-Generated Text be Reliably Detected?17 Mar
- 2023Protecting Language Generation Models via Invisible Watermarking6 Feb
- 2023A Watermark for Large Language Models24 Jan
- 2022Watermarking Pre-trained Language Models with Backdooring14 Oct
- 2022CATER: Intellectual Property Protection on Text Generation APIs via Conditional Watermarks19 Sep
- 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermark5 Dec
Other references · 32
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
20 more
- 2020Evaluation of Text Generation: A Surveycited by 275
- 2020Information Leakage in Embedding Modelscited by 199
- 2018PRADA: Protecting against DNN Model Stealing Attackscited by 159
- 2024Stealing Part of a Production Language Modelcited by 152
- 2020Entangled Watermarks as a Defense against Model Extractioncited by 144
- 2019Thieves on Sesame Street! Model Extraction of BERT-based APIscited by 136
- 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
- 2020Imitation Attacks and Defenses for Black-box Machine Translation Systemscited by 78
- 2016A Thorough Examination of the CNN/Daily Mail Reading Comprehension Taskcited by 71
- 2024LLMmap: Fingerprinting For Large Language Modelscited by 56
- 2023HuRef: HUman-REadable Fingerprint for Large Language Modelscited by 32
- 2021Watermarking Graph Neural Networks based on Backdoor Attackscited by 25
- 2023Model Leeching: An Extraction Attack Targeting LLMscited by 22
- 2023WatME: Towards Lossless Watermarking Through Lexical Redundancycited by 22
- 2024Know When To Stop: A Study of Semantic Drift in Text Generationcited by 18
- 2021Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIscited by 16
- 2021Towards Document-Level Paraphrase Generation with Sentence Rewriting and Reorderingcited by 10
- 2024Weighted Point Set Embedding for Multimodal Contrastive Learning Toward Optimal Similarity Metriccited by 6
- 2024WaterPool: A Watermark Mitigating Trade-offs among Imperceptibility, Efficacy and Robustnesscited by 6
- 2025Sandcastles in the Storm: Revisiting the (Im)possibility of Strong Watermarkingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.