Robust Text Watermarking for Large Language Models via Dual Semantic Embeddings
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
This work presents Dual-Embedding Watermarking (DEW), a semantic watermarking scheme for large language models (LLMs) that leverages contextual and token-level embeddings to enhance robustness against paraphrasing and translation. DEW utilizes a signal-processing methodology, applying algebraic vector-space operations to token and context embeddings to derive a watermark signal that degrades gracefully under semantic shifts. The method obfuscates the watermark by projecting embedding vectors through pseudo-random matrices seeded with a secret key. Experimental results show that dual-embedding watermarking can offer state-of-the-art robustness, particularly against translation, while incurring relatively low computational overhead compared with other semantic schemes. At lower watermark strength, DEW also maintains competitive text quality, suggesting that dual-embedding signals provide a promising substrate for robust semantic watermarking.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 18 of its 31 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
18 of 31 references.
Closest ancestors · 9
Same direction, newest first
- 2026PASA: A Principled Embedding-Space Watermarking Approach for LLM-Generated Text under Semantic-Invariant Attacks9 May
- 2025SimKey: A Semantically Aware Key Module for Watermarking Language Models11 Oct
- 2024Distortion-free Watermarks are not Truly Distortion-free under Watermark Key Collisions2 Jun
- 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
- 2024Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models21 Feb
- 2024k-SemStamp: A Clustering-Based Semantic Watermark for Detection of Machine-Generated Text17 Feb
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
Other references · 9
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2023The Falcon Series of Open Language Modelscited by 535
- 2023The Science of Detecting LLM-Generated Textscited by 128
- 2019Neural Linguistic Steganographycited by 78
- 2021WhiteningBERT: An Easy Unsupervised Sentence Embedding Approachcited by 69
- 2024Isotropy Matters: Soft-ZCA Whitening of Embeddings for Semantic Code Searchcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023A Semantic Invariant Robust Watermark for Large Language Models
- 2024Duwak: Dual Watermarks in Large Language Models
- 2025DERMARK: A Dynamic, Efficient and Robust Multi-bit Watermark for Large Language Models
- 2024PostMark: A Robust Blackbox Watermark for Large Language Models
- 2024Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Models
- 2024Provably Robust Watermarks for Open-Source Language Models
- 2023Advancing Beyond Identification: Multi-bit Watermark for Large Language Models
- 2026Vaporizer: Breaking Watermarking Schemes for Large Language Model Outputs