mlsanityData to 14 Oct 2026

Robustness Assessment and Enhancement of Text Watermarking for Google's SynthID

arXiv 2508.20228 ↗First posted 27 Aug 2025cs.CR cs.CLcited by 4

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

Recent advances in LLM watermarking methods such as SynthID-Text by Google DeepMind offer promising solutions for tracing the provenance of AI-generated text. However, our robustness assessment reveals that SynthID-Text is vulnerable to meaning-preserving attacks, such as paraphrasing, copy-paste modifications, and back-translation, which can significantly degrade watermark detectability. To address these limitations, we propose SynGuard, a hybrid framework that combines the semantic alignment strength of Semantic Information Retrieval (SIR) with the probabilistic watermarking mechanism of SynthID-Text. Our approach jointly embeds watermarks at both lexical and semantic levels, enabling robust provenance tracking while preserving the original meaning. Experimental results across multiple attack scenarios show that SynGuard improves watermark recovery by an average of 11.1% in F1 score compared to SynthID-Text. These findings demonstrate the effectiveness of semantic-aware watermarking in resisting real-world tampering. All code, datasets, and evaluation scripts are publicly available at: https://github.com/githshine/SynGuard.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 21 of its 32 references that are in the map. First posted on arXiv 27 Aug 2025.

Builds on

21 of 32 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025MorphMark: Flexible Adaptive Watermarking for Large Language Models14 May
  2. 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
  3. 2024Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models21 Feb
  4. 2023A Survey of Text Watermarking in the Era of Large Language Models13 Dec
  5. 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasing15 Nov
  6. 2023A Semantic Invariant Robust Watermark for Large Language Models10 Oct
  7. 2023Unbiased Watermark for Large Language Models22 Sep
  8. 2023Provable Robust Watermarking for AI-Generated Text30 Jun
  9. 2023On the Reliability of Watermarks for Large Language Models7 Jun
  10. 2023Undetectable Watermarks for Language Models25 May
  11. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
  12. 2023Protecting Language Generation Models via Invisible Watermarking6 Feb
3 more
  1. 2023A Watermark for Large Language Models24 Jan
  2. 2022FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes5 Apr
  3. 2021Deep Model Intellectual Property Protection via Deep Watermarking8 Mar

Other references · 6

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  5. 2023Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningcited by 415
  6. 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methodscited by 79

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026On Google's SynthID-Text LLM Watermarking System: Theoretical Analysis and Empirical Validation
  2. 2025Defending LLM Watermarking Against Spoofing Attacks with Contrastive Representation Learning
  3. 2025Cross-Lingual Summarization as a Black-Box Watermark Removal Attack
  4. 2025From Trade-off to Synergy: A Versatile Symbiotic Watermarking Framework for Large Language Models
  5. 2026Tracing Provenance and Detecting Tampering with Complementary LLM Watermarks
  6. 2024Waterfall: Framework for Robust and Scalable Text Watermarking and Provenance for LLMs
  7. 2024Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Models
  8. 2024Provably Robust Watermarks for Open-Source Language Models