mlsanityData to 14 Oct 2026

LLM Watermark Evasion via Bias Inversion

arXiv 2509.23019 ↗First posted 27 Sep 2025cs.CR cs.AIcited by 1

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

Watermarking offers a promising solution for detecting LLM-generated content, yet its robustness under realistic query-free (black-box) evasion remains an open challenge. Existing query-free attacks often achieve limited success or severely distort semantic meaning. We bridge this gap by theoretically analyzing rewriting-based evasion, demonstrating that reducing the average conditional probability of sampling green tokens by a small margin causes the detection probability to decay exponentially. Guided by this insight, we propose the Bias-Inversion Rewriting Attack (BIRA), a practical query-free method that applies a negative logit bias to a proxy suppression set identified via token surprisal. Empirically, BIRA achieves state-of-the-art evasion rates (>99%) across diverse watermarking schemes while preserving semantic fidelity substantially better than prior baselines. Our findings reveal a fundamental vulnerability in current watermarking methods and highlight the need for rigorous stress tests. Our code is available at hrefhttps://github.com/ml-postech/LLM-Watermark-Evasion-via-Bias-Inversionhere.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 32 of its 46 references that are in the map. First posted on arXiv 27 Sep 2025.

Builds on

32 of 46 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel Constraints25 Sep
  2. 2025Revealing Weaknesses in Text Watermarking Through Self-Information Rewrite Attacks8 May
  3. 2025SimMark: A Robust Sentence-Level Similarity-Based Watermarking Algorithm for Large Language Models5 Feb
  4. 2024De-mark: Watermark Removal in Large Language Models17 Oct
  5. 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
  6. 2024An Entropy-based Text Watermarking Detection Method20 Mar
  7. 2024Bypassing LLM Watermarks with Color-Aware Substitutions19 Mar
  8. 2024Watermark Stealing in Large Language Models29 Feb
  9. 2023A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models11 Oct
  10. 2023A Semantic Invariant Robust Watermark for Large Language Models10 Oct
  11. 2023Unbiased Watermark for Large Language Models22 Sep
  12. 2023An Unforgeable Publicly Verifiable Watermark for Large Language Models30 Jul
7 more
  1. 2023Robust Distortion-free Watermarks for Language Models28 Jul
  2. 2023Provable Robust Watermarking for AI-Generated Text30 Jun
  3. 2023On the Reliability of Watermarks for Large Language Models7 Jun
  4. 2023Undetectable Watermarks for Language Models25 May
  5. 2023Who Wrote this Code? Watermarking for Code Generation24 May
  6. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
  7. 2023A Watermark for Large Language Models24 Jan

Other references · 13

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  6. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  7. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  8. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  9. 2024Large Language Models: A Surveycited by 525
  10. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
  11. 2023GPTScore: Evaluate as You Desirecited by 361
  12. 2023New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolutioncited by 20
1 more
  1. 2024Unveiling the Misuse Potential of Base Large Language Models via In-Context Learningcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Defending LLM Watermarking Against Spoofing Attacks with Contrastive Representation Learning
  2. 2025Character-Level Perturbations Disrupt LLM Watermarks
  3. 2025HeavyWater and SimplexWater: Distortion-Free LLM Watermarks for Low-Entropy Next-Token Predictions
  4. 2026Chainwash: Multi-Step Rewriting Attacks on Diffusion Language Model Watermarks
  5. 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarking
  6. 2026Tracing Provenance and Detecting Tampering with Complementary LLM Watermarks
  7. 2024Optimizing Adaptive Attacks against Watermarks for Language Models
  8. 2023New Evaluation Metrics Capture Quality Degradation due to LLM Watermarking