mlsanityData to 7 Oct 2026

SLAM: Structural Linguistic Activation Marking for Language Models

arXiv 2605.05443 ↗First posted 6 May 2026cs.CL cs.AIcited by 1

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

LLM watermarks must be detectable without compromising text quality, yet most existing schemes bias the next-token distribution and pay for detection with measurable quality loss. We present SLAM (Structural Linguistic Activation Marking), a novel white-box watermarking scheme that sidesteps this cost by writing the mark into structural geometry rather than token frequencies: sparse autoencoders identify residual-stream directions encoding linguistic structure (e.g., voice, tense, clause order), and we causally steer those directions at generation time, leaving lexical sampling and semantics unconstrained. On Gemma-2 2B and 9B, SLAM achieves 100% detection accuracy with a quality cost of only 1-2 reward points - compared to 7.5-11.5 for KGW, EWD, and Unigram - with naturalness and diversity preserved at near-unwatermarked levels across both models. The trade-off is a complementary robustness profile: SLAM resists word-level edits but is vulnerable to paraphrase that restructures syntax (at a quality cost), the converse of token-distribution methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 38 of its 61 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

38 of 61 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025SAEMark: Steering Personalized Multilingual LLM Watermarks with Sparse Autoencoders11 Aug
  2. 2024PostMark: A Robust Blackbox Watermark for Large Language Models20 Jun
  3. 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
  4. 2024WaterMax: breaking the LLM watermark detectability-robustness-quality trade-off6 Mar
  5. 2024Adaptive Text Watermark for Large Language Models25 Jan
  6. 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasing15 Nov
  7. 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models7 Nov
  8. 2023A Semantic Invariant Robust Watermark for Large Language Models10 Oct
  9. 2023Unbiased Watermark for Large Language Models22 Sep
  10. 2023Robust Distortion-free Watermarks for Language Models28 Jul
  11. 2023Provable Robust Watermarking for AI-Generated Text30 Jun
  12. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
1 more
  1. 2023A Watermark for Large Language Models24 Jan

Other references · 25

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  4. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  5. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  6. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  7. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  8. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  9. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  10. 2022Toy Models of Superpositioncited by 928
  11. 2023Steering Language Models With Activation Engineeringcited by 824
  12. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
13 more
  1. 2022MTEB: Massive Text Embedding Benchmarkcited by 623
  2. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 553
  3. 2024Scaling and evaluating sparse autoencoderscited by 530
  4. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  5. 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 480
  6. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
  7. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
  8. 2024Skywork-Reward: Bag of Tricks for Reward Modeling in LLMscited by 322
  9. 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 151
  10. 2021Frustratingly Easy Edit-based Linguistic Steganography with a Masked Language Modelcited by 28
  11. 2023Functional Invariants to Watermark Large Transformerscited by 14
  12. 2025LinguaLens: Towards Interpreting Linguistic Mechanisms of Large Language Models via Sparse Auto-Encodercited by 13
  13. 2025Sandcastles in the Storm: Revisiting the (Im)possibility of Strong Watermarkingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.