Functional Subspace Watermarking for Large Language Models
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Model watermarking utilizes internal representations to protect the ownership of large language models (LLMs). However, these features inevitably undergo complex distortions during realistic model modifications such as fine-tuning, quantization, or knowledge distillation, making reliable extraction extremely challenging. Despite extensive research on model-side watermarking, existing methods still lack sufficient robustness against parameter-level perturbations. To address this gap, we propose textttFunctional Subspace Watermarking (FSW), a framework that anchors ownership signals into a low-dimensional functional backbone. Specifically, we first solve a generalized eigenvalue problem to extract a stable functional subspace for watermark injection, while introducing an adaptive spectral truncation strategy to achieve an optimal balance between robustness and model utility. Furthermore, a vector consistency constraint is incorporated to ensure that watermark injection does not compromise the original semantic performance. Extensive experiments across various LLM architectures and datasets demonstrate that our method achieves superior detection accuracy and statistical verifiability under multiple model attacks, maintaining robustness that outperforms existing state-of-the-art (SOTA) methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 23 of its 32 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
23 of 32 references.
Closest ancestors · 11
Same direction, newest first
- 2025SEAL: Subspace-Anchored Watermarks for LLM Ownership14 Nov
- 2025In-Context Watermarks for Large Language Models22 May
- 2024Robust Multi-bit Text Watermark with LLM-based Paraphrasers4 Dec
- 2024Ensemble Watermarks for Large Language Models29 Nov
- 2024Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approach3 Oct
- 2024EmMark: Robust Watermarks for IP Protection of Embedded Quantized Large Language Models27 Feb
- 2024Watermarking Makes Language Models Radioactive22 Feb
- 2023REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Models18 Oct
- 2023Watermarking LLMs with Weight Quantization17 Oct
- 2023Rethinking White-Box Watermarks on Deep Learning Models under Neural Structural Obfuscation17 Mar
- 2023A Watermark for Large Language Models24 Jan
Other references · 12
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
- 2024Qwen2 Technical Reportcited by 2,076
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
- 2024Instructional Fingerprinting of Large Language Modelscited by 64
- 2023PromptCARE: Prompt Copyright Protection by Watermark Injection and Verificationcited by 30
- 2025SoK: Large Language Model Copyright Auditing via Fingerprintingcited by 14
- 2024MergePrint: Merge-Resistant Fingerprints for Robust Black-box Ownership Verification of Large Language Modelscited by 6
- 2025Differentiation-Based Extraction of Proprietary Data from Fine-Tuned LLMscited by 6
Built on by
Not cited yet.