LineageMark: Multi-user White-box Watermarking for Contribution Tracing in Model Derivation Chains
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
In open large language model (LLM) ecosystems, models are frequently adapted across multiple domains and applications, forming multi-stage derivation chains. Consequently, tracking and verifying historical contributions is essential for model provenance and intellectual property protection. However, existing watermarking methods are mainly designed for single-user, one-time embeddings, often fail under repeated model derivation and incremental updates. To address this problem, we propose LineageMark, a multi-user white-box watermarking framework for model derivation chains. The framework encodes watermarks in model parameters using a projection-based approach. Stable carriers are first selected to reduce sensitivity to model changes, each watermark bit is then represented as a projection statistic over these carriers. Additional watermark insertions introduce only bounded perturbations in the projection space, and margin constraints are used to maintain signal integrity. We evaluate the effectiveness of LineageMark in multi-stage model derivation chains. Experimental results show that LineageMark preserves contributor watermarks across multi-stage derivation and supports incremental multi-user watermark insertion. Furthermore, it exhibits robustness against perturbations such as re-watermarking, fine-tuning, quantization, and pruning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 38 of its 51 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
38 of 51 references.
Closest ancestors · 6
Same direction, newest first
- 2024EmMark: Robust Watermarks for IP Protection of Embedded Quantized Large Language Models27 Feb
- 2024Watermarking Makes Language Models Radioactive22 Feb
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
- 2023On the Reliability of Watermarks for Large Language Models7 Jun
- 2023Undetectable Watermarks for Language Models25 May
- 2023A Watermark for Large Language Models24 Jan
Other references · 32
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
20 more
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
- 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,121
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
- 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 906
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 357
- 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 201
- 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 148
- 2019Large-Scale Multi-Label Text Classification on EU Legislationcited by 104
- 2019DAWN: Dynamic Adversarial Watermarking of Neural Networkscited by 100
- 2019[Extended version] Rethinking Deep Neural Network Ownership Verification: Embedding Passports to Defeat Ambiguity Attackscited by 88
- 2021Proof-of-Learning: Definitions and Practicecited by 84
- 2024Instructional Fingerprinting of Large Language Modelscited by 68
- 2024MergePrint: Merge-Resistant Fingerprints for Robust Black-box Ownership Verification of Large Language Modelscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SEAL: Subspace-Anchored Watermarks for LLM Ownership
- 2024Watermarking Language Models through Language Models
- 2025PRO: Enabling Precise and Robust Text Watermark for Open-Source LLMs
- 2024A Watermark for Black-Box Language Models
- 2023Unbiased Watermark for Large Language Models
- 2025StealthInk: A Multi-bit and Stealthy Watermark for Large Language Models
- 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarking
- 2024WAPITI: A Watermark for Finetuned Open-Source LLMs