Fingerprint Vector: Enabling Scalable and Efficient Model Fingerprint Transfer via Vector Addition
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Backdoor-based fingerprinting has emerged as an effective technique for tracing the ownership of large language models. However, in real-world deployment scenarios, developers often instantiate multiple downstream models from a shared base model, and applying fingerprinting to each variant individually incurs prohibitive computational overhead. While inheritance-based approaches -- where fingerprints are embedded into the base model and expected to persist through fine-tuning -- appear attractive, they suffer from three key limitations: late-stage fingerprinting, fingerprint instability, and interference with downstream adaptation. To address these challenges, we propose a novel mechanism called the Fingerprint Vector. Our method first embeds a fingerprint into the base model via backdoor-based fine-tuning, then extracts a task-specific parameter delta as a fingerprint vector by computing the difference between the fingerprinted and clean models. This vector can be directly added to any structurally compatible downstream model, allowing the fingerprint to be transferred post hoc without additional fine-tuning. Extensive experiments show that Fingerprint Vector achieves comparable or superior performance to direct injection across key desiderata. It maintains strong effectiveness across diverse model architectures as well as mainstream downstream variants within the same family. It also preserves harmlessness and robustness in most cases. Even when slight robustness degradation is observed, the impact remains within acceptable bounds and is outweighed by the scalability benefits of our approach.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 14 of its 44 references that are in the map. First posted on arXiv 13 Sep 2024.
Builds on
14 of 44 references.
Closest ancestors · 1
Same direction, newest first
Other references · 13
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 798
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2018WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representationscited by 370
- 2020Retrieve, Program, Repeat: Complex Knowledge Base Question Answering via Alternate Meta-learningcited by 216
- 2023Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languagescited by 52
1 more
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 54
- 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarkingcited by 14
- 2025CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoorcited by 11
- 2026ICPO: Illocution-Calibrated Policy Optimization for Multi-Turn Conversationcited by 2
- 2026Prompt2Fingerprint: Plug-and-Play LLM Fingerprinting via Text-to-Weight Generationcited by 2
- 2025Spectral Logit Sculpting: Adaptive Low-Rank Logit Transformation for Controlled Text Generationcited by 1
- 2026ForgetMark: Stealthy Fingerprint Embedding via Targeted Unlearning in Language Modelscited by 1
- 2026"I See What You Did There": Can Large Vision-Language Models Understand Multimodal Puns?cited by 1
- 2026DNF: Dual-Layer Nested Fingerprinting for Large Language Model Intellectual Property Protectioncited by 0
- 2026Prompt2Fingerprint: Plug-and-Play LLM Fingerprinting via Text-to-Weight Generation18 May 2026
- 2026"I See What You Did There": Can Large Vision-Language Models Understand Multimodal Puns?7 Apr 2026
- 2026ICPO: Illocution-Calibrated Policy Optimization for Multi-Turn Conversation20 Jan 2026
- 2026DNF: Dual-Layer Nested Fingerprinting for Large Language Model Intellectual Property Protection13 Jan 2026
- 2026ForgetMark: Stealthy Fingerprint Embedding via Targeted Unlearning in Language Models13 Jan 2026
- 2025Spectral Logit Sculpting: Adaptive Low-Rank Logit Transformation for Controlled Text Generation19 Sep 2025
- 2025CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoor5 Sep 2025
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasures24 Jun 2025
- 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarking6 Mar 2025