ForgetMark: Stealthy Fingerprint Embedding via Targeted Unlearning in Language Models
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Existing invasive (backdoor) fingerprints suffer from high-perplexity triggers that are easily filtered, fixed response patterns exposed by heuristic detectors, and spurious activations on benign inputs. We introduce textscForgetMark, a stealthy fingerprinting framework that encodes provenance via targeted unlearning. It builds a compact, human-readable key--value set with an assistant model and predictive-entropy ranking, then trains lightweight LoRA adapters to suppress the original values on their keys while preserving general capabilities. Ownership is verified under black/gray-box access by aggregating likelihood and semantic evidence into a fingerprint success rate. By relying on probabilistic forgetting traces rather than fixed trigger--response patterns, textscForgetMark avoids high-perplexity triggers, reduces detectability, and lowers false triggers. Across diverse architectures and settings, it achieves 100% ownership verification on fingerprinted models while maintaining standard performance, surpasses backdoor baselines in stealthiness and robustness to model merging, and remains effective under moderate incremental fine-tuning. Our code and data are available at hrefhttps://github.com/Xuzhenhua55/ForgetMarkhttps://github.com/Xuzhenhua55/ForgetMark.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 39 of its 55 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
39 of 55 references.
Closest ancestors · 7
Same direction, newest first
- 2025CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoor5 Sep
- 2025Copyright Protection for Large Language Models: A Survey of Methods, Challenges, and Trends15 Aug
- 2025MEraser: An Effective Fingerprint Erasure Approach for Large Language Models14 Jun
- 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarking6 Mar
- 2024Fingerprint Vector: Enabling Scalable and Efficient Model Fingerprint Transfer via Vector Addition13 Sep
- 2024Have You Merged My Model? On The Robustness of Large Language Model IP Protection Methods Against Model Merging8 Apr
- 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Models10 Dec
Other references · 32
- 2023GPT-4 Technical Reportcited by 18,396
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2023Mistral 7Bcited by 3,164
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
- 2019Machine Unlearningcited by 1,061
- 2016The LAMBADA dataset: Word prediction requiring a broad discourse contextcited by 992
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
- 2017Crowdsourcing Multiple Choice Science Questionscited by 765
- 2018WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representationscited by 372
- 2024Rethinking Machine Unlearning for Large Language Modelscited by 257
20 more
- 2019WinoGrande: An Adversarial Winograd Schema Challenge at Scalecited by 204
- 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
- 2024ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Areacited by 71
- 2024Instructional Fingerprinting of Large Language Modelscited by 68
- 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 59
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 57
- 2024Hey, That's My Model! Introducing Chain & Hash, An LLM Fingerprinting Techniquecited by 37
- 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 36
- 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 35
- 2023HuRef: HUman-REadable Fingerprint for Large Language Modelscited by 34
- 2025A Comprehensive Survey of Machine Unlearning Techniques for Large Language Modelscited by 34
- 2024A Fingerprint for Large Language Modelscited by 28
- 2025Hybrid Token Compression for Vision-Language Modelscited by 20
- 2024UTF:Undertrained Tokens as Fingerprints A Novel Approach to LLM Identificationcited by 18
- 2025IAG: Input-aware Backdoor Attack on VLM-based Visual Groundingcited by 12
- 2025EverTracer: Hunting Stolen Large Language Models via Stealthy and Robust Probabilistic Fingerprintcited by 12
- 2025PREE: Towards Harmless and Adaptive Fingerprint Editing in Large Language Models via Knowledge Prefix Enhancementcited by 11
- 2025Web Fraud Attacks Against LLM-Driven Multi-Agent Systemscited by 10
- 2025SRAF: Stealthy and Robust Adversarial Fingerprint for Copyright Verification of Large Language Modelscited by 8
- 2025Unlocking the Effectiveness of LoRA-FP for Seamless Transfer Implantation of Fingerprints in Downstream Modelscited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FPEdit: Robust LLM Fingerprinting through Localized Parameter Editing
- 2026DNF: Dual-Layer Nested Fingerprinting for Large Language Model Intellectual Property Protection
- 2026KinGuard: Hierarchical Kinship-Aware Fingerprinting to Defend Against Large Language Model Stealing ↗
- 2025LLM Fingerprinting via Semantically Conditioned Watermarks
- 2026A Behavioral Fingerprint for Large Language Models: Provenance Tracking via Refusal Vectors
- 2026SIF: Semantically In-Distribution Fingerprints for Large Vision-Language Models
- 2026From Bits to Beliefs: Recoverable Semantic Fingerprints for Black-Box Verification of Large Language Models
- 2025CoTSRF: Utilize Chain of Thought as Stealthy and Robust Fingerprint of Large Language Models