SoK: Large Language Model Copyright Auditing via Fingerprinting
Not on the map. Why?
Abstract (arXiv)
The broad capabilities and substantial resources required to train Large Language Models (LLMs) make them valuable intellectual property, yet they remain vulnerable to copyright infringement, such as unauthorized use and model theft. LLM fingerprinting, a non-intrusive technique that compares the distinctive features (i.e., fingerprint) of LLMs to identify whether an LLM is derived from another, offers a promising solution to copyright auditing. However, its reliability remains uncertain due to the prevalence of diverse model modifications and the lack of standardized evaluation. In this SoK, we present the first comprehensive study of the emerging LLM fingerprinting. We introduce a unified framework and taxonomy that structures the field: white-box methods are classified based on their feature source as static, forward-pass, or backward-pass fingerprinting, while black-box methods are distinguished by their query strategy as either untargeted or targeted. Furthermore, we propose LeaFBench, the first systematic benchmark for evaluating LLM fingerprinting under realistic deployment scenarios. Built upon 7 mainstream foundation models and comprising 149 distinct model instances, LeaFBench integrates 13 representative post-development techniques, spanning both parameter-altering methods (e.g., fine-tuning, quantization) and parameter-independent techniques (e.g., system prompts, RAG). Extensive experiments on LeaFBench reveal the strengths and weaknesses of existing methods, thereby outlining future research directions and critical open problems in this emerging field. The code is available at https://github.com/shaoshuo-ss/LeaFBench.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 75 of its 97 references that are in the map. First posted on arXiv 27 Aug 2025.
Builds on
75 of 97 references.
References · 75
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Mistral 7Bcited by 3,164
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
38 more
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 903
- 2020Aligning AI With Shared Human Valuescited by 723
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
- 2024TinyLlama: An Open-Source Small Language Modelcited by 618
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
- 2024A Survey on Mixture of Experts in Large Language Modelscited by 237
- 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
- 2024Stealing Part of a Production Language Modelcited by 159
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
- 2023A Survey of Text Watermarking in the Era of Large Language Modelscited by 112
- 2023REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Modelscited by 78
- 2021SoK: How Robust is Image Classification Deep Neural Network Watermarking? (Extended Version)cited by 69
- 2024LLMmap: Fingerprinting For Large Language Modelscited by 58
- 2024Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Applicationcited by 56
- 2024SoK: Watermarking for AI-Generated Contentcited by 51
- 2024A Comprehensive Evaluation of Quantization Strategies for Large Language Modelscited by 48
- 2024Model Equality Testing: Which Model Is This API Serving?cited by 47
- 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Modelscited by 46
- 2024Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attributioncited by 40
- 2025Are You Getting What You Pay For? Auditing Model Substitution in LLM APIscited by 38
- 2024TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identificationcited by 36
- 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 36
- 2023HuRef: HUman-REadable Fingerprint for Large Language Modelscited by 34
- 2021ModelDiff: Testing-Based DNN Similarity Comparison for Model Reuse Detectioncited by 33
- 2024Your Large Language Models Are Leaving Fingerprintscited by 33
- 2025Idiosyncrasies in Large Language Modelscited by 33
- 2020Intellectual Property Protection for Deep Learning Models: Taxonomy, Methods, Attacks, and Evaluationscited by 31
- 2024A Fingerprint for Large Language Modelscited by 28
- 2024Watermarking Techniques for Large Language Models: A Surveycited by 23
- 2022MOVE: Effective and Harmless Ownership Verification via Embedded External Featurescited by 21
- 2025Shadow in the Cache: Unveiling and Mitigating Privacy Risks of KV-cache in LLM Inferencecited by 21
- 2025Copyright Protection for Large Language Models: A Survey of Methods, Challenges, and Trendscited by 20
- 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarkingcited by 19
- 2024Hide and Seek: Fingerprinting Large Language Models with Evolutionary Learningcited by 18
- 2024UTF:Undertrained Tokens as Fingerprints A Novel Approach to LLM Identificationcited by 18
- 2025Auditing Black-Box LLM APIs with a Rank-Based Uniformity Testcited by 18
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 12.
15 papers.
Sort:
By area:
- 2025SeedPrints: Fingerprints Can Even Tell Which Seed Your Large Language Model Was Trained Fromcited by 10
- 2025Are Robust LLM Fingerprints Adversarially Robust?cited by 8
- 2025SWAP: Towards Copyright Auditing of Soft Prompts via Sequential Watermarkingcited by 3
- 2026Cert-LAS: Toward Certified Model Ownership Verification for Text-to-Image Diffusion Models via Layer-Adaptive Smoothingcited by 3
- 2026FLIPS: Instance-Fingerprinting for LLMs via Pseudo-random Sequencescited by 3
- 2026Your "Pro" LLM Subscription May Actually Be "Free": Exposing Fingerprint Spoofing Risks in LLM Inference Servicescited by 3
- 2026Echoes within the Reasoning: Stealthy and Effective Watermarking via Chain of Thoughtcited by 2
- 2026Implicit Identity Technologies for LLMs: Fingerprinting and Watermarking across Datasets, Models, and Generated Contentcited by 1
- 2026Functional Subspace Watermarking for Large Language Modelscited by 0
- 2026Black-Box Inference of LLM Architectural Properties with Restrictive API Accesscited by 0
- 2026modelDNA: Calibrated Lineage Verification and Merge Decomposition from Sampled Weight Fingerprintscited by 0
- 2026Who Built This Model? Tracing LLM Lineage via Spectral Fingerprints in Weight Spacecited by 0
3 more
- 2026Language Model Fingerprinting Requires Rethinking Watermark Teachers3 Oct 2026
- 2026Who Is Behind the Harness? Fingerprinting LLMs through Agentic Behavior23 Sep 2026
- 2026Fingerprinting Multimodal Large Language Models17 Sep 2026
- 2026Who Built This Model? Tracing LLM Lineage via Spectral Fingerprints in Weight Space7 Aug 2026
- 2026modelDNA: Calibrated Lineage Verification and Merge Decomposition from Sampled Weight Fingerprints12 Jul 2026
- 2026Black-Box Inference of LLM Architectural Properties with Restrictive API Access1 Jul 2026
- 2026Your "Pro" LLM Subscription May Actually Be "Free": Exposing Fingerprint Spoofing Risks in LLM Inference Services15 Jun 2026
- 2026FLIPS: Instance-Fingerprinting for LLMs via Pseudo-random Sequences2 Jun 2026
- 2026Cert-LAS: Toward Certified Model Ownership Verification for Text-to-Image Diffusion Models via Layer-Adaptive Smoothing28 May 2026
- 2026Implicit Identity Technologies for LLMs: Fingerprinting and Watermarking across Datasets, Models, and Generated Content28 May 2026
- 2026Echoes within the Reasoning: Stealthy and Effective Watermarking via Chain of Thought27 May 2026
- 2026Functional Subspace Watermarking for Large Language Models19 Mar 2026
- 2025SeedPrints: Fingerprints Can Even Tell Which Seed Your Large Language Model Was Trained Fromcited by 10
- 2025Are Robust LLM Fingerprints Adversarially Robust?cited by 8
- 2026FLIPS: Instance-Fingerprinting for LLMs via Pseudo-random Sequencescited by 3
- 2026Your "Pro" LLM Subscription May Actually Be "Free": Exposing Fingerprint Spoofing Risks in LLM Inference Servicescited by 3
- 2026Black-Box Inference of LLM Architectural Properties with Restrictive API Accesscited by 0
- 2026modelDNA: Calibrated Lineage Verification and Merge Decomposition from Sampled Weight Fingerprintscited by 0
- 2026Who Built This Model? Tracing LLM Lineage via Spectral Fingerprints in Weight Spacecited by 0
- 2026Who Built This Model? Tracing LLM Lineage via Spectral Fingerprints in Weight Space7 Aug 2026
- 2026modelDNA: Calibrated Lineage Verification and Merge Decomposition from Sampled Weight Fingerprints12 Jul 2026
- 2026Black-Box Inference of LLM Architectural Properties with Restrictive API Access1 Jul 2026
- 2026Your "Pro" LLM Subscription May Actually Be "Free": Exposing Fingerprint Spoofing Risks in LLM Inference Services15 Jun 2026
- 2026FLIPS: Instance-Fingerprinting for LLMs via Pseudo-random Sequences2 Jun 2026
- 2025Are Robust LLM Fingerprints Adversarially Robust?30 Sep 2025
- 2025SeedPrints: Fingerprints Can Even Tell Which Seed Your Large Language Model Was Trained From30 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025SoK: Are Watermarks in LLMs Ready for Deployment?
- 2026A Behavioral Fingerprint for Large Language Models: Provenance Tracking via Refusal Vectors
- 2025Leave No TRACE: Black-box Detection of Copyrighted Dataset Usage in Large Language Models via Watermarking
- 2025EverTracer: Hunting Stolen Large Language Models via Stealthy and Robust Probabilistic Fingerprint
- 2024Instructional Fingerprinting of Large Language Models
- 2025The Challenge of Identifying the Origin of Black-Box Large Language Models
- 2024Can Watermarking Large Language Models Prevent Copyrighted Text Generation and Hide Training Data?
- 2024Have You Merged My Model? On The Robustness of Large Language Model IP Protection Methods Against Model Merging