mlsanityData to 14 Oct 2026

SoK: Large Language Model Copyright Auditing via Fingerprinting

arXiv 2508.19843 ↗First posted 27 Aug 2025cs.CR cs.AI cs.CLcited by 15

Not on the map. Why?

Abstract (arXiv)

The broad capabilities and substantial resources required to train Large Language Models (LLMs) make them valuable intellectual property, yet they remain vulnerable to copyright infringement, such as unauthorized use and model theft. LLM fingerprinting, a non-intrusive technique that compares the distinctive features (i.e., fingerprint) of LLMs to identify whether an LLM is derived from another, offers a promising solution to copyright auditing. However, its reliability remains uncertain due to the prevalence of diverse model modifications and the lack of standardized evaluation. In this SoK, we present the first comprehensive study of the emerging LLM fingerprinting. We introduce a unified framework and taxonomy that structures the field: white-box methods are classified based on their feature source as static, forward-pass, or backward-pass fingerprinting, while black-box methods are distinguished by their query strategy as either untargeted or targeted. Furthermore, we propose LeaFBench, the first systematic benchmark for evaluating LLM fingerprinting under realistic deployment scenarios. Built upon 7 mainstream foundation models and comprising 149 distinct model instances, LeaFBench integrates 13 representative post-development techniques, spanning both parameter-altering methods (e.g., fine-tuning, quantization) and parameter-independent techniques (e.g., system prompts, RAG). Extensive experiments on LeaFBench reveal the strengths and weaknesses of existing methods, thereby outlining future research directions and critical open problems in this emerging field. The code is available at https://github.com/shaoshuo-ss/LeaFBench.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 75 of its 97 references that are in the map. First posted on arXiv 27 Aug 2025.

Builds on

75 of 97 references.

References · 75

  1. 2017Attention Is All You Needcited by 60,361
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  7. 2023Mistral 7Bcited by 3,164
  8. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  9. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  10. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  11. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  12. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
38 more
  1. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 903
  2. 2020Aligning AI With Shared Human Valuescited by 723
  3. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
  4. 2024TinyLlama: An Open-Source Small Language Modelcited by 618
  5. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  6. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  7. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  8. 2024A Survey on Mixture of Experts in Large Language Modelscited by 237
  9. 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
  10. 2024Stealing Part of a Production Language Modelcited by 159
  11. 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
  12. 2023A Survey of Text Watermarking in the Era of Large Language Modelscited by 112
  13. 2023REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Modelscited by 78
  14. 2021SoK: How Robust is Image Classification Deep Neural Network Watermarking? (Extended Version)cited by 69
  15. 2024LLMmap: Fingerprinting For Large Language Modelscited by 58
  16. 2024Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Applicationcited by 56
  17. 2024SoK: Watermarking for AI-Generated Contentcited by 51
  18. 2024A Comprehensive Evaluation of Quantization Strategies for Large Language Modelscited by 48
  19. 2024Model Equality Testing: Which Model Is This API Serving?cited by 47
  20. 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Modelscited by 46
  21. 2024Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attributioncited by 40
  22. 2025Are You Getting What You Pay For? Auditing Model Substitution in LLM APIscited by 38
  23. 2024TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identificationcited by 36
  24. 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 36
  25. 2023HuRef: HUman-REadable Fingerprint for Large Language Modelscited by 34
  26. 2021ModelDiff: Testing-Based DNN Similarity Comparison for Model Reuse Detectioncited by 33
  27. 2024Your Large Language Models Are Leaving Fingerprintscited by 33
  28. 2025Idiosyncrasies in Large Language Modelscited by 33
  29. 2020Intellectual Property Protection for Deep Learning Models: Taxonomy, Methods, Attacks, and Evaluationscited by 31
  30. 2024A Fingerprint for Large Language Modelscited by 28
  31. 2024Watermarking Techniques for Large Language Models: A Surveycited by 23
  32. 2022MOVE: Effective and Harmless Ownership Verification via Embedded External Featurescited by 21
  33. 2025Shadow in the Cache: Unveiling and Mitigating Privacy Risks of KV-cache in LLM Inferencecited by 21
  34. 2025Copyright Protection for Large Language Models: A Survey of Methods, Challenges, and Trendscited by 20
  35. 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarkingcited by 19
  36. 2024Hide and Seek: Fingerprinting Large Language Models with Evolutionary Learningcited by 18
  37. 2024UTF:Undertrained Tokens as Fingerprints A Novel Approach to LLM Identificationcited by 18
  38. 2025Auditing Black-Box LLM APIs with a Rank-Based Uniformity Testcited by 18

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 12.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025SoK: Are Watermarks in LLMs Ready for Deployment?
  2. 2026A Behavioral Fingerprint for Large Language Models: Provenance Tracking via Refusal Vectors
  3. 2025Leave No TRACE: Black-box Detection of Copyrighted Dataset Usage in Large Language Models via Watermarking
  4. 2025EverTracer: Hunting Stolen Large Language Models via Stealthy and Robust Probabilistic Fingerprint
  5. 2024Instructional Fingerprinting of Large Language Models
  6. 2025The Challenge of Identifying the Origin of Black-Box Large Language Models
  7. 2024Can Watermarking Large Language Models Prevent Copyrighted Text Generation and Hide Training Data?
  8. 2024Have You Merged My Model? On The Robustness of Large Language Model IP Protection Methods Against Model Merging