mlsanityData to 14 Oct 2026

Targeted Counterfactual Fingerprinting for Black-Box LLM Ownership Verification

arXiv 2608.08195 ↗First posted 8 Aug 2026cs.CR cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are high-value assets that can be derived through redeployment, fine-tuning, quantization, or further alignment. Because deployed LLMs are commonly exposed only through query APIs, ownership verification must often rely on black-box text responses. This setting is difficult: generations are open-ended and can vary across repeated queries, while existing black-box fingerprints rely on signals that are fragile under a final-response interface, including full-text matching, soft behavioral features, or model-specific prompts designed not to transfer. We propose TCF (Targeted Counterfactual Fingerprinting), a black-box LLM fingerprinting framework that converts open-ended generation comparison into constrained-answer targeted counterfactual transfer. TCF restricts each verification query to a finite answer space, reducing the surface-form ambiguity that enters the verification score, and optimizes a prompt perturbation toward a counterfactual target different from the protected model's clean answer on the original prompt. Verification reduces to checking whether the suspect model's parsed final answer matches the recorded target. We introduce the source-model counterfactual margin (SCM), a protected-model-only quantity that certifies the target is unlikely before the perturbation and likely after it; SCM controls target selection, perturbation stopping, and fingerprint filtering. Under explicit derived-preservation and independent-transfer budgets motivated by local behavioral closeness, we derive a target-accuracy gap between derived and independent models. Across four LLM families, TCF achieves an average AUC of 0.9861, improving over TRAP, ProFLingo, and ZeroPrint by 0.07 to 0.19.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

36 of 45 references.

References · 36

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  6. 2024Qwen2 Technical Reportcited by 2,120
  7. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  8. 2025Gemma 3 Technical Reportcited by 1,824
  9. 2023A Watermark for Large Language Modelscited by 725
  10. 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 666
  11. 2023Can AI-Generated Text be Reliably Detected?cited by 386
  12. 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 357
24 more
  1. 20242 OLMo 2 Furiouscited by 340
  2. 2017Embedding Watermarks into Deep Neural Networkscited by 248
  3. 2024Stealing Part of a Production Language Modelcited by 159
  4. 2020Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hidingcited by 130
  5. 2017Adversarial Frontier Stitching for Remote Neural Network Watermarkingcited by 118
  6. 2023Unbiased Watermark for Large Language Modelscited by 111
  7. 2019Deep Neural Network Fingerprinting by Conferrable Adversarial Examplescited by 93
  8. 2024Watermark Stealing in Large Language Modelscited by 92
  9. 2023On the Possibilities of AI-Generated Text Detectioncited by 88
  10. 2019IPGuard: Protecting Intellectual Property of Deep Neural Networks via Fingerprinting the Classification Boundarycited by 70
  11. 2024Instructional Fingerprinting of Large Language Modelscited by 68
  12. 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 61
  13. 2022Watermarking Pre-trained Language Models with Backdooringcited by 50
  14. 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Modelscited by 46
  15. 2024MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmarkcited by 41
  16. 2024TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identificationcited by 36
  17. 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 36
  18. 2023HuRef: HUman-REadable Fingerprint for Large Language Modelscited by 34
  19. 2024Double-I Watermark: Protecting Model Copyright for LLM Fine-tuningcited by 21
  20. 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarkingcited by 19
  21. 2024ProFLingo: A Fingerprinting-based Intellectual Property Protection Scheme for Large Language Modelscited by 16
  22. 2025EverTracer: Hunting Stolen Large Language Models via Stealthy and Robust Probabilistic Fingerprintcited by 12
  23. 2025CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoorcited by 12
  24. 2023NaturalFinger: Generating Natural Fingerprint with Generative Adversarial Networkscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Bits to Beliefs: Recoverable Semantic Fingerprints for Black-Box Verification of Large Language Models
  2. 2024LLMmap: Fingerprinting For Large Language Models
  3. 2025Fingerprinting LLMs via Prompt Injection
  4. 2025RAFP: Identifying LLM Lineages via Rare-Region Fingerprints
  5. 2025CoTSRF: Utilize Chain of Thought as Stealthy and Robust Fingerprint of Large Language Models
  6. 2026A Behavioral Fingerprint for Large Language Models: Provenance Tracking via Refusal Vectors
  7. 2025LLM Fingerprinting via Semantically Conditioned Watermarks
  8. 2026FLIPS: Instance-Fingerprinting for LLMs via Pseudo-random Sequences