Targeted Counterfactual Fingerprinting for Black-Box LLM Ownership Verification
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are high-value assets that can be derived through redeployment, fine-tuning, quantization, or further alignment. Because deployed LLMs are commonly exposed only through query APIs, ownership verification must often rely on black-box text responses. This setting is difficult: generations are open-ended and can vary across repeated queries, while existing black-box fingerprints rely on signals that are fragile under a final-response interface, including full-text matching, soft behavioral features, or model-specific prompts designed not to transfer. We propose TCF (Targeted Counterfactual Fingerprinting), a black-box LLM fingerprinting framework that converts open-ended generation comparison into constrained-answer targeted counterfactual transfer. TCF restricts each verification query to a finite answer space, reducing the surface-form ambiguity that enters the verification score, and optimizes a prompt perturbation toward a counterfactual target different from the protected model's clean answer on the original prompt. Verification reduces to checking whether the suspect model's parsed final answer matches the recorded target. We introduce the source-model counterfactual margin (SCM), a protected-model-only quantity that certifies the target is unlikely before the perturbation and likely after it; SCM controls target selection, perturbation stopping, and fingerprint filtering. Under explicit derived-preservation and independent-transfer budgets motivated by local behavioral closeness, we derive a target-accuracy gap between derived and independent models. Across four LLM families, TCF achieves an average AUC of 0.9861, improving over TRAP, ProFLingo, and ZeroPrint by 0.07 to 0.19.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
36 of 45 references.
References · 36
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024Qwen2 Technical Reportcited by 2,120
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023A Watermark for Large Language Modelscited by 725
- 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 666
- 2023Can AI-Generated Text be Reliably Detected?cited by 386
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 357
24 more
- 20242 OLMo 2 Furiouscited by 340
- 2017Embedding Watermarks into Deep Neural Networkscited by 248
- 2024Stealing Part of a Production Language Modelcited by 159
- 2020Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hidingcited by 130
- 2017Adversarial Frontier Stitching for Remote Neural Network Watermarkingcited by 118
- 2023Unbiased Watermark for Large Language Modelscited by 111
- 2019Deep Neural Network Fingerprinting by Conferrable Adversarial Examplescited by 93
- 2024Watermark Stealing in Large Language Modelscited by 92
- 2023On the Possibilities of AI-Generated Text Detectioncited by 88
- 2019IPGuard: Protecting Intellectual Property of Deep Neural Networks via Fingerprinting the Classification Boundarycited by 70
- 2024Instructional Fingerprinting of Large Language Modelscited by 68
- 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 61
- 2022Watermarking Pre-trained Language Models with Backdooringcited by 50
- 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Modelscited by 46
- 2024MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmarkcited by 41
- 2024TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identificationcited by 36
- 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 36
- 2023HuRef: HUman-REadable Fingerprint for Large Language Modelscited by 34
- 2024Double-I Watermark: Protecting Model Copyright for LLM Fine-tuningcited by 21
- 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarkingcited by 19
- 2024ProFLingo: A Fingerprinting-based Intellectual Property Protection Scheme for Large Language Modelscited by 16
- 2025EverTracer: Hunting Stolen Large Language Models via Stealthy and Robust Probabilistic Fingerprintcited by 12
- 2025CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoorcited by 12
- 2023NaturalFinger: Generating Natural Fingerprint with Generative Adversarial Networkscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Forging LLM Authorship Fingerprints with Targeted Rewriting30 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026From Bits to Beliefs: Recoverable Semantic Fingerprints for Black-Box Verification of Large Language Models
- 2024LLMmap: Fingerprinting For Large Language Models
- 2025Fingerprinting LLMs via Prompt Injection
- 2025RAFP: Identifying LLM Lineages via Rare-Region Fingerprints
- 2025CoTSRF: Utilize Chain of Thought as Stealthy and Robust Fingerprint of Large Language Models
- 2026A Behavioral Fingerprint for Large Language Models: Provenance Tracking via Refusal Vectors
- 2025LLM Fingerprinting via Semantically Conditioned Watermarks
- 2026FLIPS: Instance-Fingerprinting for LLMs via Pseudo-random Sequences