Stemma: Induced Decision Regions Reveal LLM Provenance
Not on the map. Why?
Abstract (arXiv)
LLM provenance testing asks whether a suspect LLM belongs to the same lineage as a source. Existing black-box methods largely infer this relationship from response-level characteristics, but these characteristics may shift under adaptation or deployment even when the underlying meaning remains unchanged, weakening the reliability of provenance evidence. To address this limitation, we introduce induced decision regions by mapping open-ended outputs into a finite decision space, thereby abstracting away surface-form variation and reframing provenance testing as measuring the inheritance of decision regions. Empirical analysis shows that the source's induced regions are preserved more strongly in related models than in unrelated models. Building on this signal, we propose Stemma, a practical black-box LLM fingerprinting method that operationalises stability, robustness, and specificity as complementary probe-selection principles for reliably estimating induced decision region inheritance. Across 770 source-suspect pairs drawn from 56 public checkpoints and spanning diverse model-weight transformations, Stemma achieves 0.967 AUC and 87.8% TPR at 1% FPR, substantially outperforming four representative baselines. It further achieves 0.995 AUC and 93.5% TPR at 1% FPR on 1,260 pairs covering 91 deployment instances, demonstrating robustness to diverse inference-time deployment settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 39 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
31 of 39 references.
References · 31
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 454
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 249
- 2017Embedding Watermarks into Deep Neural Networkscited by 227
- 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
- 2020Entangled Watermarks as a Defense against Model Extractioncited by 144
- 2024A Thorough Examination of Decoding Methods in the Era of LLMscited by 112
- 2019IPGuard: Protecting Intellectual Property of Deep Neural Networks via Fingerprinting the Classification Boundarycited by 68
19 more
- 2024LLMmap: Fingerprinting For Large Language Modelscited by 56
- 2023When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Modelscited by 50
- 2024Model Merging and Safety Alignment: One Bad Model Spoils the Bunchcited by 41
- 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 34
- 2024TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identificationcited by 33
- 2024BadMerging: Backdoor Attacks Against Model Mergingcited by 32
- 2022Are You Stealing My Model? Sample Correlation for Fingerprinting Deep Neural Networkscited by 21
- 2023Watermarking LLMs with Weight Quantizationcited by 19
- 2025Auditing Black-Box LLM APIs with a Rank-Based Uniformity Testcited by 16
- 2024ProFLingo: A Fingerprinting-based Intellectual Property Protection Scheme for Large Language Modelscited by 15
- 2025Model Provenance Testing for Large Language Modelscited by 15
- 2024Neural Lineagecited by 9
- 2025DuFFin: A Dual-Level Fingerprinting Framework for LLMs IP Protectioncited by 8
- 2025Fingerprinting LLMs via Prompt Injectioncited by 8
- 2025LLM Fingerprinting via Semantically Conditioned Watermarkscited by 7
- 2024Intellectual Property Protection for Deep Learning Model and Dataset Intelligencecited by 6
- 2025An Empirical Analysis of Machine Learning Model and Dataset Documentation, Supply Chain, and Licensing Challenges on Hugging Facecited by 6
- 2024Queries, Representation & Detection: The Next 100 Model Fingerprinting Schemescited by 5
- 2026KBF: Knowledge Boundary as Fingerprint for Language Model and Black-Box API Auditingcited by 3
Built on by
Not cited yet.