SeedPrints: Fingerprints Can Even Tell Which Seed Your Large Language Model Was Trained From
Not on the map. Why?
Abstract (arXiv)
Fingerprinting Large Language Models (LLMs)is essential for provenance verification and model attribution. Existing fingerprinting methods are primarily evaluated after fine-tuning, where models have already acquired stable signatures from training data, optimization dynamics, or hyperparameters. However, most of a model's capacity and knowledge are acquired during pretraining rather than downstream fine-tuning, making large-scale pretraining a more fundamental regime for lineage verification. We show that existing fingerprinting methods become unreliable in this regime, as they rely on post-hoc signatures that only emerge after substantial training. This limitation contradicts the classical Galton notion of a fingerprint as an intrinsic and persistent identity. In contrast, we propose a stronger and more intrinsic notion of LLM fingerprinting: SeedPrints, a method that leverages random initialization biases as persistent, seed-dependent identifiers present even before training begins. We show that untrained models exhibit reproducible prediction biases induced by their initialization seed, and that these weak signals remain statistically detectable throughout training, enabling high-confidence lineage verification. Unlike prior techniques that fail during early pretraining or degrade under distribution shifts, SeedPrints remains effective across all training stages, from initialization to large-scale pretraining and downstream adaptation. Experiments on LLaMA-style and Qwen-style models demonstrate seed-level distinguishability and enable birth-to-lifecycle identity verification. Evaluations on large-scale pretraining trajectories and real-world fingerprinting benchmarks further confirm its robustness under prolonged training, domain shifts, and parameter modifications.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
25 of 40 references.
References · 25
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Qwen2 Technical Reportcited by 2,076
- 2021Membership Inference Attacks From First Principlescited by 839
- 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
- 2023A Watermark for Large Language Modelscited by 667
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 425
- 2023Llemma: An Open Language Model For Mathematicscited by 385
- 2022The Stack: 3 TB of permissively licensed source codecited by 354
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2024Instructional Fingerprinting of Large Language Modelscited by 64
13 more
- 2019How to Prove Your Model Belongs to You: A Blind-Watermark based Framework to Protect Intellectual Property of DNNcited by 58
- 2024LLMmap: Fingerprinting For Large Language Modelscited by 56
- 2024Watermarking Makes Language Models Radioactivecited by 52
- 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 34
- 2023HuRef: HUman-REadable Fingerprint for Large Language Modelscited by 32
- 2024Hide and Seek: Fingerprinting Large Language Models with Evolutionary Learningcited by 18
- 2025Intrinsic Fingerprint of LLMs: Continue Training is NOT All You Need to Steal A Model!cited by 16
- 2025SoK: Large Language Model Copyright Auditing via Fingerprintingcited by 14
- 2025Scalable Fingerprinting of Large Language Modelscited by 11
- 2024Watermarking Language Models through Language Modelscited by 7
- 2025LLMs Have Rhythm: Fingerprinting Large Language Models Using Inter-Token Times and Network Traffic Analysiscited by 7
- 2025Natural Fingerprints of Large Language Modelscited by 6
- 2025RAFP: Identifying LLM Lineages via Rare-Region Fingerprintscited by 6
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026AttnDiff: Attention-based Differential Fingerprinting for Large Language Modelscited by 3
- 2026Your "Pro" LLM Subscription May Actually Be "Free": Exposing Fingerprint Spoofing Risks in LLM Inference Servicescited by 3
- 2026Hide and Seek in Embedding Space: Geometry-based Steganography and Detection in Large Language Modelscited by 1
- 2026TokenPrint: A Calibrated Token-Space Fingerprint for Language-Model Provenancecited by 1
- 2026The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparitycited by 0
- 2026Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Biascited by 0
- 2026modelDNA: Calibrated Lineage Verification and Merge Decomposition from Sampled Weight Fingerprintscited by 0
- 2026Query Expansion and Key Specialization in Transformer Attention Geometrycited by 0
- 2026Commutator Memory: Sparse, Path-Local Reading and Steering in Language Modelscited by 0
- 2026Commutator Memory: Sparse, Path-Local Reading and Steering in Language Models28 Sep 2026
- 2026Query Expansion and Key Specialization in Transformer Attention Geometry28 Sep 2026
- 2026TokenPrint: A Calibrated Token-Space Fingerprint for Language-Model Provenance8 Aug 2026
- 2026modelDNA: Calibrated Lineage Verification and Merge Decomposition from Sampled Weight Fingerprints12 Jul 2026
- 2026Your "Pro" LLM Subscription May Actually Be "Free": Exposing Fingerprint Spoofing Risks in LLM Inference Services15 Jun 2026
- 2026Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias27 May 2026
- 2026The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparity7 May 2026
- 2026AttnDiff: Attention-based Differential Fingerprinting for Large Language Models7 Apr 2026
- 2026Hide and Seek in Embedding Space: Geometry-based Steganography and Detection in Large Language Models30 Jan 2026