mlsanityData to 7 Oct 2026

SeedPrints: Fingerprints Can Even Tell Which Seed Your Large Language Model Was Trained From

arXiv 2509.26404 ↗First posted 30 Sep 2025cs.CR cs.AI cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Fingerprinting Large Language Models (LLMs)is essential for provenance verification and model attribution. Existing fingerprinting methods are primarily evaluated after fine-tuning, where models have already acquired stable signatures from training data, optimization dynamics, or hyperparameters. However, most of a model's capacity and knowledge are acquired during pretraining rather than downstream fine-tuning, making large-scale pretraining a more fundamental regime for lineage verification. We show that existing fingerprinting methods become unreliable in this regime, as they rely on post-hoc signatures that only emerge after substantial training. This limitation contradicts the classical Galton notion of a fingerprint as an intrinsic and persistent identity. In contrast, we propose a stronger and more intrinsic notion of LLM fingerprinting: SeedPrints, a method that leverages random initialization biases as persistent, seed-dependent identifiers present even before training begins. We show that untrained models exhibit reproducible prediction biases induced by their initialization seed, and that these weak signals remain statistically detectable throughout training, enabling high-confidence lineage verification. Unlike prior techniques that fail during early pretraining or degrade under distribution shifts, SeedPrints remains effective across all training stages, from initialization to large-scale pretraining and downstream adaptation. Experiments on LLaMA-style and Qwen-style models demonstrate seed-level distinguishability and enable birth-to-lifecycle identity verification. Evaluations on large-scale pretraining trajectories and real-world fingerprinting benchmarks further confirm its robustness under prolonged training, domain shifts, and parameter modifications.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

25 of 40 references.

References · 25

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  3. 2024Qwen2 Technical Reportcited by 2,076
  4. 2021Membership Inference Attacks From First Principlescited by 839
  5. 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
  6. 2023A Watermark for Large Language Modelscited by 667
  7. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
  8. 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 425
  9. 2023Llemma: An Open Language Model For Mathematicscited by 385
  10. 2022The Stack: 3 TB of permissively licensed source codecited by 354
  11. 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
  12. 2024Instructional Fingerprinting of Large Language Modelscited by 64
13 more
  1. 2019How to Prove Your Model Belongs to You: A Blind-Watermark based Framework to Protect Intellectual Property of DNNcited by 58
  2. 2024LLMmap: Fingerprinting For Large Language Modelscited by 56
  3. 2024Watermarking Makes Language Models Radioactivecited by 52
  4. 2024REEF: Representation Encoding Fingerprints for Large Language Modelscited by 34
  5. 2023HuRef: HUman-REadable Fingerprint for Large Language Modelscited by 32
  6. 2024Hide and Seek: Fingerprinting Large Language Models with Evolutionary Learningcited by 18
  7. 2025Intrinsic Fingerprint of LLMs: Continue Training is NOT All You Need to Steal A Model!cited by 16
  8. 2025SoK: Large Language Model Copyright Auditing via Fingerprintingcited by 14
  9. 2025Scalable Fingerprinting of Large Language Modelscited by 11
  10. 2024Watermarking Language Models through Language Modelscited by 7
  11. 2025LLMs Have Rhythm: Fingerprinting Large Language Models Using Inter-Token Times and Network Traffic Analysiscited by 7
  12. 2025Natural Fingerprints of Large Language Modelscited by 6
  13. 2025RAFP: Identifying LLM Lineages via Rare-Region Fingerprintscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.