mlsanityData to 14 Oct 2026

OriginBlame: Record- and Token-Level Data Provenance for AI Training Datasets

arXiv 2607.13037 ↗First posted 19 May 2026cs.AIcited by 0

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

When a data contributor requests removal, model trainers face a practical gap: unlearning algorithms require a forget set, yet no tool can locate which training records belong to a given author. Existing provenance systems operate at file or dataset level, forcing catastrophic over-deletion. We present ob, a record- and token-level data provenance system that propagates author identity through data processing pipelines and resolves revocation requests into precise forget sets via deterministic queries. Evaluation on 219,555 Wikipedia pages demonstrates that record-level provenance eliminates dataset-level over-deletion (from 101x to 1.3x), while integration adds 1.3-4.0% throughput overhead (HuggingFace) and 2.1-19.0% (Datatrove) on wiki data. On a 1.7B model, provenance-based forget sets consistently reduce the collateral damage of machine unlearning (retain perplexity) relative to same-size random baselines across all evaluated authors, with membership-inference tests indicating they select genuinely memorized content.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 10 of its 28 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

10 of 28 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Not All Data Are Unlearned Equally7 Apr
  2. 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
  3. 2024Fast Exact Unlearning for In-Context Learning Data for LLMs1 Feb
  4. 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan

Other references · 6

  1. 2023StarCoder: may the source be with you!cited by 799
  2. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
  3. 2022The Stack: 3 TB of permissively licensed source codecited by 359
  4. 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
  5. 2022Design and Evaluation of IPFS: A Storage Layer for the Decentralized Webcited by 6
  6. 2026Fine-Grained Traceability for Transparent ML Pipelinescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TokenPrint: A Calibrated Token-Space Fingerprint for Language-Model Provenance
  2. 2026DataDignity: Training Data Attribution for Large Language Models
  3. 2025Unlearning at Scale: State-Exact Trace-Preserving Deletion in Billion-Parameter Language Models
  4. 2025Training Data Provenance Verification: Did Your Model Use Synthetic Data from My Generative Model for Training?
  5. 2024RESTOR: Knowledge Recovery in Machine Unlearning
  6. 2026Origin Is All You Need: Provenance-Aware Transformers for Structural Trust-Boundary Separation
  7. 2026PACMI: Provenance-Aware Cascading Memory Invalidation for Long-Term LLM Agents
  8. 2026Representation-Aware Unlearning via Activation Signatures: From Suppression to Entity-Signature Erasure