Atlas: A Framework for ML Lifecycle Provenance & Transparency
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
The rapid adoption of open source machine learning (ML) datasets and models exposes today's AI applications to critical risks like data poisoning and supply chain attacks across the ML lifecycle. With growing regulatory pressure to address these issues through greater transparency, ML model vendors face challenges balancing these requirements against confidentiality for data and intellectual property needs. We propose Atlas, a framework that enables fully attestable ML pipelines. Atlas leverages open specifications for data and software supply chain provenance to collect verifiable records of model artifact authenticity and end-to-end lineage metadata. Atlas combines trusted hardware and transparency logs to enhance metadata integrity, preserve data confidentiality, and limit unauthorized access during ML pipeline operations, from training through deployment. Our prototype implementation of Atlas integrates several open-source tools to build an ML lifecycle transparency system, and assess the practicality of Atlas through two case study ML pipelines.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 26 of its 100 references that are in the map. First posted on arXiv 26 Feb 2025.
Builds on
26 of 100 references.
References · 26
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2021Membership Inference Attacks From First Principlescited by 878
- 2016Stealing Machine Learning Models via Prediction APIscited by 619
- 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 536
- 2017Certified Defenses for Data Poisoning Attackscited by 303
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 290
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 214
- 2021OpenFL: An open-source framework for Federated Learningcited by 58
- 2020A Systematic Review on Model Watermarking for Neural Networkscited by 52
- 2019Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challengescited by 39
14 more
- 2024The AI Community Building the Future? A Quantitative Analysis of Development Activity on Hugging Face Hubcited by 18
- 2022Machine Learning with Confidential Computing: A Systematization of Knowledgecited by 15
- 2024Laminator: Verifiable ML Property Cards using Hardware-assisted Attestationscited by 10
- 2023Examining the Impact of Provenance-Enabled Media on Trust and Accuracy Perceptionscited by 9
- 2020AMP: Authentication of Media via Provenancecited by 8
- 2022Attestation Mechanisms for Trusted Execution Environments Demystifiedcited by 8
- 2024Machine Learning Robustness: A Primercited by 8
- 2021Reproducible Builds: Increasing the Integrity of Software Supply Chainscited by 7
- 2024Certification for Differentially Private Prediction in Gradient-Based Trainingcited by 7
- 2024Fortify Your Foundations: Practical Privacy and Security for Foundation Model Deployments In The Cloudcited by 4
- 2023Beyond Detection: Unveiling Fairness Vulnerabilities in Abusive Language Modelscited by 3
- 2024Trustworthy confidential virtual machines for the massescited by 2
- 2020Building secure distributed applications the DECENT waycited by 1
- 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelinescited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2026AIBoMGen: Generating an AI Bill of Materials for Secure, Transparent, and Compliant Model Trainingcited by 6
- 2026Safeguarding LLM Agents from Misalignment through Provenance Analysiscited by 6
- 2026Operationalising Artificial Intelligence Bills of Materials (AIBOMs) for Verifiable AI Provenance and Lifecycle Assurancecited by 3
- 2025Scalable GPU-Based Integrity Verification for Large Machine Learning Modelscited by 1
- 2025Threat Modeling for AI: The Case for an Asset-Centric Approachcited by 0
- 2026A Blueprint for Self-Evolving Coding Agents in Vehicle Aerodynamic Drag Predictioncited by 0
- 2026A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face Modelscited by 0
- 2026Position: AI Governance Needs ISO-like Interoperability Protocols, Not Just Lawscited by 0
- 2026A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face Models19 Jul 2026
- 2026Position: AI Governance Needs ISO-like Interoperability Protocols, Not Just Laws30 May 2026
- 2026Safeguarding LLM Agents from Misalignment through Provenance Analysis1 May 2026
- 2026A Blueprint for Self-Evolving Coding Agents in Vehicle Aerodynamic Drag Prediction23 Mar 2026
- 2026Operationalising Artificial Intelligence Bills of Materials (AIBOMs) for Verifiable AI Provenance and Lifecycle Assurance17 Mar 2026
- 2026AIBoMGen: Generating an AI Bill of Materials for Secure, Transparent, and Compliant Model Training9 Jan 2026
- 2025Scalable GPU-Based Integrity Verification for Large Machine Learning Models27 Oct 2025
- 2025Threat Modeling for AI: The Case for an Asset-Centric Approach8 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025AI Bill of Materials and Beyond: Systematizing Security Assurance through the AI Risk Scanning (AIRS) Framework
- 2024"They've Stolen My GPL-Licensed Model!": Toward Standardized and Transparent Model Licensing
- 2026Attesting LLM Pipelines: Enforcing Verifiable Training and Release Claims
- 2026Lifecycle-Aware Dynamic Analysis for Secure ML Model Execution
- 2025A Framework for Cryptographic Verifiability of End-to-End AI Pipelines
- 2026OriginBlame: Record- and Token-Level Data Provenance for AI Training Datasets
- 2025LibVulnWatch: A Deep Assessment Agent System and Leaderboard for Uncovering Hidden Vulnerabilities in Open-Source AI Libraries
- 2026MAP-Graph: Provenance-Aware Shared Memory for Multi-Agent Workflows