Mitigating Downstream Model Risks via Model Provenance
Not on the map. Why?
Abstract (arXiv)
Research and industry are rapidly advancing the innovation and adoption of foundation model-based systems, yet the tools for managing these models have not kept pace. Understanding the provenance and lineage of models is critical for researchers, industry, regulators, and public trust. While model cards and system cards were designed to provide transparency, they fall short in key areas: tracing model genealogy, enabling machine readability, offering reliable centralized management systems, and fostering consistent creation incentives. This challenge mirrors issues in software supply chain security, but AI/ML remains at an earlier stage of maturity. Addressing these gaps requires industry-standard tooling that can be adopted by foundation model publishers, open-source model innovators, and major distribution platforms. We propose a machine-readable model specification format to simplify the creation of model records, thereby reducing error-prone human effort, notably when a new model inherits most of its design from a foundation model. Our solution explicitly traces relationships between upstream and downstream models, enhancing transparency and traceability across the model lifecycle. To facilitate the adoption, we introduce the unified model record (UMR) repository , a semantically versioned system that automates the publication of model records to multiple formats (PDF, HTML, LaTeX) and provides a hosted web interface (https://modelrecord.com/). This proof of concept aims to set a new standard for managing foundation models, bridging the gap between innovation and responsible model management.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 37 references that are in the map. First posted on arXiv 3 Oct 2024.
Builds on
27 of 37 references.
References · 27
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2018Datasheets for Datasetscited by 1,386
- 2018Model Cards for Model Reportingcited by 1,080
- 2022Quantifying Memorization Across Neural Language Modelscited by 763
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 624
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
- 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 387
- 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 322
15 more
- 2024TrustLLM: Trustworthiness in Large Language Modelscited by 285
- 2023Beyond Memorization: Violating Privacy Via Inference with Large Language Modelscited by 175
- 2023Holistic Evaluation of Text-To-Image Modelscited by 160
- 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
- 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 81
- 2024Feature Re-Embedding: Towards Foundation Model-Level Performance in Computational Pathologycited by 67
- 2024On the Societal Impact of Open Foundation Modelscited by 65
- 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 61
- 2023PathLDM: Text conditioned Latent Diffusion Model for Histopathologycited by 52
- 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Paperscited by 49
- 2023Ecosystem Graphs: The Social Footprint of Foundation Modelscited by 32
- 2017Multi-Target, Multi-Camera Tracking by Hierarchical Clustering: Recent Progress on DukeMTMC Projectcited by 19
- 2023Do SSL Models Have D'ej`a Vu? A Case of Unintended Memorization in Self-supervised Learningcited by 19
- 2022System Cards for AI-Based Decision-Making for Public Policycited by 13
- 2024Deep Learning-based Prediction of Breast Cancer Tumor and Immune Phenotypes from Histopathologycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.