The "Collections as ML Data" Checklist for Machine Learning & Cultural Heritage
Not on the map. Why?
Abstract (arXiv)
Within the cultural heritage sector, there has been a growing and concerted effort to consider a critical sociotechnical lens when applying machine learning techniques to digital collections. Though the cultural heritage community has collectively developed an emerging body of work detailing responsible operations for machine learning in libraries and other cultural heritage institutions at the organizational level, there remains a paucity of guidelines created specifically for practitioners embarking on machine learning projects. The manifold stakes and sensitivities involved in applying machine learning to cultural heritage underscore the importance of developing such guidelines. This paper contributes to this need by formulating a detailed checklist with guiding questions and practices that can be employed while developing a machine learning project that utilizes cultural heritage data. I call the resulting checklist the "Collections as ML Data" checklist, which, when completed, can be published with the deliverables of the project. By surveying existing projects, including my own project, Newspaper Navigator, I justify the "Collections as ML Data" checklist and demonstrate how the formulated guiding questions can be employed and operationalized.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 91 references that are in the map. First posted on arXiv 6 Jul 2022.
Builds on
18 of 91 references.
References · 18
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
- 2018Model Cards for Model Reportingcited by 1,080
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
- 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 605
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 344
- 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 322
- 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 171
- 2018The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standardscited by 97
6 more
- 2022Interactive Model Cards: A Human-Centered Approach to Model Documentationcited by 61
- 2017A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turkcited by 39
- 2018FactSheets: Increasing Trust in AI Services through Supplier's Declarations of Conformitycited by 31
- 2022System Cards for AI-Based Decision-Making for Public Policycited by 13
- 2019An Algorithmic Equity Toolkit for Technology Audits by Community Advocates and Activistscited by 2
- 2021Comprehensive and Comprehensible Data Catalogs: The What, Who, Where, When, Why, and How of Metadata Managementcited by 2
Built on by
Not cited yet.