The Dataset Nutrition Label (2nd Gen): Leveraging Context to Mitigate Harms in Artificial Intelligence
Not on the map. Why?
Abstract (arXiv)
As the production of and reliance on datasets to produce automated decision-making systems (ADS) increases, so does the need for processes for evaluating and interrogating the underlying data. After launching the Dataset Nutrition Label in 2018, the Data Nutrition Project has made significant updates to the design and purpose of the Label, and is launching an updated Label in late 2020, which is previewed in this paper. The new Label includes context-specific Use Cases &Alerts presented through an updated design and user interface targeted towards the data scientist profile. This paper discusses the harm and bias from underlying training data that the Label is intended to mitigate, the current state of the work including new datasets being labeled, new and existing challenges, and further directions of the work, as well as Figures previewing the new label.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 9 of its 24 references that are in the map. First posted on arXiv 10 Jan 2022.
Builds on
9 of 24 references.
References · 9
- 2018Datasheets for Datasetscited by 1,371
- 2018Model Cards for Model Reportingcited by 1,068
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2019Explainability Fact Sheets: A Framework for Systematic Assessment of Explainable Approachescited by 101
- 2018The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standardscited by 97
- 2019ABOUT ML: Annotation and Benchmarking on Understanding and Transparency of Machine Learning Lifecyclescited by 13
- 2018A Nutritional Label for Rankingscited by 10
- 2019Talking datasets: Understanding data sensemaking behaviourscited by 7
Built on by
Citing papers per year: 2022: 6; 2023: 5; 2024: 9; 2025: 5; 2026: 1.
26 papers.
Sort:
- 2022CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotationcited by 59
- 2022Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desideratacited by 28
- 2024Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on Hugging Facecited by 27
- 2023Use case cards: a use case reporting framework inspired by the European AI Actcited by 14
- 2024What's documented in AI? Systematic Analysis of 32K AI Model Cardscited by 10
- 2024Benchmark Data Repositories for Better Benchmarkingcited by 10
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparencycited by 7
- 2023Open Datasheets: Machine-readable Documentation for Open Datasets and Responsible AI Assessmentscited by 7
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AIcited by 5
- 2023Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Educationcited by 5
- 2024Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Representcited by 5
- 2024Building Better Datasets: Seven Recommendations for Responsible Design from Dataset Creatorscited by 5
14 more
- 2022Evaluating a Methodology for Increasing AI Transparency: A Case Studycited by 3
- 2024Compliance Cards: Automated EU AI Act Compliance Analyses amidst a Complex AI Supply Chaincited by 3
- 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
- 2025TechOps: Technical Documentation Templates for the AI Actcited by 2
- 2022Sharing and Caring: Creating a Culture of Constructive Criticism in Computational Legal Studiescited by 1
- 2022Documenting use cases in the affective computing domain using Unified Modeling Languagecited by 1
- 2023Datasheets for Machine Learning Sensorscited by 1
- 2024Uncertain Boundaries: Multidisciplinary Approaches to Copyright Issues in Generative AIcited by 1
- 2025A Scoresheet for Explainable AIcited by 1
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Toolscited by 1
- 2024Documentation Practices of Artificial Intelligencecited by 0
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentationcited by 0
- 2025A case for data valuation transparency via DValCardscited by 0
- 2025Standards in the Preparation of Biomedical Research Metadata: A Bridge2AI Perspectivecited by 0
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Tools17 Feb 2026
- 2025Standards in the Preparation of Biomedical Research Metadata: A Bridge2AI Perspective12 Sep 2025
- 2025TechOps: Technical Documentation Templates for the AI Act12 Aug 2025
- 2025A case for data valuation transparency via DValCards29 Jun 2025
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentation23 May 2025
- 2025A Scoresheet for Explainable AI14 Feb 2025
- 2024Benchmark Data Repositories for Better Benchmarking31 Oct 2024
- 2024Building Better Datasets: Seven Recommendations for Responsible Design from Dataset Creators30 Aug 2024
- 2024Documentation Practices of Artificial Intelligence26 Jun 2024
- 2024Compliance Cards: Automated EU AI Act Compliance Analyses amidst a Complex AI Supply Chain20 Jun 2024
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent10 Apr 2024
14 more
- 2024Uncertain Boundaries: Multidisciplinary Approaches to Copyright Issues in Generative AI31 Mar 2024
- 2024What's documented in AI? Systematic Analysis of 32K AI Model Cards7 Feb 2024
- 2024Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on Hugging Face24 Jan 2024
- 2023Open Datasheets: Machine-readable Documentation for Open Datasets and Responsible AI Assessments11 Dec 2023
- 2023Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Education9 Nov 2023
- 2023Use case cards: a use case reporting framework inspired by the European AI Act23 Jun 2023
- 2023Datasheets for Machine Learning Sensors15 Jun 2023
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AI10 Feb 2023
- 2022Documenting use cases in the affective computing domain using Unified Modeling Language19 Sep 2022
- 2022CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation9 Jun 2022
- 2022Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desiderata6 Jun 2022
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparency27 Apr 2022
- 2022Sharing and Caring: Creating a Culture of Constructive Criticism in Computational Legal Studies19 Apr 2022
- 2022Evaluating a Methodology for Increasing AI Transparency: A Case Study24 Jan 2022
- 2022CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotationcited by 59
- 2022Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desideratacited by 28
- 2024Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on Hugging Facecited by 27
- 2023Use case cards: a use case reporting framework inspired by the European AI Actcited by 14
- 2024What's documented in AI? Systematic Analysis of 32K AI Model Cardscited by 10
- 2024Benchmark Data Repositories for Better Benchmarkingcited by 10
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparencycited by 7
- 2023Open Datasheets: Machine-readable Documentation for Open Datasets and Responsible AI Assessmentscited by 7
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AIcited by 5
- 2023Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Educationcited by 5
- 2024Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Representcited by 5
- 2024Building Better Datasets: Seven Recommendations for Responsible Design from Dataset Creatorscited by 5
12 most cited of 26 All 26 (JSON)
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Tools17 Feb 2026
- 2025Standards in the Preparation of Biomedical Research Metadata: A Bridge2AI Perspective12 Sep 2025
- 2025TechOps: Technical Documentation Templates for the AI Act12 Aug 2025
- 2025A case for data valuation transparency via DValCards29 Jun 2025
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentation23 May 2025
- 2025A Scoresheet for Explainable AI14 Feb 2025
- 2024Benchmark Data Repositories for Better Benchmarking31 Oct 2024
- 2024Building Better Datasets: Seven Recommendations for Responsible Design from Dataset Creators30 Aug 2024
- 2024Documentation Practices of Artificial Intelligence26 Jun 2024
- 2024Compliance Cards: Automated EU AI Act Compliance Analyses amidst a Complex AI Supply Chain20 Jun 2024
- 2024A Taxonomy of Challenges to Curating Fair Datasets10 Jun 2024
- 2024Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent10 Apr 2024
12 newest of 26 All 26 (JSON)