mlsanityData to 7 Oct 2026

Data Readiness for AI: A 360-Degree Survey

arXiv 2404.05779 ↗First posted 8 Apr 2024cs.LG cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

Artificial Intelligence (AI) applications critically depend on data. Poor quality data produces inaccurate and ineffective AI models that may lead to incorrect or unsafe use. Evaluation of data readiness is a crucial step in improving the quality and appropriateness of data usage for AI. R&D efforts have been spent on improving data quality. However, standardized metrics for evaluating data readiness for use in AI training are still evolving. In this study, we perform a comprehensive survey of metrics used to verify data readiness for AI training. This survey examines more than 140 papers published by ACM Digital Library, IEEE Xplore, journals such as Nature, Springer, and Science Direct, and online articles published by prominent AI experts. This survey aims to propose a taxonomy of data readiness for AI (DRAI) metrics for structured and unstructured datasets. We anticipate that this taxonomy will lead to new standards for DRAI metrics that will be used for enhancing the quality, accuracy, and fairness of AI training and inference.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 25 of its 164 references that are in the map. First posted on arXiv 8 Apr 2024.

Builds on

25 of 164 references.

References · 25

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  2. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  3. 2018Datasheets for Datasetscited by 1,371
  4. 2018Model Cards for Model Reportingcited by 1,068
  5. 2014Certifying and removing disparate impactcited by 715
  6. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  7. 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
  8. 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 273
  9. 2013Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Indexcited by 193
  10. 2022The Privacy Onion Effect: Memorization is Relativecited by 128
  11. 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 126
  12. 2018The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standardscited by 97
13 more
  1. 2017Practical Coreset Constructions for Machine Learningcited by 75
  2. 2016Feature Selection: A Data Perspectivecited by 50
  3. 2019An ADMM Based Framework for AutoML Pipeline Configurationcited by 47
  4. 2022Representation Bias in Data: A Survey on Identification and Resolution Techniquescited by 37
  5. 2017Anomaly Detection by Robust Statisticscited by 22
  6. 2021Data Quality Toolkit: Automatic assessment of data quality and remediation for machine learning datasetscited by 18
  7. 2020Data Readiness Reportcited by 17
  8. 2022Optimal Ratio for Data Splittingcited by 17
  9. 2017Data Readiness Levelscited by 12
  10. 2015Technical Privacy Metrics: a Systematic Surveycited by 11
  11. 2019Bayes Imbalance Impact Index: A Measure of Class Imbalanced Dataset for Classification Problemcited by 10
  12. 2021SHAPr: An Efficient and Versatile Membership Privacy Risk Metric for Machine Learningcited by 10
  13. 2022FAIR principles for AI models with a practical application for accelerated high energy diffraction microscopycited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 7; 2026: 6.

15 papers.

Sort:

By area: