mlsanityData to 7 Oct 2026

Model Reporting for Certifiable AI: A Proposal from Merging EU Regulation into AI Development

arXiv 2307.11525 ↗First posted 21 Jul 2023cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Despite large progress in Explainable and Safe AI, practitioners suffer from a lack of regulation and standards for AI safety. In this work we merge recent regulation efforts by the European Union and first proposals for AI guidelines with recent trends in research: data and model cards. We propose the use of standardized cards to document AI applications throughout the development process. Our main contribution is the introduction of use-case and operation cards, along with updates for data and model cards to cope with regulatory requirements. We reference both recent research as well as the source of the regulation in our cards and provide references to additional support material and toolboxes whenever possible. The goal is to design cards that help practitioners develop safe AI systems throughout the development process, while enabling efficient third-party auditing of AI applications, being easy to understand, and building trust in the system. Our work incorporates insights from interviews with certification experts as well as developers and individuals working with the developed AI applications.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 42 of its 119 references that are in the map. First posted on arXiv 21 Jul 2023.

Builds on

42 of 119 references.

References · 42

  1. 2013Intriguing properties of neural networkscited by 5,114
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  3. 2017On Calibration of Modern Neural Networkscited by 4,860
  4. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  5. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  6. 2018Model Cards for Model Reportingcited by 1,068
  7. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 669
  8. 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 519
  9. 2019Does Learning Require Memorization? A Short Tale about a Long Tailcited by 452
  10. 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 388
  11. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
  12. 2018AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Biascited by 319
30 more
  1. 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
  2. 2020A Survey on the Explainability of Supervised Machine Learningcited by 225
  3. 2019Machine Learning Testing: Survey, Landscapes and Horizonscited by 213
  4. 2022Why do tree-based models still outperform deep learning on tabular data?cited by 198
  5. 2021Accounting for Variance in Machine Learning Benchmarkscited by 195
  6. 2020Fairness in Machine Learningcited by 194
  7. 2020On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practicecited by 181
  8. 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 169
  9. 2018Model Evaluation, Model Selection, and Algorithm Selection in Machine Learningcited by 157
  10. 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
  11. 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
  12. 2020Characterizing Structural Regularities of Labeled Data in Overparameterized Modelscited by 93
  13. 2022DataPerf: Benchmarks for Data-Centric AI Developmentcited by 89
  14. 2021The Shape of Learning Curves: a Reviewcited by 67
  15. 2020ML Privacy Meter: Aiding Regulatory Compliance by Quantifying the Privacy Risks of Machine Learningcited by 66
  16. 2022Leakage and the Reproducibility Crisis in ML-based Sciencecited by 63
  17. 2018On Testing Machine Learning Programscited by 48
  18. 2019Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challengescited by 39
  19. 2020An Overview of Privacy in Machine Learningcited by 39
  20. 2018Model Selection Techniques -- An Overviewcited by 36
  21. 2021Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond)cited by 35
  22. 2021How to avoid machine learning pitfalls: a guide for academic researcherscited by 34
  23. 2017An Analysis of ISO 26262: Using Machine Learning Safely in Automotive Softwarecited by 26
  24. 2022Measuring Datacited by 18
  25. 2022Optimal Ratio for Data Splittingcited by 17
  26. 2021Trusted Artificial Intelligence: Towards Certification of Machine Learning Applicationscited by 13
  27. 2020Insights into Performance Fitness and Error Metrics for Machine Learningcited by 12
  28. 2022Using sensitive data to prevent discrimination by artificial intelligence: Does the GDPR need a new exception?cited by 7
  29. 2022Never trust, always verify : a roadmap for Trustworthy AI?cited by 4
  30. 2022Quantitative AI Risk Assessments: Opportunities and Challengescited by 4

Built on by

Cited by year

Citing papers per year: 2024: 5; 2025: 1.

6 papers.

  1. 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52
  2. 2024How should AI decisions be explained? Requirements for Explanations from the Perspective of European Lawcited by 10
  3. 2024Rethinking Software Engineering in the Foundation Model Era: A Curated Catalogue of Challenges in the Development of Trustworthy FMwarecited by 6
  4. 2024Compliance Cards: Automated EU AI Act Compliance Analyses amidst a Complex AI Supply Chaincited by 3
  5. 2024The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysiscited by 2
  6. 2025The Hitchhikers Guide to Production-ready Trustworthy Foundation Model powered Software (FMware)cited by 0