mlsanityData to 7 Oct 2026

The AI Incident Database as an Educational Tool to Raise Awareness of AI Harms: A Classroom Exploration of Efficacy, Limitations, & Future Improvements

arXiv 2310.06269 ↗First posted 10 Oct 2023cs.CY cs.AI cs.HCcited by 8

Not on the map. Why?

Abstract (arXiv)

Prior work has established the importance of integrating AI ethics topics into computer and data sciences curricula. We provide evidence suggesting that one of the critical objectives of AI Ethics education must be to raise awareness of AI harms. While there are various sources to learn about such harms, The AI Incident Database (AIID) is one of the few attempts at offering a relatively comprehensive database indexing prior instances of harms or near harms stemming from the deployment of AI technologies in the real world. This study assesses the effectiveness of AIID as an educational tool to raise awareness regarding the prevalence and severity of AI harms in socially high-stakes domains. We present findings obtained through a classroom study conducted at an R1 institution as part of a course focused on the societal and ethical considerations around AI and ML. Our qualitative findings characterize students' initial perceptions of core topics in AI ethics and their desire to close the educational gap between their technical skills and their ability to think systematically about ethical and societal aspects of their work. We find that interacting with the database helps students better understand the magnitude and severity of AI harms and instills in them a sense of urgency around (a) designing functional and safe AI and (b) strengthening governance and accountability mechanisms. Finally, we compile students' feedback about the tool and our class activity into actionable recommendations for the database development team and the broader community to improve awareness of AI harms in AI ethics education.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 16 of its 101 references that are in the map. First posted on arXiv 10 Oct 2023.

Builds on

16 of 101 references.

References · 16

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  3. 2018Datasheets for Datasetscited by 1,371
  4. 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
  5. 2020Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Databasecited by 95
  6. 2022The Fallacy of AI Functionalitycited by 88
  7. 2022How Different Groups Prioritize Ethical Values for Responsible AIcited by 49
  8. 2020Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberationcited by 24
  9. 2020Overcoming Failures of Imagination in AI Infused System Development and Deploymentcited by 22
  10. 2022REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Researchcited by 20
  11. 2022An Algorithmic Framework for Bias Bountiescited by 19
  12. 2022Four Years of FAccT: A Reflexive, Mixed-Methods Analysis of Research Contributions, Shortcomings, and Future Prospectscited by 14
4 more
  1. 2022AI Ethics Issues in Real World: Evidence from AI Incident Databasecited by 14
  2. 2022Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data Sciencecited by 13
  3. 2018Embedded EthiCS: Integrating Ethics Broadly Across Computer Science Educationcited by 5
  4. 2021Reproducibility as a Mechanism for Teaching Fairness, Accountability, Confidentiality, and Transparency in Artificial Intelligencecited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 3; 2026: 2.

8 papers.