mlsanityData to 7 Oct 2026

The AI risk repository: A meta-review, database, and taxonomy of risks from artificial intelligence

arXiv 2408.12622 ↗First posted 14 Aug 2024cs.AI cs.CR cs.ETcited by 13

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Artificial intelligence (AI) is reshaping society, from video generation to medical diagnosis, coding agents to autonomous vehicles. Yet researchers, policymakers, and technology companies lack shared terminology for discussing AI risks. Consider "privacy": one framework uses this term to describe a model's ability to leak sensitive training data, while another uses it to mean freedom from government surveillance. Conversely, researchers have introduced "Goodhart's law," "specification gaming," "reward hacking," and "mesa-optimization" to describe the same phenomenon of AI systems optimizing for measured proxies rather than intended goals. This terminological diversity creates friction: comparing findings across studies requires mapping between frameworks, and comprehensive risk coverage requires consulting multiple taxonomies that use different organizing principles. This paper addresses this challenge by creating a comprehensive catalog of AI risks. We systematically analyzed every major AI risk framework published to date-74 frameworks containing 1,725 distinct risks-and organized them into a unified system. Our two classification systems reveal important patterns: contrary to common assumptions, human decisions cause nearly as many AI risks (38%) as the AI systems themselves (42%). The work provides practical tools for anyone working on AI safety, from developers conducting risk assessments to policymakers writing regulations to auditors evaluating AI systems. By establishing a common reference point, this repository creates the foundation for more coordinated and comprehensive approaches to managing AI's risks while realizing its benefits.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 12 of its 52 references that are in the map. First posted on arXiv 14 Aug 2024.

Builds on

12 of 52 references.

References · 12

  1. 2021Ethical and social risks of harm from Language Modelscited by 957
  2. 2023An Overview of Catastrophic AI Riskscited by 214
  3. 2023Model evaluation for extreme riskscited by 167
  4. 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
  5. 2024The Ethics of Advanced AI Assistantscited by 103
  6. 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 91
  7. 2023Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystemcited by 49
  8. 2020Open Source Software for Efficient and Transparent Reviewscited by 34
  9. 2023TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AIcited by 25
  10. 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
  11. 2022The Risks of Machine Learning Systemscited by 5
  12. 2022Examining the Differential Risk from High-level Artificial Intelligence and the Question of Controlcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 11.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024AI Risk Management Should Incorporate Both Safety and Security
  2. 2026Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
  3. 2025The AI Risk Spectrum: From Dangerous Capabilities to Existential Threats
  4. 2026Measuring Biological Capabilities and Risks of AI Agents
  5. 2025Free Energy Risk Metrics for Systemically Safe AI: Gatekeeping Multi-Agent Study
  6. 2025Rethinking Data Protection in the (Generative) Artificial Intelligence Era
  7. 2026Taxonomy-Driven Analysis of Open-Source AI Risk Mitigation Tools
  8. 2026The Insurability Frontier of AI Risk: Mapping Threats to Affirmative Coverage, Silent Exposures, and Exclusions