The AI risk repository: A meta-review, database, and taxonomy of risks from artificial intelligence
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Artificial intelligence (AI) is reshaping society, from video generation to medical diagnosis, coding agents to autonomous vehicles. Yet researchers, policymakers, and technology companies lack shared terminology for discussing AI risks. Consider "privacy": one framework uses this term to describe a model's ability to leak sensitive training data, while another uses it to mean freedom from government surveillance. Conversely, researchers have introduced "Goodhart's law," "specification gaming," "reward hacking," and "mesa-optimization" to describe the same phenomenon of AI systems optimizing for measured proxies rather than intended goals. This terminological diversity creates friction: comparing findings across studies requires mapping between frameworks, and comprehensive risk coverage requires consulting multiple taxonomies that use different organizing principles. This paper addresses this challenge by creating a comprehensive catalog of AI risks. We systematically analyzed every major AI risk framework published to date-74 frameworks containing 1,725 distinct risks-and organized them into a unified system. Our two classification systems reveal important patterns: contrary to common assumptions, human decisions cause nearly as many AI risks (38%) as the AI systems themselves (42%). The work provides practical tools for anyone working on AI safety, from developers conducting risk assessments to policymakers writing regulations to auditors evaluating AI systems. By establishing a common reference point, this repository creates the foundation for more coordinated and comprehensive approaches to managing AI's risks while realizing its benefits.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 12 of its 52 references that are in the map. First posted on arXiv 14 Aug 2024.
Builds on
12 of 52 references.
References · 12
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023An Overview of Catastrophic AI Riskscited by 214
- 2023Model evaluation for extreme riskscited by 167
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
- 2024The Ethics of Advanced AI Assistantscited by 103
- 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 91
- 2023Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystemcited by 49
- 2020Open Source Software for Efficient and Transparent Reviewscited by 34
- 2023TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AIcited by 25
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2022The Risks of Machine Learning Systemscited by 5
- 2022Examining the Differential Risk from High-level Artificial Intelligence and the Question of Controlcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 11.
13 papers.
Sort:
By area:
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
- 2026SHE: Trajectory-driven Safety Harness Evolution for LLM Agentscited by 6
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvementcited by 5
- 2024Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systemscited by 2
- 2026The Agent Incident Registry: Toward Preventing Repeated AI Agent Failurescited by 2
- 2026Generative Models Erode Human Temporal Learning Through Market Selectioncited by 0
- 2026The Eticas AI Risk Taxonomy: Open Infrastructure for Operationalizing AI Auditscited by 0
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speechcited by 0
- 2026TrustX Agent Risk Classification Framework (ARC): Risk-Tiering Internally Created Agentic AI Systemscited by 0
- 2026Closing the AI Trust Gap: The Case for Independent Certification for Trustworthy AIcited by 0
- 2026From Legal Text to AI-specific Risk Sources: A Systematic Analysis of the EU AI Act's High-Risk Requirementscited by 0
- 2026Mapping U.S. Federal AI Governance Against Sector Vulnerabilitycited by 0
- 2026An Open Pipeline and Dashboard for Systemic-Risk Evidence under the EU AI Act's Code of Practice23 Sep 2026
- 2026Mapping U.S. Federal AI Governance Against Sector Vulnerability14 Sep 2026
- 2026From Legal Text to AI-specific Risk Sources: A Systematic Analysis of the EU AI Act's High-Risk Requirements11 Sep 2026
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement10 Sep 2026
- 2026The Agent Incident Registry: Toward Preventing Repeated AI Agent Failures10 Sep 2026
- 2026SHE: Trajectory-driven Safety Harness Evolution for LLM Agents10 Aug 2026
- 2026Closing the AI Trust Gap: The Case for Independent Certification for Trustworthy AI17 Jul 2026
- 2026TrustX Agent Risk Classification Framework (ARC): Risk-Tiering Internally Created Agentic AI Systems10 Jul 2026
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speech6 Jul 2026
- 2026The Eticas AI Risk Taxonomy: Open Infrastructure for Operationalizing AI Audits2 Jul 2026
- 2026Generative Models Erode Human Temporal Learning Through Market Selection4 Jun 2026
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb 2025
- 2024Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systemscited by 2
- 2026The Agent Incident Registry: Toward Preventing Repeated AI Agent Failurescited by 2
- 2026Generative Models Erode Human Temporal Learning Through Market Selectioncited by 0
- 2026The Eticas AI Risk Taxonomy: Open Infrastructure for Operationalizing AI Auditscited by 0
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speechcited by 0
- 2026Closing the AI Trust Gap: The Case for Independent Certification for Trustworthy AIcited by 0
- 2026From Legal Text to AI-specific Risk Sources: A Systematic Analysis of the EU AI Act's High-Risk Requirementscited by 0
- 2026Mapping U.S. Federal AI Governance Against Sector Vulnerabilitycited by 0
- 2026An Open Pipeline and Dashboard for Systemic-Risk Evidence under the EU AI Act's Code of Practicecited by 0
- 2026An Open Pipeline and Dashboard for Systemic-Risk Evidence under the EU AI Act's Code of Practice23 Sep 2026
- 2026Mapping U.S. Federal AI Governance Against Sector Vulnerability14 Sep 2026
- 2026From Legal Text to AI-specific Risk Sources: A Systematic Analysis of the EU AI Act's High-Risk Requirements11 Sep 2026
- 2026The Agent Incident Registry: Toward Preventing Repeated AI Agent Failures10 Sep 2026
- 2026Closing the AI Trust Gap: The Case for Independent Certification for Trustworthy AI17 Jul 2026
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speech6 Jul 2026
- 2026The Eticas AI Risk Taxonomy: Open Infrastructure for Operationalizing AI Audits2 Jul 2026
- 2026Generative Models Erode Human Temporal Learning Through Market Selection4 Jun 2026
- 2024Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems30 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2024AI Risk Management Should Incorporate Both Safety and Security
- 2026Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
- 2025The AI Risk Spectrum: From Dangerous Capabilities to Existential Threats
- 2026Measuring Biological Capabilities and Risks of AI Agents
- 2025Free Energy Risk Metrics for Systemically Safe AI: Gatekeeping Multi-Agent Study
- 2025Rethinking Data Protection in the (Generative) Artificial Intelligence Era
- 2026Taxonomy-Driven Analysis of Open-Source AI Risk Mitigation Tools
- 2026The Insurability Frontier of AI Risk: Mapping Threats to Affirmative Coverage, Silent Exposures, and Exclusions