When AI Fails, What Works? A Data-Driven Taxonomy of Real-World AI Risk Mitigation Strategies
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly embedded in high-stakes workflows, where failures propagate beyond isolated model errors into systemic breakdowns that can lead to legal exposure, reputational damage, and material financial losses. Building on this shift from model-centric risks to end-to-end system vulnerabilities, we analyze real-world AI incident reporting and mitigation actions to derive an empirically grounded taxonomy that links failure dynamics to actionable interventions. Using a unified corpus of 9,705 media-reported AI incident articles, we extract explicit mitigation actions from 6,893 texts via structured prompting and then systematically classify responses to extend MIT's AI Risk Mitigation Taxonomy. Our taxonomy introduces four new mitigation categories, including 1) Corrective and Restrictive Actions, 2) Legal/Regulatory and Enforcement Actions, 3) Financial, Economic, and Market Controls, and 4) Avoidance and Denial, capturing response patterns that are becoming increasingly prevalent as AI deployment and regulation evolve. Quantitatively, we label the mitigation dataset with 32 distinct labels, producing 23,994 label assignments; 9,629 of these reflect previously unseen mitigation patterns, yielding a 67% increase of the original subcategory coverage and substantially enhancing the taxonomy's applicability to emerging systemic failure modes. By structuring incident responses, the paper strengthens "diagnosis-to-prescription" guidance and advances continuous, taxonomy-aligned post-deployment monitoring to prevent cascading incidents and downstream impact.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 41 of its 80 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
41 of 80 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
- 2016Concrete Problems in AI Safetycited by 1,642
- 2018Datasheets for Datasetscited by 1,386
- 2018Model Cards for Model Reportingcited by 1,080
29 more
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
- 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 496
- 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 269
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
- 2023An Overview of Catastrophic AI Riskscited by 222
- 2023MART: Improving LLM Safety with Multi-round Automatic Red-Teamingcited by 163
- 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMscited by 90
- 2023Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategiescited by 85
- 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Modelscited by 80
- 2023Attack Prompt Generation for Red Teaming and Defending Large Language Modelscited by 76
- 2024RigorLLM: Resilient Guardrails for Large Language Models against Undesired Contentcited by 68
- 2024Algorithmic Collusion by Large Language Modelscited by 62
- 2023Privacy Issues in Large Language Models: A Surveycited by 60
- 2024Learning diverse attacks on large language models for robust red-teaming and safety tuningcited by 54
- 2024History, Development, and Principles of Large Language Models-An Introductory Surveycited by 30
- 2025AI-Trader: Benchmarking Autonomous Agents in Real-Time Financial Marketscited by 25
- 2020Bias and Discrimination in AI: a cross-disciplinary perspectivecited by 24
- 2025A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategycited by 20
- 2024A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harmscited by 19
- 2025RSafe: Incentivizing proactive reasoning to build robust and adaptive LLM safeguardscited by 14
- 2023Walking the Walk of AI Ethics: Organizational Challenges and the Individualization of Risk among Ethics Entrepreneurscited by 12
- 2024A Taxonomy of Systemic Risks from General-Purpose AIcited by 12
- 2023Towards Concrete and Connected AI Risk Assessment (C2AIRA): A Systematic Mapping Studycited by 9
- 2023Privacy Preserving Large Language Models: ChatGPT Case Study Based Vision and Frameworkcited by 8
- 2025Text-Diffusion Red-Teaming of Large Language Models: Unveiling Harmful Behaviors with Proximity Constraintscited by 5
- 2025Mapping AI Risk Mitigations: Evidence Scan and Preliminary AI Risk Mitigation Taxonomycited by 3
- 2025Rule Encoding and Compliance in Large Language Models: An Information-Theoretic Analysiscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.