TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI
Not on the map. Why?
Abstract (arXiv)
While several recent works have identified societal-scale and extinction-level risks to humanity arising from artificial intelligence, few have attempted an em exhaustive taxonomy of such risks. Many exhaustive taxonomies are possible, and some are useful -- particularly if they reveal new risks or practical approaches to safety. This paper explores a taxonomy based on accountability: whose actions lead to the risk, are the actors unified, and are they deliberate? We also provide stories to illustrate how the various risk types could each play out, including risks arising from unanticipated interactions of many AI systems, as well as risks from deliberate misuse, for which combined technical and policy solutions are indicated.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 13 of its 64 references that are in the map. First posted on arXiv 12 Jun 2023.
Builds on
13 of 64 references.
References · 13
- 2016Concrete Problems in AI Safetycited by 1,642
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
- 2016Cooperative Inverse Reinforcement Learningcited by 300
- 2013The Complexity of Decentralized Control of Markov Decision Processescited by 231
- 2019Conservative Agency via Attainable Utility Preservationcited by 35
- 2019Preferences Implicit in the State of the Worldcited by 34
- 2019Learning Gentle Object Manipulation with Curiosity-Driven Deep Reinforcement Learningcited by 26
- 2019Literal or Pedagogic Human? Analyzing Human Model Misspecification in Objective Learningcited by 15
- 2017Low Impact Artificial Intelligencescited by 11
- 2017Incorrigibility in the CIRL Frameworkcited by 9
- 2015Taxonomy of Pathways to Dangerous AIcited by 4
- 2017Servant of Many Masters: Shifting priorities in Pareto-optimal sequential decision-makingcited by 2
Built on by
Citing papers per year: 2023: 5; 2024: 8; 2025: 9; 2026: 4.
26 papers.
Sort:
By area:
- 2023Can LLM-Generated Misinformation Be Detected?cited by 177
- 2023Taken out of context: On measuring situational awareness in LLMscited by 143
- 2024Visibility into AI Agentscited by 79
- 2024Sabotage Evaluations for Frontier Modelscited by 52
- 2023From task structures to world models: What do LLMs know?cited by 46
- 2024A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harmscited by 19
- 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generatorscited by 18
- 2024The AI risk repository: A meta-review, database, and taxonomy of risks from artificial intelligencecited by 16
- 2023An International Consortium for Evaluations of Societal-Scale Risks from Advanced AIcited by 5
- 2025A Framework for Responsible AI Systems: Building Societal Trust through Domain Definition, Trustworthy AI Design, Auditability, Accountability, and Governancecited by 5
- 2024Avoiding Catastrophe in Online Learning by Asking for Helpcited by 4
- 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
14 more
- 2026Overview of Risk Assessment and Management for Intelligent Systems under the AI Act and Beyondcited by 4
- 2024Strategic Insights from Simulation Gaming of AI Race Dynamicscited by 3
- 2025TechOps: Technical Documentation Templates for the AI Actcited by 3
- 2026AI Finds A Waycited by 3
- 2025The Economics of p(doom): Scenarios of Existential Risk and Economic Growth in the Age of Transformative AIcited by 2
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic riskscited by 2
- 2023General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Societal Implications and Responsible Governancecited by 1
- 2024Taxonomy to Regulation: A (Geo)Political Taxonomy for AI Risks and Regulatory Measures in the EU AI Actcited by 1
- 2025Safe Learning Under Irreversible Dynamics via Asking for Helpcited by 1
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Riskscited by 1
- 2025A Taxonomy of Omnicidal Futures Involving Artificial Intelligencecited by 0
- 2025AI Consciousness and Existential Riskcited by 0
- 2026Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problemcited by 0
- 2026Culturally Situated AI Safety for Youth: Saudi Arabian Perspectives of Youth, Parents and Teacherscited by 0
- 2026AI Finds A Way24 Aug 2026
- 2026Overview of Risk Assessment and Management for Intelligent Systems under the AI Act and Beyond2 Jul 2026
- 2026Culturally Situated AI Safety for Youth: Saudi Arabian Perspectives of Youth, Parents and Teachers29 Apr 2026
- 2026Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problem22 Apr 2026
- 2025AI Consciousness and Existential Risk24 Nov 2025
- 2025TechOps: Technical Documentation Templates for the AI Act12 Aug 2025
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Risks8 Aug 2025
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic risks29 Jul 2025
- 2025A Taxonomy of Omnicidal Futures Involving Artificial Intelligence12 Jul 2025
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
- 2025The Economics of p(doom): Scenarios of Existential Risk and Economic Growth in the Age of Transformative AI10 Mar 2025
- 2025Safe Learning Under Irreversible Dynamics via Asking for Help19 Feb 2025
14 more
- 2025A Framework for Responsible AI Systems: Building Societal Trust through Domain Definition, Trustworthy AI Design, Auditability, Accountability, and Governance4 Feb 2025
- 2024Sabotage Evaluations for Frontier Models28 Oct 2024
- 2024Strategic Insights from Simulation Gaming of AI Race Dynamics4 Oct 2024
- 2024The AI risk repository: A meta-review, database, and taxonomy of risks from artificial intelligence14 Aug 2024
- 2024A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms1 Jul 2024
- 2024Taxonomy to Regulation: A (Geo)Political Taxonomy for AI Risks and Regulatory Measures in the EU AI Act17 Apr 2024
- 2024Avoiding Catastrophe in Online Learning by Asking for Help12 Feb 2024
- 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators25 Jan 2024
- 2024Visibility into AI Agents23 Jan 2024
- 2023An International Consortium for Evaluations of Societal-Scale Risks from Advanced AI22 Oct 2023
- 2023From task structures to world models: What do LLMs know?6 Oct 2023
- 2023Can LLM-Generated Misinformation Be Detected?25 Sep 2023
- 2023Taken out of context: On measuring situational awareness in LLMs1 Sep 2023
- 2023General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Societal Implications and Responsible Governance26 Jul 2023
- 2023From task structures to world models: What do LLMs know?cited by 46
- 2023From task structures to world models: What do LLMs know?6 Oct 2023
- 2023Can LLM-Generated Misinformation Be Detected?cited by 177
- 2023Taken out of context: On measuring situational awareness in LLMscited by 143
- 2024Visibility into AI Agentscited by 79
- 2024Sabotage Evaluations for Frontier Modelscited by 52
- 2024A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harmscited by 19
- 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generatorscited by 18
- 2023An International Consortium for Evaluations of Societal-Scale Risks from Advanced AIcited by 5
- 2025A Framework for Responsible AI Systems: Building Societal Trust through Domain Definition, Trustworthy AI Design, Auditability, Accountability, and Governancecited by 5
- 2024Avoiding Catastrophe in Online Learning by Asking for Helpcited by 4
- 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
- 2026Overview of Risk Assessment and Management for Intelligent Systems under the AI Act and Beyondcited by 4
- 2024Strategic Insights from Simulation Gaming of AI Race Dynamicscited by 3
12 most cited of 24 All 24 (JSON)
- 2026AI Finds A Way24 Aug 2026
- 2026Overview of Risk Assessment and Management for Intelligent Systems under the AI Act and Beyond2 Jul 2026
- 2026Culturally Situated AI Safety for Youth: Saudi Arabian Perspectives of Youth, Parents and Teachers29 Apr 2026
- 2026Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problem22 Apr 2026
- 2025AI Consciousness and Existential Risk24 Nov 2025
- 2025TechOps: Technical Documentation Templates for the AI Act12 Aug 2025
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Risks8 Aug 2025
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic risks29 Jul 2025
- 2025A Taxonomy of Omnicidal Futures Involving Artificial Intelligence12 Jul 2025
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
- 2025The Economics of p(doom): Scenarios of Existential Risk and Economic Growth in the Age of Transformative AI10 Mar 2025
- 2025Safe Learning Under Irreversible Dynamics via Asking for Help19 Feb 2025
12 newest of 24 All 24 (JSON)