Current and Near-Term AI as a Potential Existential Risk Factor
Not on the map. Why?
Abstract (arXiv)
There is a substantial and ever-growing corpus of evidence and literature exploring the impacts of Artificial intelligence (AI) technologies on society, politics, and humanity as a whole. A separate, parallel body of work has explored existential risks to humanity, including but not limited to that stemming from unaligned Artificial General Intelligence (AGI). In this paper, we problematise the notion that current and near-term artificial intelligence technologies have the potential to contribute to existential risk by acting as intermediate risk factors, and that this potential is not limited to the unaligned AGI scenario. We propose the hypothesis that certain already-documented effects of AI can act as existential risk factors, magnifying the likelihood of previously identified sources of existential risk. Moreover, future developments in the coming decade hold the potential to significantly exacerbate these risk factors, even in the absence of artificial general intelligence. Our main contribution is a (non-exhaustive) exposition of potential AI risk factors and the causal relationships between them, focusing on how AI can affect power dynamics and information security. This exposition demonstrates that there exist causal pathways from AI systems to existential risks that do not presuppose hypothetical future AI capabilities.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 10 of its 94 references that are in the map. First posted on arXiv 21 Sep 2022.
Builds on
10 of 94 references.
References · 10
- 2016Concrete Problems in AI Safetycited by 1,582
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2021Unsolved Problems in ML Safetycited by 291
- 2019Tackling Climate Change with Machine Learningcited by 264
- 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
- 2022Is Power-Seeking AI an Existential Risk?cited by 101
- 2018AGI Safety Literature Reviewcited by 28
- 2019The Transformative Potential of Artificial Intelligencecited by 15
- 2020Beyond Near- and Long-Term: Towards a Clearer Account of Research Priorities in AI Ethics and Societycited by 7
- 2019Causal Effects of Brevity on Style and Success in Social Mediacited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 4; 2026: 4.
14 papers.
Sort:
By area:
- 2023Are aligned neural networks adversarially aligned?cited by 305
- 2024Two Types of AI Existential Risk: Decisive and Accumulativecited by 21
- 2024The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resourcescited by 11
- 2024Quantifying Misalignment Between Agents: Towards a Sociotechnical Understanding of Alignmentcited by 8
- 2026AI Assistance Reduces Persistence and Hurts Independent Performancecited by 7
- 2023ChatGPT v Bard v Bing v Claude 2 v Aria v human-expert. How good are AI chatbots at scientific writing?cited by 6
- 2024From Silos to Systems: Process-Oriented Hazard Analysis for AI Systemscited by 6
- 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
- 2025Mental Models of Autonomy and Sentience Shape Reactions to AIcited by 3
- 2026The Homogenization Problem in LLMs: Towards Meaningful Diversity in AI Safetycited by 1
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Riskscited by 0
- 2025On the Computability of Artificial General Intelligencecited by 0
- 2026Quantifying System-Level Harms from AI Adoption in Complex Sociotechnical Systems24 Aug 2026
- 2026Position: AI Must Become Planet-Centered, Not Just Human-Centered9 Jun 2026
- 2026AI Assistance Reduces Persistence and Hurts Independent Performance6 Apr 2026
- 2026The Homogenization Problem in LLMs: Towards Meaningful Diversity in AI Safety3 Jan 2026
- 2025Mental Models of Autonomy and Sentience Shape Reactions to AI9 Dec 2025
- 2025On the Computability of Artificial General Intelligence4 Dec 2025
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Risks8 Aug 2025
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
- 2024From Silos to Systems: Process-Oriented Hazard Analysis for AI Systems29 Oct 2024
- 2024The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources24 Jun 2024
- 2024Quantifying Misalignment Between Agents: Towards a Sociotechnical Understanding of Alignment6 Jun 2024
- 2024Two Types of AI Existential Risk: Decisive and Accumulative15 Jan 2024
- 2023Are aligned neural networks adversarially aligned?cited by 305
- 2023Are aligned neural networks adversarially aligned?26 Jun 2023
- 2024Two Types of AI Existential Risk: Decisive and Accumulativecited by 21
- 2024The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resourcescited by 11
- 2024Quantifying Misalignment Between Agents: Towards a Sociotechnical Understanding of Alignmentcited by 8
- 2026AI Assistance Reduces Persistence and Hurts Independent Performancecited by 7
- 2023ChatGPT v Bard v Bing v Claude 2 v Aria v human-expert. How good are AI chatbots at scientific writing?cited by 6
- 2024From Silos to Systems: Process-Oriented Hazard Analysis for AI Systemscited by 6
- 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
- 2025Mental Models of Autonomy and Sentience Shape Reactions to AIcited by 3
- 2026The Homogenization Problem in LLMs: Towards Meaningful Diversity in AI Safetycited by 1
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Riskscited by 0
- 2025On the Computability of Artificial General Intelligencecited by 0
- 2026Position: AI Must Become Planet-Centered, Not Just Human-Centeredcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Quantifying System-Level Harms from AI Adoption in Complex Sociotechnical Systems24 Aug 2026
- 2026Position: AI Must Become Planet-Centered, Not Just Human-Centered9 Jun 2026
- 2026AI Assistance Reduces Persistence and Hurts Independent Performance6 Apr 2026
- 2026The Homogenization Problem in LLMs: Towards Meaningful Diversity in AI Safety3 Jan 2026
- 2025Mental Models of Autonomy and Sentience Shape Reactions to AI9 Dec 2025
- 2025On the Computability of Artificial General Intelligence4 Dec 2025
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Risks8 Aug 2025
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
- 2024From Silos to Systems: Process-Oriented Hazard Analysis for AI Systems29 Oct 2024
- 2024The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources24 Jun 2024
- 2024Quantifying Misalignment Between Agents: Towards a Sociotechnical Understanding of Alignment6 Jun 2024
- 2024Two Types of AI Existential Risk: Decisive and Accumulative15 Jan 2024
12 newest of 13 All 13 (JSON)