Agent-Supported Foresight for AI Systemic Risks: AI Agents for Breadth, Experts for Judgment
Not on the map. Why?
Abstract (arXiv)
AI impact assessments often stress near-term risks because human judgment degrades over longer horizons, exemplifying the Collingridge dilemma: foresight is most needed when knowledge is scarcest. To address long-term systemic risks, we introduce a scalable approach that simulates in-silico agents using the strategic foresight method of the Futures Wheel. We applied it to four AI uses spanning Technology Readiness Levels (TRLs): Chatbot Companion (TRL 9, mature), AI Toy (TRL 7, medium), Griefbot (TRL 5, low), and Death App (TRL 2, conceptual). Across 30 agent runs per use, agents produced 86-110 consequences, condensed into 27-47 unique risks. To benchmark the agent outputs against human perspectives, we collected evaluations from 290 domain experts and 7 leaders, and conducted Futures Wheel sessions with 42 experts and 42 laypeople. Agents generated many systemic consequences across runs. Compared with these outputs, experts identified fewer risks, typically less systemic but judged more likely, whereas laypeople surfaced more emotionally salient concerns that were generally less systemic. We propose a hybrid foresight workflow, wherein agents broaden systemic coverage, and humans provide contextual grounding. Our dataset is available at: https://social-dynamics.net/ai-risks/foresight.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 119 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
29 of 119 references.
References · 29
- 2023An Overview of Catastrophic AI Riskscited by 214
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 165
- 2023An Empirical Study of the Non-determinism of ChatGPT in Code Generationcited by 134
- 2024The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismcited by 113
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 61
- 2024AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policiescited by 34
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2024A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harmscited by 19
- 2024Plurals: A System for Guiding LLMs Via Simulated Social Ensemblescited by 17
- 2024PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideationcited by 16
17 more
- 2023Algorithmic Pluralism: A Structural Approach To Equal Opportunitycited by 13
- 2024ExploreGen: Large Language Models for Envisioning the Uses and Risks of AI Technologiescited by 12
- 2024A Taxonomy of Systemic Risks from General-Purpose AIcited by 12
- 2022The Algorithmic Imprintcited by 10
- 2024Guidelines for Integrating Value Sensitive Design in Responsible AI Toolkitscited by 10
- 2024Risk and Response in Large Language Models: Evaluating Key Threat Categoriescited by 10
- 2024Co-designing an AI Impact Assessment Report Template with AI Practitioners and AI Compliance Expertscited by 10
- 2025RiskRAG: A Data-Driven Solution for Improved AI Model Risk Reportingcited by 9
- 2022Actionable Guidance for High-Consequence AI Risk Management: Towards Standards Addressing AI Catastrophic Riskscited by 7
- 2025AI Risk Atlas: Taxonomy and Tooling for Navigating AI Risks and Resourcescited by 7
- 2024BLIP: Facilitating the Exploration of Undesirable Consequences of Digital Technologiescited by 6
- 2025The Science Fiction Science Methodcited by 4
- 2025Digital Dybbuks and Virtual Golems: The Ethics of Digital Duplicates in Holocaust Testimonycited by 3
- 2024Good Intentions, Risky Inventions: A Method for Assessing the Risks and Benefits of AI in Mobile and Wearable Usescited by 2
- 2025Let's Talk Futures: A Literature Review of HCI's Future-Orientationcited by 2
- 2025From Prediction to Foresight: The Role of AI in Designing Responsible Futurescited by 2
- 2022DiRaC-I: Identifying Diverse and Rare Training Classes for Zero-Shot Learningcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.