Reducing Catastrophic Risk from AI with Systematic Monitoring and Evaluation of Rogue AI Progression
Not on the map. Why?
Abstract (arXiv)
This article presents a structured framework of behavioral indicators that may signal progression toward potentially catastrophic threats from artificial intelligence systems. We adopt a pragmatic approach, inspired by established methodologies in cybersecurity and national security. By establishing clear metrics, indicators, and thresholds across multiple dimensions of AI capability and behavior, this framework enables researchers and policymakers to implement evidence-based monitoring protocols.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 14 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
7 of 14 references.
References · 7
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
- 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goalscited by 126
- 2025Subliminal Learning: Language models transmit behavioral traits via hidden signals in datacited by 95
- 2025Demonstrating specification gaming in reasoning modelscited by 56
- 2024LLM Agent Honeypot: Monitoring AI Hacking Agents in the Wildcited by 12
Built on by
Not cited yet.