Evaluating whether AI models would sabotage AI safety research
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
We evaluate the propensity of frontier models to sabotage or refuse to assist with safety research when deployed as AI research agents within a frontier AI company. We apply two complementary evaluations to four Claude models (Mythos Preview, Opus 4.7 Preview, Opus 4.6, and Sonnet 4.6): an unprompted sabotage evaluation testing model behaviour with opportunities to sabotage safety research, and a sabotage continuation evaluation testing whether models continue to sabotage when placed in trajectories where prior actions have started undermining research. We find no instances of unprompted sabotage across any model, with refusal rates close to zero for Mythos Preview and Opus 4.7 Preview, though all models sometimes only partially completed tasks. In the continuation evaluation, Mythos Preview actively continues sabotage in 7% of cases (versus 3% for Opus 4.6, 4% for Sonnet 4.6, and 0% for Opus 4.7 Preview), and exhibits reasoning-output discrepancy in the majority of these cases, indicating covert sabotage reasoning. Our evaluation framework builds on Petri, an open-source LLM auditing tool, with a custom scaffold running models inside Claude Code, alongside an iterative pipeline for generating realistic sabotage trajectories. We measure both evaluation awareness and a new form of situational awareness termed "prefill awareness", the capability to recognise that prior trajectory content was not self-generated. Opus 4.7 Preview shows notably elevated unprompted evaluation awareness, while prefill awareness remains low across all models. Finally, we discuss limitations including evaluation awareness confounds, limited scenario coverage, and untested pathways to risk beyond safety research sabotage.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. First posted on arXiv 27 Apr 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Gram: Assessing sabotage propensities via automated alignment auditingcited by 3
- 2026Realistic honeypot evaluations for scheming propensitycited by 0
- 2026EvalDetectBench: A Benchmark for Measuring Evaluation Awareness in Frontier Language Modelscited by 0
- 2026Improving Evaluation Realism with Inference-Time Compute and Deployment Scaffoldscited by 0
- 2026AI Persuasion as a Threat to Human Controlcited by 0
- 2026TraceDance: An Automated System for Building Agent Behavior Benchmarks from Real-World Agent Deployment Tracescited by 0
- 2026Deception by Omission: Language Models Knowingly Hide Their Mistakescited by 0
- 2026Deception by Omission: Language Models Knowingly Hide Their Mistakes8 Oct 2026
- 2026TraceDance: An Automated System for Building Agent Behavior Benchmarks from Real-World Agent Deployment Traces27 Sep 2026
- 2026AI Persuasion as a Threat to Human Control13 Sep 2026
- 2026Improving Evaluation Realism with Inference-Time Compute and Deployment Scaffolds2 Sep 2026
- 2026EvalDetectBench: A Benchmark for Measuring Evaluation Awareness in Frontier Language Models8 Jun 2026
- 2026Gram: Assessing sabotage propensities via automated alignment auditing28 May 2026
- 2026Realistic honeypot evaluations for scheming propensity28 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D
- 2026UK AISI Alignment Evaluation Case-Study
- 2026Evading Chain-of-Thought Monitoring Through Model Poisoning
- 2026Reasoning Consistency Scanning: A Framework for Auditing Chain-of-Thought Validity in AI Safety Evaluations
- 2026Boiling the Frog: A Multi-Turn Benchmark for Agentic Safety
- 2025When Chain of Thought is Necessary, Language Models Struggle to Evade Monitors
- 2025Evaluating Frontier Models for Stealth and Situational Awareness
- 2025Evaluation Faking: Unveiling Observer Effects in Safety Evaluation of Frontier AI Systems