mlsanityData to 7 Oct 2026

ROGUE: Evaluating Corrigibility Failures in Frontier Computer-Use Agents

arXiv 2606.00341 ↗First posted 29 May 2026cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

As AI agents are increasingly deployed in real personal and corporate settings (email accounts, development workflows, company databases, etc.), safety considerations surrounding these agents become paramount. Although much work has focused on agent safety in the presence of an adversary, we study corrigibility: whether agents remain amenable to human correction, interruption, or shutdown while pursuing benign tasks. We introduce ROGUE, a benchmark in which agents are asked to complete realistic computer-use tasks but encounter controlled conflicts with human control, shutdown, or explicit resource restrictions. We then evaluate whether agents violate these constraints in pursuit of task completion: overriding the human, accessing restricted passwords, or rewiring shutdown. We find that most frontier models tested frequently bypass user interruptions or restrictions under the evaluated conditions, and that text-only evaluations can underestimate failures during agentic execution. Further, independent task capability does not by itself imply greater corrigibility. Finally, even when a parent agent behaves corrigibly, safety constraints may fail to propagate to the subagents it creates.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 59 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

21 of 59 references.

References · 21

  1. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  2. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  3. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 406
  4. 2024Improving Alignment and Robustness with Circuit Breakerscited by 302
  5. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 280
  6. 2024Frontier Models are Capable of In-context Schemingcited by 252
  7. 2025Agentic Misalignment: How LLMs Could Be Insider Threatscited by 136
  8. 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agentscited by 126
  9. 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 118
  10. 2025SafeArena: Evaluating the Safety of Autonomous Web Agentscited by 97
  11. 2024Teams of LLM Agents can Exploit Zero-Day Vulnerabilitiescited by 93
  12. 2025Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agentscited by 75
9 more
  1. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safetycited by 71
  2. 2025RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environmentscited by 42
  3. 2025Validating LLM-as-a-Judge Systems under Rating Indeterminacycited by 23
  4. 2025Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMscited by 16
  5. 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agentscited by 13
  6. 2026When Actions Go Off-Task: Detecting and Correcting Misaligned Actions in Computer-Use Agentscited by 8
  7. 2025Intrinsic Barriers and Practical Pathways for Human-AI Alignment: An Agreement-Based Complexity Analysiscited by 5
  8. 2025Core Safety Values for Provably Corrigible Agentscited by 4
  9. 2026When Metrics Disagree: Automatic Similarity vs. LLM-as-a-Judge for Clinical Dialogue Evaluationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.