The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Computer-use agents (CUAs) can now autonomously complete complex tasks in real digital environments, but when misled, they can also be used to automate harmful actions programmatically. Existing safety evaluations largely target explicit threats such as misuse and prompt injection, but overlook a subtle yet critical setting where user instructions are entirely benign and harm arises from the task context or execution outcome. We introduce OS-BLIND, a benchmark that evaluates CUAs under unintended attack conditions, comprising 300 human-crafted tasks across 12 categories, 8 applications, and 2 threat clusters: environment-embedded threats and agent-initiated harms. Our evaluation on frontier models and agentic frameworks reveals that most CUAs exceed 90% attack success rate (ASR), and even the safety-aligned Claude 4.5 Sonnet reaches 73.0% ASR. More interestingly, this vulnerability becomes even more severe, with ASR rising from 73.0% to 92.7% when Claude 4.5 Sonnet is deployed in multi-agent systems. Our analysis further shows that existing safety defenses provide limited protection when user instructions are benign. Safety alignment primarily activates within the first few steps and rarely re-engages during subsequent execution. In multi-agent systems, decomposed subtasks obscure the harmful intent from the model, causing safety-aligned models to fail. We will release our OS-BLIND to encourage the broader research community to further investigate and address these safety challenges.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 53 of its 64 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
53 of 64 references.
Closest ancestors · 21
Same direction, newest first
- 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agents9 Feb
- 2026MirrorGuard: Toward Secure Computer-Use Agents via Simulation-to-Real Reasoning Correction19 Jan
- 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents29 Dec
- 2025OS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflows28 Oct
- 2025Just Do It!? Computer-Use Agents Exhibit Blind Goal-Directedness2 Oct
- 2025WebGuard: Building a Generalizable Guardrail for Web Agents18 Jul
- 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents17 Jun
- 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
- 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
- 2025RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments28 May
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
- 2025DoomArena: A framework for Testing AI Agents Against Evolving Security Threats18 Apr
9 more
- 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
- 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents19 Jun
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
- 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning13 Jun
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep
Other references · 32
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
- 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 295
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
- 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 182
20 more
- 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agentscited by 156
- 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 151
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 132
- 2025GTA1: GUI Test-time Scaling Agentcited by 102
- 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 96
- 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agentscited by 88
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environmentscited by 69
- 2024Multi-Turn Context Jailbreak Attack on Large Language Models From First Principlescited by 54
- 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experiencecited by 51
- 2026UI-Venus-1.5 Technical Reportcited by 39
- 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 34
- 2025CoAct-1: Computer-using Multi-Agent System with Coding Actionscited by 33
- 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learningcited by 32
- 2025Monitoring Decomposition Attacks in LLMs with Lightweight Sequential Monitorscited by 21
- 2025MobileWorldBench: Towards Semantic World Modeling For Mobile Agentscited by 18
- 2026SafePred: A Predictive Guardrail for Computer-Using Agents via World Modelscited by 11
- 2025sudo rm -rf agentic_securitycited by 8
- 2026Shifting Uncertainty to Critical Moments: Towards Reliable Uncertainty Quantification for VLA Modelcited by 6
- 2026Video-Based Reward Modeling for Computer-Use Agentscited by 3
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Abstain-R1: Calibrated Abstention and Post-Refusal Clarification via Verifiable RLcited by 11
- 2026Safeguarding LLM Agents against Long-Horizon Threats via Shadow Memorycited by 6
- 2026REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systemscited by 4
- 2026Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teamingcited by 1
- 2026UI-Venus-2 Technical Reportcited by 1
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliabilitycited by 0
- 2026SynChain: Inducing Computer-Use Agent Systems to Construct Their Own Attack Chainscited by 0
- 2026MobileWorldSafety: Benchmarking GUI Agent Safety Against Environmental Injection Attacks in Android Appscited by 0
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 0
- 2026ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devicescited by 0
- 2026Beyond Task Completion: Training Capable and Safe Computer-Use Agentscited by 0
- 2026SCOUT: Synergizing Reasoning and Tool-Use for Computer-Use Safetycited by 0
- 2026SCOUT: Synergizing Reasoning and Tool-Use for Computer-Use Safety28 Sep 2026
- 2026Beyond Task Completion: Training Capable and Safe Computer-Use Agents27 Aug 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devices25 Aug 2026
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments20 Aug 2026
- 2026MobileWorldSafety: Benchmarking GUI Agent Safety Against Environmental Injection Attacks in Android Apps18 Aug 2026
- 2026REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systems11 Aug 2026
- 2026SynChain: Inducing Computer-Use Agent Systems to Construct Their Own Attack Chains7 Aug 2026
- 2026Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teaming3 Jun 2026
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliability8 May 2026
- 2026Safeguarding LLM Agents against Long-Horizon Threats via Shadow Memory4 May 2026
- 2026Abstain-R1: Calibrated Abstention and Post-Refusal Clarification via Verifiable RL18 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026OSGuard: A Benchmark for Safety in Computer-Use Agents
- 2025A Systematization of Security Vulnerabilities in Computer Use Agents
- 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents
- 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety
- 2026SIR: Self-improving Red-teaming for Compute Use Agents
- 2025How Brittle is Agent Safety? Rethinking Agent Risk under Intent Concealment and Task Complexity
- 2026Invisible Ink Threats: Adversarial Goals Behind Legitimate Tasks in Computer-Use Agents
- 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfaces