mlsanityData to 7 Oct 2026

The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents

arXiv 2604.10577 ↗First posted 12 Apr 2026cs.CR cs.AIcited by 12

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Computer-use agents (CUAs) can now autonomously complete complex tasks in real digital environments, but when misled, they can also be used to automate harmful actions programmatically. Existing safety evaluations largely target explicit threats such as misuse and prompt injection, but overlook a subtle yet critical setting where user instructions are entirely benign and harm arises from the task context or execution outcome. We introduce OS-BLIND, a benchmark that evaluates CUAs under unintended attack conditions, comprising 300 human-crafted tasks across 12 categories, 8 applications, and 2 threat clusters: environment-embedded threats and agent-initiated harms. Our evaluation on frontier models and agentic frameworks reveals that most CUAs exceed 90% attack success rate (ASR), and even the safety-aligned Claude 4.5 Sonnet reaches 73.0% ASR. More interestingly, this vulnerability becomes even more severe, with ASR rising from 73.0% to 92.7% when Claude 4.5 Sonnet is deployed in multi-agent systems. Our analysis further shows that existing safety defenses provide limited protection when user instructions are benign. Safety alignment primarily activates within the first few steps and rarely re-engages during subsequent execution. In multi-agent systems, decomposed subtasks obscure the harmful intent from the model, causing safety-aligned models to fail. We will release our OS-BLIND to encourage the broader research community to further investigate and address these safety challenges.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 53 of its 64 references that are in the map. First posted on arXiv 12 Apr 2026.

Builds on

53 of 64 references.

Closest ancestors · 21

Same direction, newest first

  1. 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agents9 Feb
  2. 2026MirrorGuard: Toward Secure Computer-Use Agents via Simulation-to-Real Reasoning Correction19 Jan
  3. 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents29 Dec
  4. 2025OS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflows28 Oct
  5. 2025Just Do It!? Computer-Use Agents Exhibit Blind Goal-Directedness2 Oct
  6. 2025WebGuard: Building a Generalizable Guardrail for Web Agents18 Jul
  7. 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents17 Jun
  8. 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
  9. 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
  10. 2025RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments28 May
  11. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  12. 2025DoomArena: A framework for Testing AI Agents Against Evolving Security Threats18 Apr
9 more
  1. 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
  2. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  3. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  4. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
  5. 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents19 Jun
  6. 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
  7. 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning13 Jun
  8. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
  9. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 32

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  4. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  5. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
  6. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
  7. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
  8. 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 295
  9. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
  10. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
  11. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
  12. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 182
20 more
  1. 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agentscited by 156
  2. 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 151
  3. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
  4. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 132
  5. 2025GTA1: GUI Test-time Scaling Agentcited by 102
  6. 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 96
  7. 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agentscited by 88
  8. 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environmentscited by 69
  9. 2024Multi-Turn Context Jailbreak Attack on Large Language Models From First Principlescited by 54
  10. 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experiencecited by 51
  11. 2026UI-Venus-1.5 Technical Reportcited by 39
  12. 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 34
  13. 2025CoAct-1: Computer-using Multi-Agent System with Coding Actionscited by 33
  14. 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learningcited by 32
  15. 2025Monitoring Decomposition Attacks in LLMs with Lightweight Sequential Monitorscited by 21
  16. 2025MobileWorldBench: Towards Semantic World Modeling For Mobile Agentscited by 18
  17. 2026SafePred: A Predictive Guardrail for Computer-Using Agents via World Modelscited by 11
  18. 2025sudo rm -rf agentic_securitycited by 8
  19. 2026Shifting Uncertainty to Critical Moments: Towards Reliable Uncertainty Quantification for VLA Modelcited by 6
  20. 2026Video-Based Reward Modeling for Computer-Use Agentscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026OSGuard: A Benchmark for Safety in Computer-Use Agents
  2. 2025A Systematization of Security Vulnerabilities in Computer Use Agents
  3. 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents
  4. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety
  5. 2026SIR: Self-improving Red-teaming for Compute Use Agents
  6. 2025How Brittle is Agent Safety? Rethinking Agent Risk under Intent Concealment and Task Complexity
  7. 2026Invisible Ink Threats: Adversarial Goals Behind Legitimate Tasks in Computer-Use Agents
  8. 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfaces