sudo rm -rf agentic_security
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large Language Models (LLMs) are increasingly deployed as computer-use agents, autonomously performing tasks within real desktop or web environments. While this evolution greatly expands practical use cases for humans, it also creates serious security exposures. We present SUDO (Screen-based Universal Detox2Tox Offense), a novel attack framework that systematically bypasses refusal-trained safeguards in commercial computer-use agents, such as Claude for Computer Use. The core mechanism, Detox2Tox, transforms harmful requests (that agents initially reject) into seemingly benign requests via detoxification, secures detailed instructions from advanced vision language models (VLMs), and then reintroduces malicious content via toxification just before execution. Unlike conventional jailbreaks, SUDO iteratively refines its attacks based on a built-in refusal feedback, making it increasingly effective against robust policy filters. In extensive tests spanning 50 real-world tasks and multiple state-of-the-art VLMs, SUDO achieves a stark attack success rate of 24.41% (with no refinement), and up to 41.33% (by its iterative refinement) in Claude for Computer Use. By revealing these vulnerabilities and demonstrating the ease with which they can be exploited in real-world computing environments, this paper highlights an immediate need for robust, context-aware safeguards. WARNING: This paper includes harmful or offensive model outputs
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 10 of its 26 references that are in the map. First posted on arXiv 26 Mar 2025.
Builds on
10 of 26 references.
Closest ancestors · 1
Same direction, newest first
Other references · 9
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 538
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 437
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
- 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 220
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakagecited by 150
- 2024The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Usecited by 63
- 2024MobileSafetyBench: Evaluating Safety of Autonomous Agents in Mobile Device Controlcited by 51
- 2024When LLMs Go Online: The Emerging Threat of Web-Enabled LLMscited by 24
Built on by
Citing papers per year: 2025: 7; 2026: 1.
8 papers.
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challengescited by 28
- 2025WebGuard: Building a Generalizable Guardrail for Web Agentscited by 21
- 2025Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Studycited by 12
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agentscited by 12
- 2025Just Do It!? Computer-Use Agents Exhibit Blind Goal-Directednesscited by 9
- 2025Mind the Web: The Security of Web Use Agentscited by 5
- 2025State Your Intention to Steer Your Attention: An AI Assistant for Intentional Digital Livingcited by 2
- 2025Measuring the Security of Mobile LLM Agents under Adversarial Prompts from Untrusted Third-Party Channelscited by 0
- 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents12 Apr 2026
- 2025Measuring the Security of Mobile LLM Agents under Adversarial Prompts from Untrusted Third-Party Channels31 Oct 2025
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges27 Oct 2025
- 2025State Your Intention to Steer Your Attention: An AI Assistant for Intentional Digital Living16 Oct 2025
- 2025Just Do It!? Computer-Use Agents Exhibit Blind Goal-Directedness2 Oct 2025
- 2025WebGuard: Building a Generalizable Guardrail for Web Agents18 Jul 2025
- 2025Mind the Web: The Security of Web Use Agents8 Jun 2025
- 2025Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Study21 May 2025
Similar, not cited
Close in wording, no citation either way
- 2024Competition Report: Finding Universal Jailbreak Backdoors in Aligned LLMs
- 2025Evaluating Multi-Agent Defences Against Jailbreaking Attacks on Large Language Models
- 2025Defending Large Language Models Against Jailbreak Exploits with Responsible AI Considerations
- 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models
- 2023Universal Jailbreak Backdoors from Poisoned Human Feedback
- 2025From LLMs to MLLMs to Agents: A Survey of Emerging Paradigms in Jailbreak Attacks and Defenses within LLM Ecosystem
- 2026From Prompt Injection to Persistent Control: Defending Agentic Harness Against Trojan Backdoors