mlsanityData to 7 Oct 2026

ClawTrap: A MITM-Based Red-Teaming Framework for Real-World OpenClaw Security Evaluation

arXiv 2603.18762 ↗First posted 19 Mar 2026cs.CR cs.AIcited by 3

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Autonomous web agents such as OpenClaw are rapidly moving into high-impact real-world workflows, but their security robustness under live network threats remains insufficiently evaluated. Existing benchmarks mainly focus on static sandbox settings and content-level prompt attacks, which leaves a practical gap for network-layer security testing. In this paper, we present ClawTrap, a MITM-based red-teaming framework for real-world OpenClaw security evaluation. ClawTrap supports diverse and customizable attack forms, including textitStatic HTML Replacement, textitIframe Popup Injection, and textitDynamic Content Modification, and provides a reproducible pipeline for rule-driven interception, transformation, and auditing. This design lays the foundation for future research to construct richer, customizable MITM attacks and to perform systematic security testing across agent frameworks and model backbones. Our empirical study shows clear model stratification: weaker models are more likely to trust tampered observations and produce unsafe outputs, while stronger models demonstrate better anomaly attribution and safer fallback strategies. These findings indicate that reliable OpenClaw security evaluation should explicitly incorporate dynamic real-world MITM conditions rather than relying only on static sandbox protocols.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 27 of its 29 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

27 of 29 references.

Closest ancestors · 15

Same direction, newest first

  1. 2026Agents of Chaos23 Feb
  2. 2026WebTrap Park: An Automated Platform for Systematic Security Evaluation of Web Agents13 Jan
  3. 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents29 Dec
  4. 2025SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web Agents11 Oct
  5. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
  6. 2025WebInject: Prompt Injection Attack to Web Agents16 May
  7. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  8. 2025DoomArena: A framework for Testing AI Agents Against Evolving Security Threats18 Apr
  9. 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
  10. 2025Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks12 Feb
  11. 2024Attacking Vision-Language Computer Agents via Pop-ups4 Nov
  12. 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agents22 Oct
3 more
  1. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  2. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
  3. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 12

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  3. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  4. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  5. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  6. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  7. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  8. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  9. 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 177
  10. 2024HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactionscited by 42
  11. 2025WAREX: Web Agent Reliability Evaluation on Existing Benchmarkscited by 14
  12. 2025Injecting Falsehoods: Adversarial Man-in-the-Middle Attacks Undermining Factual Recall in LLMscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Security Attack and Defense Strategies for Autonomous Agent Frameworks: A Layered Review with OpenClaw as a Case Study
  2. 2026A Security Analysis of the OpenClaw AI Agent Framework
  3. 2026Uncovering Security Threats and Architecting Defenses in Autonomous Agents: A Case Study of OpenClaw
  4. 2026OpenClaw PRISM: A Zero-Fork, Defense-in-Depth Runtime Security Layer for Tool-Augmented LLM Agents
  5. 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasures
  6. 2026From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agent
  7. 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats
  8. 2026Your Agent, Their Asset: A Real-World Safety Analysis of OpenClaw