mlsanityData to 14 Oct 2026

IPI-proxy: An Intercepting Proxy for Red-Teaming Web-Browsing AI Agents Against Indirect Prompt Injection

arXiv 2605.11868 ↗First posted 12 May 2026cs.CR cs.AIcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Web-browsing AI agents are increasingly deployed in enterprise settings under strict whitelists of approved domains, yet adversaries can still influence them by embedding hidden instructions in the HTML pages those domains serve. Existing red-teaming resources fall short of this scenario: prompt-injection benchmarks ship pre-built adversarial pages that whitelisted agents cannot reach, and generic LLM scanners probe the model API rather than its retrieved content. We present IPI-proxy, an open-source toolkit for red-teaming web-browsing agents against indirect prompt injection (IPI). At its core is an intercepting proxy that rewrites real HTTP responses from whitelisted domains in flight, embedding payloads drawn from a unified library of 820 deduplicated attack strings extracted from six published benchmarks (BIPIA, InjecAgent, AgentDojo, Tensor Trust, WASP, and LLMail-Inject). A YAML-driven test harness independently parameterizes the payload set, the embedding technique (HTML comment, invisible CSS, or LLM-generated semantic prose), and the HTML insertion point (6 locations from icodeheadmeta to icodescriptcomment), enabling parameter-sweep evaluation without mock pages or sandboxed environments. A companion exfiltration tracker logs successful callbacks. This paper describes the threat model, situates IPI-proxy among contemporary IPI benchmarks and red-teaming tools, and details its architecture, design decisions, and configuration interface. By bridging static benchmarks and live deployment, IPI-proxy gives AI security teams a reproducible substrate for measuring and hardening web-browsing agents against indirect prompt injection on the same retrieval surface attackers exploit in production.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 16 of its 25 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

16 of 25 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Design Patterns for Securing LLM Agents against Prompt Injections10 Jun
  2. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  3. 2025Defeating Prompt Injections by Design24 Mar
  4. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 12

  1. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  2. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  3. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  4. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
  5. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  6. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267
  7. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
  8. 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 210
  9. 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Gamecited by 145
  10. 2024garak: A Framework for Security Probing Large Language Modelscited by 49
  11. 2025EchoLeak: The First Real-World Zero-Click Prompt Injection Exploit in a Production LLM Systemcited by 29
  12. 2025LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challengecited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents
  2. 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
  3. 2026SIR: Self-improving Red-teaming for Compute Use Agents
  4. 2026WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agents
  5. 2026Securing the AI Agent: A Unified Framework for Multi-Layer Agent Red Teaming
  6. 2026Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teaming
  7. 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
  8. 2026Agent Data Injection Attacks are Realistic Threats to AI Agents