Who Pays the Price? Stakeholder-Centric Prompt Injection Benchmarking for Real-world Web Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
LLM-based web agents are increasingly deployed in real-world settings such as e-commerce, where they interact extensively with untrusted web content while executing actions that carry direct financial consequences. This makes them vulnerable to prompt-injection attacks, in which seemingly benign web content conceals adversarial instructions that manipulate the agent's behavior. Existing security benchmarks adopt an textitattack-centric perspective, focusing on the technical feasibility of injections while overlooking the nuanced distribution of resulting harms. In practice, however, prompt-injection risk is victim-dependent: a single exploit can produce asymmetric consequences for different stakeholders, and the same attack pattern may exhibit substantially different effectiveness depending on whom it targets. To capture these properties, we introduce StakeBench, a stakeholder-centric benchmark that systematically categorizes and attributes harm in real-world web agent systems for online shopping. In general, StakeBench decomposes prompt-injection risk into 12 concrete attack objectives across three stakeholder classes, realized by 22 reusable templates and instantiated into 264 executable adversarial cases spanning 12 product categories, with each case evaluated along complementary outcome- and process-level metrics. Evaluating four deployable agent-backbone configurations across 3,168 attacked runs, we find substantial and heterogeneous vulnerabilities: no attack objective is reliably resisted by current LLM-based web agents, and outcomes span four qualitatively distinct modes. These patterns are missed by conventional attack-centric, single-metric evaluation, underscoring the need for stakeholder-aware assessment of LLM-based agents in real-world deployments.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 42 of its 60 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
42 of 60 references.
Closest ancestors · 16
Same direction, newest first
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis11 Feb
- 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks9 Feb
- 2025Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections30 Oct
- 2025OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents17 Jun
- 2025Simple Prompt Injection Attacks Can Leak Personal Data Observed by LLM Agents During Task Execution1 Jun
- 2025WebInject: Prompt Injection Attack to Web Agents16 May
- 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
- 2025AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agents12 Mar
- 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasures12 Mar
- 2025Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks12 Feb
- 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents9 Oct
4 more
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep
Other references · 26
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2025OpenAI GPT-5 System Cardcited by 910
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
14 more
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 307
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 237
- 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 145
- 2024AutoWebGLM: A Large Language Model-based Web Navigating Agentcited by 130
- 2024Beyond Browsing: API-Based Web Agentscited by 77
- 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Modelcited by 56
- 2026AgentDyn: Are Your Agent Security Defenses Deployable in Real-World Dynamic Environments?cited by 45
- 2025DeepShop: A Benchmark for Deep Research Shopping Agentscited by 42
- 2025ShoppingBench: A Real-World Intent-Grounded Shopping Benchmark for LLM-based Agentscited by 26
- 2025Toward a Human-Centered Evaluation Framework for Trustworthy LLM-Powered GUI Agentscited by 11
- 2024DCA-Bench: A Benchmark for Dataset Curation Agentscited by 6
- 2025When AI Meets the Web: Prompt Injection Risks in Third-Party AI Chatbot Pluginscited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
- 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents
- 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks
- 2026Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teaming
- 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilities
- 2026WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agents