Benchmarking Web Agent Safety under E-commerce Deceptive Interfaces
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
As autonomous web agents are increasingly deployed to perform real-world tasks, ensuring their safety has become a critical concern. In this work, we study web agent behavior under realistic deceptive interfaces in the e-commerce domain. We introduce WebDecept, a lightweight and configurable plugin framework that enables controlled injection of deceptive interface patterns into existing web environments. Using WebDecept, we instantiate seven deceptive patterns commonly observed on the open web, including targeted advertisements, domain redirection, and shopping manipulation. By injecting these patterns into the frontend during task execution, we perform controlled evaluation of multiple multimodal web agents. Our results show that current web agents are highly susceptible to multiple classes of deceptive interfaces, and that prompt-based constraints are often insufficient to mitigate these failures. We further analyze how the design choices of deceptive patterns influence the success of such manipulations. These findings highlight safety challenges that should be addressed as web agents are scaled toward real-world deployment.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 25 of its 35 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
25 of 35 references.
Closest ancestors · 13
Same direction, newest first
- 2025SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents13 Oct
- 2025SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web Agents11 Oct
- 2025WebGuard: Building a Generalizable Guardrail for Web Agents18 Jul
- 2025The Hidden Dangers of Browsing AI Agents19 May
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
- 2025DoomArena: A framework for Testing AI Agents Against Evolving Security Threats18 Apr
- 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb
- 2024Refusal-Trained LLMs Are Easily Jailbroken As Browser Agents11 Oct
- 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents9 Oct
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
- 2024WIPI: A New Web Threat for LLM-Driven Web Agents26 Feb
1 more
Other references · 12
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2024WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Explorationcited by 100
- 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
- 2024ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Datacited by 39
- 2025PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequencecited by 33
- 2025BEARCUBS: A benchmark for computer-using web agentscited by 29
- 2025Monte Carlo Planning with Large Language Model for Text-Based Game Agentscited by 22
- 2026VGAS: Value-Guided Action-Chunk Selection for Few-Shot Vision-Language-Action Adaptationcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Right Screen, Wrong Transition: World Models as Verifiers for GUI Agents8 Oct 2026
- 2026Before Acting, Change the State: Prospective State Intervention for Web Agents under Deceptive Interfaces28 Sep 2026
- 2026CAVEAT: Towards Robust Computer-Use Agents in Incentive-Misaligned Environments23 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Don't Click That: Teaching Web Agents to Resist Deceptive Interfaces
- 2025Building Browser Agents: Architecture, Security, and Practical Solutions
- 2026WebSP-Eval: Evaluating Web Agents on Website Security and Privacy Tasks
- 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
- 2025Mind the Web: The Security of Web Use Agents
- 2025WAREX: Web Agent Reliability Evaluation on Existing Benchmarks
- 2026RiskWebWorld: A Realistic Interactive Benchmark for GUI Agents in E-commerce Risk Management
- 2026When Bots Take the Bait: Exposing and Mitigating the Emerging Social Engineering Attack in Web Automation Agent