mlsanityData to 7 Oct 2026

Benchmarking Web Agent Safety under E-commerce Deceptive Interfaces

arXiv 2606.13686 ↗First posted 26 Apr 2026cs.CL cs.CYcited by 3

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

As autonomous web agents are increasingly deployed to perform real-world tasks, ensuring their safety has become a critical concern. In this work, we study web agent behavior under realistic deceptive interfaces in the e-commerce domain. We introduce WebDecept, a lightweight and configurable plugin framework that enables controlled injection of deceptive interface patterns into existing web environments. Using WebDecept, we instantiate seven deceptive patterns commonly observed on the open web, including targeted advertisements, domain redirection, and shopping manipulation. By injecting these patterns into the frontend during task execution, we perform controlled evaluation of multiple multimodal web agents. Our results show that current web agents are highly susceptible to multiple classes of deceptive interfaces, and that prompt-based constraints are often insufficient to mitigate these failures. We further analyze how the design choices of deceptive patterns influence the success of such manipulations. These findings highlight safety challenges that should be addressed as web agents are scaled toward real-world deployment.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 25 of its 35 references that are in the map. First posted on arXiv 26 Apr 2026.

Builds on

25 of 35 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents13 Oct
  2. 2025SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web Agents11 Oct
  3. 2025WebGuard: Building a Generalizable Guardrail for Web Agents18 Jul
  4. 2025The Hidden Dangers of Browsing AI Agents19 May
  5. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  6. 2025DoomArena: A framework for Testing AI Agents Against Evolving Security Threats18 Apr
  7. 2025SafeArena: Evaluating the Safety of Autonomous Web Agents6 Mar
  8. 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb
  9. 2024Refusal-Trained LLMs Are Easily Jailbroken As Browser Agents11 Oct
  10. 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents9 Oct
  11. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
  12. 2024WIPI: A New Web Threat for LLM-Driven Web Agents26 Feb
1 more
  1. 2023Evil Geniuses: Delving into the Safety of LLM-based Agents20 Nov

Other references · 12

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  3. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  4. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  5. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
  6. 2024WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Explorationcited by 100
  7. 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
  8. 2024ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Datacited by 39
  9. 2025PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequencecited by 33
  10. 2025BEARCUBS: A benchmark for computer-using web agentscited by 29
  11. 2025Monte Carlo Planning with Large Language Model for Text-Based Game Agentscited by 22
  12. 2026VGAS: Value-Guided Action-Chunk Selection for Few-Shot Vision-Language-Action Adaptationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Don't Click That: Teaching Web Agents to Resist Deceptive Interfaces
  2. 2025Building Browser Agents: Architecture, Security, and Practical Solutions
  3. 2026WebSP-Eval: Evaluating Web Agents on Website Security and Privacy Tasks
  4. 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
  5. 2025Mind the Web: The Security of Web Use Agents
  6. 2025WAREX: Web Agent Reliability Evaluation on Existing Benchmarks
  7. 2026RiskWebWorld: A Realistic Interactive Benchmark for GUI Agents in E-commerce Risk Management
  8. 2026When Bots Take the Bait: Exposing and Mitigating the Emerging Social Engineering Attack in Web Automation Agent