mlsanityData to 14 Oct 2026

RiskWebWorld: A Realistic Interactive Benchmark for GUI Agents in E-commerce Risk Management

arXiv 2604.13531 ↗First posted 15 Apr 2026cs.AI cs.LGcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Graphical User Interface (GUI) agents show strong capabilities for automating web tasks, but existing interactive benchmarks primarily target benign, predictable consumer environments. Their effectiveness in high-stakes, investigative domains such as authentic e-commerce risk management remains underexplored. To bridge this gap, we present RiskWebWorld, the first highly realistic interactive benchmark for evaluating GUI agents in e-commerce risk management. RiskWebWorld features 1,513 tasks sourced from production risk-control pipelines across 8 core domains, and captures the authentic challenges of risk operations on uncooperative websites, partially environmental hijackments. To support scalable evaluation and agentic reinforcement learning (RL), we further build a Gymnasium-compliant infrastructure that decouples policy planning from environment mechanics. Our evaluation across diverse models reveals a dramatic capability gap: top-tier generalist models achieve 49.1% success, while specialized open-weights GUI models lag at near-total failure. This highlights that foundation model scale currently matters more than zero-shot interface grounding in long-horizon professional tasks. We also demonstrate the viability of our infrastructure through agentic RL, which improves open-source models by 16.2%. These results position RiskWebWorld as a practical testbed for developing robust digital workers.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 50 of its 76 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

50 of 76 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents13 Oct
  2. 2025RISK: A Framework for GUI Agents in E-commerce Risk Management26 Sep
  3. 2025RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents31 May
  4. 2025RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments28 May

Other references · 46

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  4. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  5. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  6. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  7. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  8. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
  9. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  10. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
  11. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  12. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
34 more
  1. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  2. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 319
  3. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 244
  4. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
  5. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 215
  6. 2025An Illusion of Progress? Assessing the Current State of Web Agentscited by 174
  7. 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 157
  8. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 139
  9. 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
  10. 2024WebCanvas: Benchmarking Web Agents in Online Environmentscited by 121
  11. 2024GUI Agents: A Surveycited by 103
  12. 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agentscited by 79
  13. 2025GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agentscited by 74
  14. 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environmentscited by 72
  15. 2024AppAgent v2: Advanced Agent for Flexible Mobile Interactionscited by 68
  16. 2025GUI-G2: Gaussian Reward Modeling for GUI Groundingcited by 63
  17. 2024Benchmarking Mobile Device Control Agents across Diverse Configurationscited by 55
  18. 2025AppAgentX: Evolving GUI Agents as Proficient Smartphone Userscited by 46
  19. 2025UFO2: The Desktop AgentOScited by 41
  20. 2026UI-Venus-1.5 Technical Reportcited by 41
  21. 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agentscited by 32
  22. 2025RealWebAssist: A Benchmark for Long-Horizon Web Assistance with Real-World Userscited by 21
  23. 2026WebGym: Scaling Training Environments for Visual Web Agents with Realistic Taskscited by 19
  24. 2024Tur[k]ingBench: A Challenge Benchmark for Web Agentscited by 18
  25. 2025WebMall -- A Multi-Shop Benchmark for Evaluating Web Agentscited by 17
  26. 2025A Functionality-Grounded Benchmark for Evaluating Web Agents in E-commerce Domainscited by 7
  27. 2026Generalization in Online Reinforcement Learning for Mobile Agentscited by 6
  28. 2026GUIGuard-Bench: Toward a General Evaluation for Privacy-Preserving GUI Agentscited by 4
  29. 2025WEBSERV: A Full-Stack and RL-Ready Web Environment for Training Web Agents at Scalecited by 3
  30. 2025MobiBench: Multi-Branch, Modular Benchmark for Mobile GUI Agentscited by 3
  31. 2026CUAAudit: Meta-Evaluation of Vision-Language Models as Auditors of Autonomous Computer-Use Agentscited by 3
  32. 2026GUI-CEval: A Hierarchical and Comprehensive Chinese Benchmark for Mobile GUI Agentscited by 3
  33. 2026Towards GUI Agents: Vision-Language Diffusion Models for GUI Groundingcited by 3
  34. 2026GuideWeb: A Benchmark for Automatic In-App Guide Generation on Real-World Web UIscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025WebGuard: Building a Generalizable Guardrail for Web Agents
  2. 2025EconWebArena: Benchmarking Autonomous Agents on Economic Tasks in Realistic Web Environments
  3. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety
  4. 2026Benchmarking Web Agent Safety under E-commerce Deceptive Interfaces
  5. 2025Building Browser Agents: Architecture, Security, and Practical Solutions
  6. 2025WAREX: Web Agent Reliability Evaluation on Existing Benchmarks
  7. 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents
  8. 2026Monitoring Web Agents Without Internal Signals: Observable Trajectories and Key-Step Supervision