mlsanityData to 14 Oct 2026

WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agents

arXiv 2604.12284 ↗First posted 14 Apr 2026cs.CRcited by 3

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Web agents powered by vision-language models (VLMs) enable autonomous interaction with web environments by perceiving and acting on both visual and textual webpage content to accomplish user-specified tasks. However, they are highly vulnerable to prompt injection attacks, where adversarial instructions embedded in HTML or rendered screenshots can manipulate agent behavior and lead to harmful outcomes such as information leakage. Existing defenses, including system prompt defenses and direct fine-tuning of agents, have shown limited effectiveness. To address this issue, we propose a defense framework in which a web agent operates in parallel with a dedicated guard agent, decoupling prompt injection detection from the agent's own reasoning. Building on this framework, we introduce WebAgentGuard, a reasoning-driven, multimodal guard model for prompt injection detection. We construct a synthetic multimodal dataset using GPT-5 spanning 164 topics and 230 visual and UI design styles, and train the model via reasoning-intensive supervised fine-tuning followed by reinforcement learning. Experiments across multiple benchmarks show that WebAgentGuard consistently outperforms strong baselines while preserving agent utility, without introducing additional latency.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 27 of its 42 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

27 of 42 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
  2. 2025WebInject: Prompt Injection Attack to Web Agents16 May
  3. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  4. 2024Attacking Vision-Language Computer Agents via Pop-ups4 Nov
  5. 2024Imprompter: Tricking LLM Agents into Improper Tool Use19 Oct
  6. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
  7. 2024WIPI: A New Web Threat for LLM-Driven Web Agents26 Feb

Other references · 20

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  2. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  3. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  4. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
  5. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
  6. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
  7. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
  8. 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 165
  9. 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 129
  10. 2024AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shield Promptingcited by 125
  11. 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
  12. 2023JailGuard: A Universal Detection Framework for LLM Prompt-based Attackscited by 50
8 more
  1. 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detectioncited by 33
  2. 2024Safeguarding Vision-Language Models Against Patched Visual Prompt Injectorscited by 27
  3. 2024PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detectioncited by 19
  4. 2024VLMGuard: Bootstrapping Malicious Prompt Detectors from Unlabeled Vision-Language Prompts in the Wildcited by 18
  5. 2025TopicAttack: An Indirect Prompt Injection Attack via Topic Transitioncited by 17
  6. 2025RSafe: Incentivizing proactive reasoning to build robust and adaptive LLM safeguardscited by 14
  7. 2025GSPR: Aligning LLM Safeguards as Generalizable Safety Policy Reasonerscited by 13
  8. 2025Backdoor-Powered Prompt Injection Attacks Nullify Defense Methodscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SnapGuard: Lightweight Prompt Injection Detection for Screenshot-Based Web Agents
  2. 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents
  3. 2025WebGuard: Building a Generalizable Guardrail for Web Agents
  4. 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
  5. 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
  6. 2026AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model
  7. 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents
  8. 2025Mind the Web: The Security of Web Use Agents