mlsanityData to 7 Oct 2026

WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections

arXiv 2605.15030 ↗First posted 14 May 2026cs.CR cs.AIcited by 3

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Web agents can autonomously complete online tasks by interacting with websites, but their exposure to open web environments makes them vulnerable to prompt injection attacks embedded in HTML content or visual interfaces. Existing guard models still suffer from limited generalization to unseen domains and attack patterns, high false positive rates on benign content, reduced deployment efficiency due to added latency at each step, and vulnerability to adversarial attacks that evolve over time or directly target the guard itself. To address these limitations, we propose WARD (Web Agent Robust Defense against Prompt Injection), a practical guard model for secure and efficient web agents. WARD is built on WARD-Base, a large-scale dataset with around 177K samples collected from 719 high-traffic URLs and platforms, and WARD-PIG, a dedicated dataset designed for prompt injection attacks targeting the guard model. We further introduce A3T, an adaptive adversarial attack training framework that iteratively strengthens WARD through a memory-based attacker and guard co-evolution process. Extensive experiments show that WARD achieves nearly perfect recall on out-of-distribution benchmarks, maintains low false positive rates to preserve agent utility, remains robust against guard-targeted and adaptive attacks under substantial distribution shifts, and runs efficiently in parallel with the agent without introducing additional latency.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 63 of its 79 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

63 of 79 references.

Closest ancestors · 15

Same direction, newest first

  1. 2026SnapGuard: Lightweight Prompt Injection Detection for Screenshot-Based Web Agents28 Apr
  2. 2026WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agents14 Apr
  3. 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agents3 Feb
  4. 2026MirrorGuard: Toward Secure Computer-Use Agents via Simulation-to-Real Reasoning Correction19 Jan
  5. 2026VIGIL: Defending LLM Agents Against Tool Stream Injection via Verify-Before-Commit9 Jan
  6. 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
  7. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
  8. 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
  9. 2025WebInject: Prompt Injection Attack to Web Agents16 May
  10. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  11. 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injection19 Apr
  12. 2024Attacking Vision-Language Computer Agents via Pop-ups4 Nov
3 more
  1. 2024Imprompter: Tricking LLM Agents into Improper Tool Use19 Oct
  2. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
  3. 2024WIPI: A New Web Threat for LLM-Driven Web Agents26 Feb

Other references · 48

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  6. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  7. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  8. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  9. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  10. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  11. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  12. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
36 more
  1. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  2. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
  3. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
  4. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
  5. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
  6. 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 260
  7. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
  8. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 180
  9. 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
  10. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
  11. 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 118
  12. 2023LongCoder: A Long-Range Pre-trained Language Model for Code Completioncited by 110
  13. 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
  14. 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
  15. 2025Words or Vision: Do Vision-Language Models Have Blind Faith in Text?cited by 86
  16. 2024InferAligner: Inference-Time Alignment for Harmlessness through Cross-Model Guidancecited by 78
  17. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  18. 2024FlipAttack: Jailbreak LLMs via Flippingcited by 73
  19. 2020A Large-Scale Multi-Document Summarization Dataset from the Wikipedia Current Events Portalcited by 72
  20. 2024JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Modelscited by 67
  21. 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 66
  22. 2024ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Timecited by 57
  23. 2024Immune: Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignmentcited by 42
  24. 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoningcited by 38
  25. 2024IDEATOR: Jailbreaking and Benchmarking Large Vision-Language Models Using Themselvescited by 34
  26. 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detectioncited by 29
  27. 2024Safety Alignment for Vision Language Modelscited by 27
  28. 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agentscited by 23
  29. 2024PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detectioncited by 16
  30. 2025VLM-Guard: Safeguarding Vision-Language Models via Fulfilling Safety Alignment Gapcited by 16
  31. 2025Adversary-Aware DPO: Enhancing Safety Alignment in Vision Language Models via Adversarial Trainingcited by 12
  32. 2025TopicAttack: An Indirect Prompt Injection Attack via Topic Transitioncited by 11
  33. 2026PIArena: A Platform for Prompt Injection Evaluationcited by 10
  34. 2025Making Every Step Effective: Jailbreaking Large Vision-Language Models Through Hierarchical KV Equalizationcited by 4
  35. 2025PRISM: Programmatic Reasoning with Image Sequence Manipulation for LVLM Jailbreakingcited by 3
  36. 2025Backdoor-Powered Prompt Injection Attacks Nullify Defense Methodscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model
  2. 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
  3. 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
  4. 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agents
  5. 2026Prismata: Confining Cross-Site Prompt Injection in Web Agents
  6. 2025WebGuard: Building a Generalizable Guardrail for Web Agents
  7. 2025AdInject: Real-World Black-Box Attacks on Web Agents via Advertising Delivery
  8. 2026Silent Egress: When Implicit Prompt Injection Makes LLM Agents Leak Without a Trace