WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Web agents can autonomously complete online tasks by interacting with websites, but their exposure to open web environments makes them vulnerable to prompt injection attacks embedded in HTML content or visual interfaces. Existing guard models still suffer from limited generalization to unseen domains and attack patterns, high false positive rates on benign content, reduced deployment efficiency due to added latency at each step, and vulnerability to adversarial attacks that evolve over time or directly target the guard itself. To address these limitations, we propose WARD (Web Agent Robust Defense against Prompt Injection), a practical guard model for secure and efficient web agents. WARD is built on WARD-Base, a large-scale dataset with around 177K samples collected from 719 high-traffic URLs and platforms, and WARD-PIG, a dedicated dataset designed for prompt injection attacks targeting the guard model. We further introduce A3T, an adaptive adversarial attack training framework that iteratively strengthens WARD through a memory-based attacker and guard co-evolution process. Extensive experiments show that WARD achieves nearly perfect recall on out-of-distribution benchmarks, maintains low false positive rates to preserve agent utility, remains robust against guard-targeted and adaptive attacks under substantial distribution shifts, and runs efficiently in parallel with the agent without introducing additional latency.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 63 of its 79 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
63 of 79 references.
Closest ancestors · 15
Same direction, newest first
- 2026SnapGuard: Lightweight Prompt Injection Detection for Screenshot-Based Web Agents28 Apr
- 2026WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agents14 Apr
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agents3 Feb
- 2026MirrorGuard: Toward Secure Computer-Use Agents via Simulation-to-Real Reasoning Correction19 Jan
- 2026VIGIL: Defending LLM Agents Against Tool Stream Injection via Verify-Before-Commit9 Jan
- 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
- 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safety8 Jul
- 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
- 2025WebInject: Prompt Injection Attack to Web Agents16 May
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
- 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injection19 Apr
- 2024Attacking Vision-Language Computer Agents via Pop-ups4 Nov
3 more
Other references · 48
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
36 more
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 260
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 180
- 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
- 2024Llama Guard 3 Vision: Safeguarding Human-AI Image Understanding Conversationscited by 118
- 2023LongCoder: A Long-Range Pre-trained Language Model for Code Completioncited by 110
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
- 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
- 2025Words or Vision: Do Vision-Language Models Have Blind Faith in Text?cited by 86
- 2024InferAligner: Inference-Time Alignment for Harmlessness through Cross-Model Guidancecited by 78
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2024FlipAttack: Jailbreak LLMs via Flippingcited by 73
- 2020A Large-Scale Multi-Document Summarization Dataset from the Wikipedia Current Events Portalcited by 72
- 2024JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Modelscited by 67
- 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 66
- 2024ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Timecited by 57
- 2024Immune: Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignmentcited by 42
- 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoningcited by 38
- 2024IDEATOR: Jailbreaking and Benchmarking Large Vision-Language Models Using Themselvescited by 34
- 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detectioncited by 29
- 2024Safety Alignment for Vision Language Modelscited by 27
- 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agentscited by 23
- 2024PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detectioncited by 16
- 2025VLM-Guard: Safeguarding Vision-Language Models via Fulfilling Safety Alignment Gapcited by 16
- 2025Adversary-Aware DPO: Enhancing Safety Alignment in Vision Language Models via Adversarial Trainingcited by 12
- 2025TopicAttack: An Indirect Prompt Injection Attack via Topic Transitioncited by 11
- 2026PIArena: A Platform for Prompt Injection Evaluationcited by 10
- 2025Making Every Step Effective: Jailbreaking Large Vision-Language Models Through Hierarchical KV Equalizationcited by 4
- 2025PRISM: Programmatic Reasoning with Image Sequence Manipulation for LVLM Jailbreakingcited by 3
- 2025Backdoor-Powered Prompt Injection Attacks Nullify Defense Methodscited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model
- 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
- 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
- 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agents
- 2026Prismata: Confining Cross-Site Prompt Injection in Web Agents
- 2025WebGuard: Building a Generalizable Guardrail for Web Agents
- 2025AdInject: Real-World Black-Box Attacks on Web Agents via Advertising Delivery
- 2026Silent Egress: When Implicit Prompt Injection Makes LLM Agents Leak Without a Trace