BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
The integration of artificial intelligence (AI) agents into web browsers introduces security challenges that go beyond traditional web application threat models. Prior work has identified prompt injection as a new attack vector for web agents, yet the resulting impact within real-world environments remains insufficiently understood. In this work, we examine the landscape of prompt injection attacks and synthesize a benchmark of attacks embedded in realistic HTML payloads. Our benchmark goes beyond prior work by emphasizing injections that can influence real-world actions rather than mere text outputs, and by presenting attack payloads with complexity and distractor frequency similar to what real-world agents encounter. We leverage this benchmark to conduct a comprehensive empirical evaluation of existing defenses, assessing their effectiveness across a suite of frontier AI models. We propose a multi-layered defense strategy comprising both architectural and model-based defenses to protect against evolving prompt injection attacks. Our work offers a blueprint for designing practical, secure web agents through a defense-in-depth approach.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 42 of its 59 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
42 of 59 references.
Closest ancestors · 22
Same direction, newest first
- 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents1 Oct
- 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
- 2025Defending Against Prompt Injection With a Few DefensiveTokens10 Jul
- 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
- 2025LLM Agents Should Employ Security Principles29 May
- 2025WebInject: Prompt Injection Attack to Web Agents16 May
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
- 2025Progent: Securing AI Agents with Privilege Control16 Apr
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attacks15 Apr
- 2025Defeating Prompt Injections by Design24 Mar
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspective27 Sep
10 more
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlighting20 Mar
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Models7 Mar
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
- 2024StruQ: Defending Against Prompt Injection with Structured Queries9 Feb
- 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuning29 Dec
- 2023Maatphor: Automated Variant Analysis for Prompt Injection Attacks12 Dec
- 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game2 Nov
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defenses19 Oct
- 2023Prompt Injection attack against LLM-integrated Applications8 Jun
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb
Other references · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakagecited by 150
- 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systemscited by 130
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 129
8 more
- 2025Securing AI Agents with Information-Flow Controlcited by 121
- 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 120
- 2024Attacking Vision-Language Computer Agents via Pop-upscited by 116
- 2023Evil Geniuses: Delving into the Safety of LLM-based Agentscited by 106
- 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
- 2025Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agentscited by 87
- 2025The Obvious Invisible Threat: LLM-Powered GUI Agents' Vulnerability to Fine-Print Injectionscited by 59
- 2025ACE: A Security Architecture for LLM-Integrated App Systemscited by 55
Built on by
Citing papers per year: 2025: 1; 2026: 23.
24 papers.
Sort:
By area:
- 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systemscited by 30
- 2025ceLLMate: Sandboxing Browser AI Agentscited by 16
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agentscited by 11
- 2026Security Considerations for Artificial Intelligence Agentscited by 8
- 2026Web Agents Should Adopt the Plan-Then-Execute Paradigmcited by 4
- 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injectionscited by 4
- 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memorycited by 4
- 2026WAAA! Web Adversaries Against Agentic Browserscited by 3
- 2026Untrusted Content Masking for Web Agents with Security Guaranteescited by 3
- 2026WebTrap Park: An Automated Platform for Systematic Security Evaluation of Web Agentscited by 2
- 2026Trust No Tool: Evaluating and Defending LLM Agents under Untrusted Tool Feedbackcited by 2
- 2026Security--Fidelity Tradeoffs: The Hidden Cost of Prompt Injection Defensecited by 2
12 more
- 2026MalURLBench: A Benchmark Evaluating Agents' Vulnerabilities When Processing Web URLscited by 1
- 2026How do AI agents talk about science and research? An exploration of scientific discussions on Moltbook using BERTopiccited by 1
- 2026Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teamingcited by 1
- 2026WebChallenger: A Reliable and Efficient Generalist Web Agentcited by 1
- 2026Same-Origin Policy for Agentic Browserscited by 1
- 2026Prismata: Confining Cross-Site Prompt Injection in Web Agentscited by 1
- 2026LoginTrap: Uncovering Task-Agnostic Phishing-Style Indirect Prompt Injection Attacks against LLM-based Web Agentscited by 1
- 2026Toward a Principled Framework for Agent Safety Measurementcited by 0
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliabilitycited by 0
- 2026Lazy Grounding: Attacking Search Agents with Factual Evidencecited by 0
- 2026Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarkscited by 0
- 2026BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Viewscited by 0
- 2026BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views12 Oct 2026
- 2026Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarks15 Sep 2026
- 2026Lazy Grounding: Attacking Search Agents with Factual Evidence31 Aug 2026
- 2026LoginTrap: Uncovering Task-Agnostic Phishing-Style Indirect Prompt Injection Attacks against LLM-based Web Agents5 Aug 2026
- 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memory31 Jul 2026
- 2026Prismata: Confining Cross-Site Prompt Injection in Web Agents9 Jul 2026
- 2026Untrusted Content Masking for Web Agents with Security Guarantees6 Jul 2026
- 2026Security--Fidelity Tradeoffs: The Hidden Cost of Prompt Injection Defense29 Jun 2026
- 2026Same-Origin Policy for Agentic Browsers12 Jun 2026
- 2026WebChallenger: A Reliable and Efficient Generalist Web Agent9 Jun 2026
- 2026Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teaming3 Jun 2026
- 2026Trust No Tool: Evaluating and Defending LLM Agents under Untrusted Tool Feedback17 May 2026
12 more
- 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections14 May 2026
- 2026Web Agents Should Adopt the Plan-Then-Execute Paradigm14 May 2026
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliability8 May 2026
- 2026WAAA! Web Adversaries Against Agentic Browsers6 May 2026
- 2026Toward a Principled Framework for Agent Safety Measurement2 May 2026
- 2026Security Considerations for Artificial Intelligence Agents12 Mar 2026
- 2026How do AI agents talk about science and research? An exploration of scientific discussions on Moltbook using BERTopic11 Mar 2026
- 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems19 Feb 2026
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agents3 Feb 2026
- 2026MalURLBench: A Benchmark Evaluating Agents' Vulnerabilities When Processing Web URLs26 Jan 2026
- 2026WebTrap Park: An Automated Platform for Systematic Security Evaluation of Web Agents13 Jan 2026
- 2025ceLLMate: Sandboxing Browser AI Agents14 Dec 2025
- 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systemscited by 30
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agentscited by 11
- 2026Web Agents Should Adopt the Plan-Then-Execute Paradigmcited by 4
- 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injectionscited by 4
- 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memorycited by 4
- 2026WAAA! Web Adversaries Against Agentic Browserscited by 3
- 2026Untrusted Content Masking for Web Agents with Security Guaranteescited by 3
- 2026WebTrap Park: An Automated Platform for Systematic Security Evaluation of Web Agentscited by 2
- 2026Trust No Tool: Evaluating and Defending LLM Agents under Untrusted Tool Feedbackcited by 2
- 2026MalURLBench: A Benchmark Evaluating Agents' Vulnerabilities When Processing Web URLscited by 1
- 2026Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teamingcited by 1
- 2026Same-Origin Policy for Agentic Browserscited by 1
12 most cited of 17 All 17 (JSON)
- 2026Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarks15 Sep 2026
- 2026LoginTrap: Uncovering Task-Agnostic Phishing-Style Indirect Prompt Injection Attacks against LLM-based Web Agents5 Aug 2026
- 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memory31 Jul 2026
- 2026Prismata: Confining Cross-Site Prompt Injection in Web Agents9 Jul 2026
- 2026Untrusted Content Masking for Web Agents with Security Guarantees6 Jul 2026
- 2026Same-Origin Policy for Agentic Browsers12 Jun 2026
- 2026Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teaming3 Jun 2026
- 2026Trust No Tool: Evaluating and Defending LLM Agents under Untrusted Tool Feedback17 May 2026
- 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections14 May 2026
- 2026Web Agents Should Adopt the Plan-Then-Execute Paradigm14 May 2026
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliability8 May 2026
- 2026WAAA! Web Adversaries Against Agentic Browsers6 May 2026
12 newest of 17 All 17 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agents
- 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
- 2025The Hidden Dangers of Browsing AI Agents
- 2026IPI-proxy: An Intercepting Proxy for Red-Teaming Web-Browsing AI Agents Against Indirect Prompt Injection
- 2025Context manipulation attacks : Web agents are susceptible to corrupted memory
- 2025Building Browser Agents: Architecture, Security, and Practical Solutions
- 2025Mind the Web: The Security of Web Use Agents
- 2025Cybersecurity AI: Hacking the AI Hackers via Prompt Injection