BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views
On the map: LLM safety and security → Prompt injection and agent security also fits: Backdoor and data poisoning attacks
Abstract (arXiv)
Browser agents need to make decisions and execute actions on behalf of users while consuming untrusted webpages, creating opportunities for malicious instructions embedded in webpages to redirect legitimate tasks. We introduce BrowseSafe++, which extends BrowseSafe from 14,719 pages to 38,675 pairs of pages. Most of its prompt injections were observed in the wild on production websites. We keep each injection unchanged and rewrite the sensitive parts of the page around it to protect privacy. Each attacked page has a clean copy of the same page as its control. Both are provided as HTML, Markdown, an accessibility tree, and a screenshot. Every pair includes a user task and its expected answer. The benchmark includes twelve types of websites, from news articles to shared documents and forums, with 24 attack types appearing in 18 different locations on a page. We use these paired pages to train BrowseSafe-Guard, two 0.8B-parameter detectors for text and screenshots. Both achieve higher F1 scores than the detector based on frontier models, while keeping false-positive rates on benign pages and inference cost low. BrowseSafe-Adapt revises benchmark injections from browser-agent feedback, and attacks that succeed on only a few percent of tasks when replayed directly reach up to 95.41% success once adapted.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 57 of its 78 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
57 of 78 references.
Closest ancestors · 31
Same direction, newest first
- 2026DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agents6 May
- 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks9 Feb
- 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents25 Nov
- 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents1 Oct
- 2025IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents21 Aug
- 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
- 2025Defending Against Prompt Injection With a Few DefensiveTokens10 Jul
- 2025VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents3 Jun
- 2025LLM Agents Should Employ Security Principles29 May
- 2025RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments28 May
- 2025WebInject: Prompt Injection Attack to Web Agents16 May
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
19 more
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attacks15 Apr
- 2025Defeating Prompt Injections by Design24 Mar
- 2024AdvAgent: Controllable Blackbox Red-teaming on Web Agents22 Oct
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimization7 Oct
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspective27 Sep
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions19 Apr
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlighting20 Mar
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Models7 Mar
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
- 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts26 Feb
- 2024StruQ: Defending Against Prompt Injection with Structured Queries9 Feb
- 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuning29 Dec
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models21 Dec
- 2023Maatphor: Automated Variant Analysis for Prompt Injection Attacks12 Dec
- 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game2 Nov
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defenses19 Oct
- 2023Prompt Injection attack against LLM-integrated Applications8 Jun
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb
Other references · 26
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
- 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 439
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
14 more
- 2015Illuminating search spaces by mapping elitescited by 425
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakagecited by 150
- 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systemscited by 130
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 129
- 2025Securing AI Agents with Information-Flow Controlcited by 121
- 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 120
- 2024Attacking Vision-Language Computer Agents via Pop-upscited by 116
- 2024AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agentscited by 114
- 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
- 2025Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agentscited by 87
- 2025The Obvious Invisible Threat: LLM-Powered GUI Agents' Vulnerability to Fine-Print Injectionscited by 59
- 2025ACE: A Security Architecture for LLM-Integrated App Systemscited by 55
- 2025LM Agents May Fail to Act on Their Own Risk Knowledgecited by 6
- 2026PII-TRACE: A Benchmark for Context-Aware PII Detection in Multi-Turn LLM Conversationscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SnapGuard: Lightweight Prompt Injection Detection for Screenshot-Based Web Agents
- 2026Indirect Prompt Injection in the Wild: An Empirical Study of Prevalence, Techniques, and Objectives
- 2026WebSentinel: Detecting and Localizing Prompt Injection Attacks for Web Agents
- 2026WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agents
- 2025PromptShield: Deployable Detection for Prompt Injection Attacks
- 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections
- 2026MalURLBench: A Benchmark Evaluating Agents' Vulnerabilities When Processing Web URLs
- 2025Mind the Web: The Security of Web Use Agents