Context manipulation attacks : Web agents are susceptible to corrupted memory
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Autonomous web navigation agents, which translate natural language instructions into sequences of browser actions, are increasingly deployed for complex tasks across e-commerce, information retrieval, and content discovery. Due to the stateless nature of large language models (LLMs), these agents rely heavily on external memory systems to maintain context across interactions. Unlike centralized systems where context is securely stored server-side, agent memory is often managed client-side or by third-party applications, creating significant security vulnerabilities. This was recently exploited to attack production systems. We introduce and formalize "plan injection," a novel context manipulation attack that corrupts these agents' internal task representations by targeting this vulnerable context. Through systematic evaluation of two popular web agents, Browser-use and Agent-E, we show that plan injections bypass robust prompt injection defenses, achieving up to 3x higher attack success rates than comparable prompt-based attacks. Furthermore, "context-chained injections," which craft logical bridges between legitimate user goals and attacker objectives, lead to a 17.7% increase in success rate for privacy exfiltration tasks. Our findings highlight that secure memory handling must be a first-class concern in agentic systems.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 27 of its 38 references that are in the map. First posted on arXiv 18 Jun 2025.
Builds on
27 of 38 references.
Closest ancestors · 9
Same direction, newest first
- 2025Defeating Prompt Injections by Design24 Mar
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb
- 2024Breaking ReAct Agents: Foot-in-the-Door Attack Will Get You In22 Oct
- 2024Refusal-Trained LLMs Are Easily Jailbroken As Browser Agents11 Oct
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents19 Jun
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training10 Jan
Other references · 18
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
- 2023Cognitive Architectures for Language Agentscited by 422
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 237
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
- 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agentscited by 201
- 2024AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agentscited by 110
6 more
- 2024WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Explorationcited by 100
- 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 96
- 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environmentscited by 93
- 2024ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Datacited by 39
- 2025Real AI Agents with Fake Memories: Fatal Context Manipulation Attacks on Web3 Agentscited by 23
- 2024NaviQAte: Functionality-Guided Web Application Navigationcited by 9
Built on by
Citing papers per year: 2025: 3; 2026: 7.
10 papers.
- 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
- 2025Beyond Data Privacy: New Privacy Risks for Large Language Modelscited by 6
- 2026Mind Your HEARTBEAT! Claw Background Execution Inherently Enables Silent Memory Pollutioncited by 5
- 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoningcited by 4
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governancecited by 3
- 2026When Claws Remember but Do Not Tell: Stealthy Memory Injection in Persistent Personal Agentscited by 2
- 2026Proof-of-Execution Memory: Defending LLM Agents Against Forged-Reasoning Attacks by Verifying What Actually Happenedcited by 1
- 2026MAFIA: Query-Only Memory Attacks via Probing and Factual Injection against Audited LLM Agentscited by 0
- 2026When Correct Memory Goes Wrong: Fuzzing Persistent Memory Use in LLM Agentscited by 0
- 2026Secure-CUA: Controlling Untrusted Influence in Computer-Use Agentscited by 0
- 2026Secure-CUA: Controlling Untrusted Influence in Computer-Use Agents7 Oct 2026
- 2026When Correct Memory Goes Wrong: Fuzzing Persistent Memory Use in LLM Agents29 Sep 2026
- 2026Proof-of-Execution Memory: Defending LLM Agents Against Forged-Reasoning Attacks by Verifying What Actually Happened17 Aug 2026
- 2026MAFIA: Query-Only Memory Attacks via Probing and Factual Injection against Audited LLM Agents4 Aug 2026
- 2026When Claws Remember but Do Not Tell: Stealthy Memory Injection in Persistent Personal Agents6 Jul 2026
- 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoning18 Apr 2026
- 2026Mind Your HEARTBEAT! Claw Background Execution Inherently Enables Silent Memory Pollution24 Mar 2026
- 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agents29 Dec 2025
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governance30 Nov 2025
- 2025Beyond Data Privacy: New Privacy Risks for Large Language Models16 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Mind the Web: The Security of Web Use Agents
- 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents
- 2026Prismata: Confining Cross-Site Prompt Injection in Web Agents
- 2026When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents
- 2026Bad Memory: Evaluating Prompt Injection Risks from Memory in Agentic Systems
- 2026MemVenom: Triggered Poisoning of Multimodal Memories in Web Agents
- 2026Agent Data Injection Attacks are Realistic Threats to AI Agents
- 2026AgentSys: Secure and Dynamic LLM Agents Through Explicit Hierarchical Memory Management