mlsanityData to 14 Oct 2026

Agent Data Injection Attacks are Realistic Threats to AI Agents

arXiv 2607.05120 ↗First posted 6 Jul 2026cs.CR cs.AIcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

AI agents act on behalf of user prompts, consuming external data and taking actions based on the agent context. Prior research on AI agent security has primarily focused on indirect prompt injection (IPI). Its most well-studied category is instruction injection, where attacker-controlled untrusted data is interpreted as an instruction. In response, many mitigations have been proposed to prevent instruction injection attacks. In this paper, we introduce a new category of IPI, agent data injection attacks (ADI). ADI injects malicious data disguised as trusted data, such as security-critical metadata (e.g., resource identifiers or data origins) or agent context data (e.g., tool call and response formats). As a result, agents unknowingly execute unintended actions based on attacker-controlled data. ADI has similar attack impacts as instruction injection attacks, because it causes agents to misbehave and execute unintended actions. Despite the similar impact, ADI remains underexplored and easily bypasses existing IPI defenses. We found several critical vulnerabilities in real-world agents that allow an attacker to launch various attacks: arbitrary click attacks on web agents (Claude in Chrome, Antigravity, and Nanobrowser), and remote code execution and supply-chain attacks on coding agents (Claude Code, Codex, and Gemini CLI). We evaluate ADI vulnerabilities across off-the-shelf models and AI agents, and find that ADI is effective in both standalone LLMs and AI agent settings. ADI exposes a critical gap in agent security, signifying that current AI agents do not employ a fundamental security principle: current agents do not isolate trusted data from untrusted data.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 42 of its 59 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

42 of 59 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
  2. 2025Design Patterns for Securing LLM Agents against Prompt Injections10 Jun
  3. 2025AgentVigil: Generic Black-Box Red-teaming for Indirect Prompt Injection against LLM Agents9 May
  4. 2025LlamaFirewall: An open source guardrail system for building secure AI agents6 May
  5. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  6. 2025Defeating Prompt Injections by Design24 Mar
  7. 2025Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agents17 Mar
  8. 2024Imprompter: Tricking LLM Agents into Improper Tool Use19 Oct
  9. 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
  10. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
  11. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  12. 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
2 more
  1. 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systems8 Mar
  2. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 28

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  5. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  6. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  7. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
  8. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  9. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
  10. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
  11. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
  12. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
16 more
  1. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
  2. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
  3. 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judgecited by 143
  4. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 143
  5. 2023Open Sesame! Universal Black Box Jailbreaking of Large Language Modelscited by 134
  6. 2024PLeak: Prompt Leaking Attacks against Large Language Model Applicationscited by 127
  7. 2025Securing AI Agents with Information-Flow Controlcited by 121
  8. 2024Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templatescited by 96
  9. 2024System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspectivecited by 96
  10. 2023Effective Prompt Extraction from Language Modelscited by 85
  11. 2025Contextual Agent Security: A Policy for Every Purposecited by 59
  12. 2025ACE: A Security Architecture for LLM-Integrated App Systemscited by 55
  13. 2024Permissive Information-Flow Analysis for Large Language Modelscited by 22
  14. 2025Towards Automating Data Access Permissions in AI Agentscited by 21
  15. 2025Invitation Is All You Need! Promptware Attacks Against LLM-Powered Assistants in Production Are Practical and Dangerouscited by 12
  16. 2025How Good Are LLMs at Processing Tool Outputs?cited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Context manipulation attacks : Web agents are susceptible to corrupted memory
  2. 2025BrowseSafe: Understanding and Preventing Prompt Injection Within AI Browser Agents
  3. 2026Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks
  4. 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMs
  5. 2026SIR: Self-improving Red-teaming for Compute Use Agents
  6. 2026DualView: Preventing Indirect Prompt Injection in Personal AI Agents
  7. 2025Who Grants the Agent Power? Defending Against Instruction Injection via Task-Centric Access Control
  8. 2025Indirect Prompt Injections: Are Firewalls All You Need, or Stronger Benchmarks?