mlsanityData to 14 Oct 2026

IterInject: Indirect Prompt Injection Against LLM Agents via Feedback-Guided Iterative Optimization

arXiv 2605.24659 ↗First posted 23 May 2026cs.LGcited by 7

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

LLM-based agents are increasingly deployed for complex tasks requiring planning, tool use, and interaction with external services. Their reliance on untrusted external content exposes them to indirect prompt injection (IPI), in which adversarial instructions embedded in retrieved data hijack agent behavior. Existing attacks rely on static payloads that cannot adapt to agent-specific defenses; even recent adaptive methods lack structured feedback to guide optimization. We introduce oursys, a feedback-guided iterative framework that closes the loop between injection, diagnosis, and refinement: a rule-based diagnoser produces structured outcome labels with behavioral descriptions, and an LLM-based optimizer refines payloads conditioned on the full optimization history. A synthesis step generates new disguise seeds from failure patterns, enabling the strategy space to self-evolve. On AgentDojo and InjectAgent, oursys substantially outperforms static baselines and existing adaptive methods across four victim models. Extension experiments on Claude Code, a production-grade coding agent with layered defenses, show that optimized payloads achieve full success on 5 of 9 targets; even those that resist full exploitation exhibit measurable improvement from iterative refinement. We further present a mechanistic analysis of IPI, identifying an attention-mediated threshold mechanism in mid-to-late layers; three causal interventions validate this finding and point to concrete defense directions.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 11 of its 21 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

11 of 21 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats12 Mar
  2. 2025ChatInject: Abusing Chat Templates for Prompt Injection in LLM Agents26 Sep
  3. 2025EVA: Evolving Semantic Adversaries for Red-Teaming GUI Agents Against Environmental Injection Attacks20 May
  4. 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents17 Feb

Other references · 7

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  4. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  5. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  6. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  7. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Defense Against Indirect Prompt Injection via Tool Result Parsing
  2. 2026Assessing Automated Prompt Injection Attacks in Agentic Environments
  3. 2026Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment
  4. 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMs
  5. 2026Self-Reflection Fine-Tuning: Enhancing Agent Security against Prompt Injection Attacks from Failure Experience
  6. 2026INFUSE: A Unified Surface Benchmark for Indirect Prompt Injection in Agentic Systems
  7. 2026Learning to Inject: Automated Prompt Injection via Reinforcement Learning
  8. 2026Adaptive Evaluation of Out-of-Band Defenses Against Prompt Injection in LLM Agents