IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Large language model (LLM) agents are widely deployed in real-world applications, where they leverage tools to retrieve and manipulate external data for complex tasks. However, when interacting with untrusted data sources (e.g., fetching information from public websites), tool responses may contain injected instructions that covertly influence agent behaviors and lead to malicious outcomes, a threat referred to as Indirect Prompt Injection (IPI). Existing defenses typically rely on advanced prompting strategies or auxiliary detection models. While these methods have demonstrated some effectiveness, they fundamentally rely on assumptions about the model's inherent security, which lacks structural constraints on agent behaviors. As a result, agents still retain unrestricted access to tool invocations, leaving them vulnerable to stronger attack vectors that can bypass the security guardrails of the model. To prevent malicious tool invocations at the source, we propose a novel defensive task execution paradigm, called IPIGuard, which models the agents' task execution process as a traversal over a planned Tool Dependency Graph (TDG). By explicitly decoupling action planning from interaction with external data, IPIGuard significantly reduces unintended tool invocations triggered by injected instructions, thereby enhancing robustness against IPI attacks. Experiments on the AgentDojo benchmark show that IPIGuard achieves a superior balance between effectiveness and robustness, paving the way for the development of safer agentic systems in dynamic environments.
Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 11 of its 26 references that are in the map. First posted on arXiv 21 Aug 2025.
Builds on
11 of 26 references.
Closest ancestors · 3
Same direction, newest first
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb
- 2024The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agents21 Dec
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
Other references · 8
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267
- 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddingscited by 240
- 2025Can Indirect Prompt Injection Attacks Be Detected and Removed?cited by 52
Built on by
Citing papers per year: 2025: 4; 2026: 50.
54 papers.
Sort:
By area:
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 129
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 72
- 2026AttriGuard: Defeating Indirect Prompt Injection in LLM Agents via Causal Attribution of Tool Invocationscited by 38
- 2025Defending Against Prompt Injection with DataFiltercited by 35
- 2025MAGPIE: A benchmark for Multi-AGent contextual PrIvacy Evaluationcited by 29
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Surveycited by 28
- 2026Learning to Inject: Automated Prompt Injection via Reinforcement Learningcited by 16
- 2026A Framework for Formalizing LLM Agent Securitycited by 16
- 2026AgenTRIM: Tool Risk Mitigation for Agentic AIcited by 11
- 2026AgentSys: Secure and Dynamic LLM Agents Through Explicit Hierarchical Memory Managementcited by 10
- 2025Taxonomy, Evaluation and Exploitation of IPI-Centric LLM Agent Defense Frameworkscited by 9
- 2026SOK: A Taxonomy of Attack Vectors and Defense Strategies for Agentic Supply Chain Runtimecited by 8
38 more
- 2026Security Considerations for Artificial Intelligence Agentscited by 8
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injectioncited by 7
- 2026SafeAgent: A Runtime Protection Architecture for Agentic Systemscited by 7
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skillscited by 7
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 7
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden Statescited by 7
- 2026Evaluating Privilege Usage of Agents with Real-World Toolscited by 4
- 2026Web Agents Should Adopt the Plan-Then-Execute Paradigmcited by 4
- 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memorycited by 4
- 2026Agent-Fence: Mapping Security Vulnerabilities Across Deep Research Agentscited by 3
- 2026STARS: Skill-Triggered Audit for Request-Conditioned Invocation Safety in Agent Systemscited by 3
- 2026Think Twice Before You Act: Protecting LLM Agents Against Tool Description Poisoning via Isolated Planningcited by 3
- 2026AgentLens: Interpretable Safety Steering via Mechanistic Subspaces for Multi-Turn Coding Agentcited by 3
- 2026LLM-enabled Applications Require System-Level Threat Monitoringcited by 2
- 2026"I See What You Did There": Can Large Vision-Language Models Understand Multimodal Puns?cited by 2
- 2026Conjunctive Prompt Attacks in Multi-Agent LLM Systemscited by 2
- 2026SecureClaw: Clawing Back Control of LLM Agentscited by 2
- 2026EvoSafeHarness: Evolving Model- and Domain-Specific Harnesses for Securing Agentscited by 2
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectoriescited by 2
- 2026From Thinker to Society: Security in Hierarchical Autonomy Evolution of AI Agentscited by 1
- 2026CapSeal: Capability-Sealed Secret Mediation for Secure Agent Executioncited by 1
- 2026FinHarness: An Inline Lifecycle Safety Harness for Finance LLM Agentscited by 1
- 2026IssueTrojanBench: Benchmarking AI Coding Agents Against Malicious Issue Requestscited by 1
- 2026AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injectioncited by 1
- 2026Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifoldscited by 1
- 2026Silent Failures in Agentic Security Evaluation: A Validated Harness for Tool-Call Mediation Under Indirect Prompt Injectioncited by 1
- 2026SkillShield: Prompt-Space Security Skills for LLM Coding Agentscited by 0
- 2026When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agentscited by 0
- 2026Implicit Manipulation for Skill Selection in LLM Agents with Semantic Matchingcited by 0
- 2026DriftNet: A Dual-Head Trajectory Transformer for Detecting and Localizing Prompt Injection in LLM Agentscited by 0
- 2026ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agentscited by 0
- 2026Universal Defenses for Tool-Integrated LLM Agents Against Adversarial Attackscited by 0
- 2026Defusing Explosive Prompts: Understanding and Preventing Trigger-Based Prompt Injections in LLM Agentscited by 0
- 2026Control-Token Injection Suppresses Chain-of-Thought and Defeats Reasoning-Based Oversight in Tool-Using Agentscited by 0
- 2026ActionGuard: Tool Call Authorization under Poisoned Skillscited by 0
- 2026PACE: Provenance-Aware Capability Enforcement for Tool-Using LLM Agentscited by 0
- 2026Blocking at the Boundary: Auditing Long-Horizon Agents against Staged Prompt Injectioncited by 0
- 2026G-CARB: Graph-Localized Conformal Agent Risk Budget for Compositional Harmcited by 0
50 most cited of 54 All 54 (JSON)
- 2026BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views12 Oct 2026
- 2026From Acoustic Sensing to Physical Actions: A Comprehensive Survey of Security Risks in Edge-Deployed Audio LLM-Based Agents11 Oct 2026
- 2026Only What You've Signed up For: Secure Workflows with Constrained Diffusion Agents10 Oct 2026
- 2026G-CARB: Graph-Localized Conformal Agent Risk Budget for Compositional Harm4 Oct 2026
- 2026Blocking at the Boundary: Auditing Long-Horizon Agents against Staged Prompt Injection4 Oct 2026
- 2026APEX: Active Protection at Execution Boundaries for LLM Agents3 Oct 2026
- 2026PACE: Provenance-Aware Capability Enforcement for Tool-Using LLM Agents1 Oct 2026
- 2026ActionGuard: Tool Call Authorization under Poisoned Skills30 Sep 2026
- 2026Silent Failures in Agentic Security Evaluation: A Validated Harness for Tool-Call Mediation Under Indirect Prompt Injection26 Sep 2026
- 2026Control-Token Injection Suppresses Chain-of-Thought and Defeats Reasoning-Based Oversight in Tool-Using Agents23 Sep 2026
- 2026Defusing Explosive Prompts: Understanding and Preventing Trigger-Based Prompt Injections in LLM Agents18 Sep 2026
- 2026Universal Defenses for Tool-Integrated LLM Agents Against Adversarial Attacks14 Sep 2026
38 more
- 2026ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agents14 Sep 2026
- 2026DriftNet: A Dual-Head Trajectory Transformer for Detecting and Localizing Prompt Injection in LLM Agents9 Sep 2026
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories7 Sep 2026
- 2026EvoSafeHarness: Evolving Model- and Domain-Specific Harnesses for Securing Agents5 Sep 2026
- 2026Implicit Manipulation for Skill Selection in LLM Agents with Semantic Matching2 Sep 2026
- 2026When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents27 Aug 2026
- 2026SkillShield: Prompt-Space Security Skills for LLM Coding Agents26 Aug 2026
- 2026Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifolds23 Aug 2026
- 2026AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injection4 Aug 2026
- 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden States1 Aug 2026
- 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memory31 Jul 2026
- 2026IssueTrojanBench: Benchmarking AI Coding Agents Against Malicious Issue Requests22 Jul 2026
- 2026AgentLens: Interpretable Safety Steering via Mechanistic Subspaces for Multi-Turn Coding Agent21 Jun 2026
- 2026Think Twice Before You Act: Protecting LLM Agents Against Tool Description Poisoning via Isolated Planning18 Jun 2026
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation9 Jun 2026
- 2026SecureClaw: Clawing Back Control of LLM Agents8 Jun 2026
- 2026FinHarness: An Inline Lifecycle Safety Harness for Finance LLM Agents26 May 2026
- 2026Web Agents Should Adopt the Plan-Then-Execute Paradigm14 May 2026
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skills28 Apr 2026
- 2026SafeAgent: A Runtime Protection Architecture for Agentic Systems19 Apr 2026
- 2026CapSeal: Capability-Sealed Secret Mediation for Secure Agent Execution18 Apr 2026
- 2026Conjunctive Prompt Attacks in Multi-Agent LLM Systems17 Apr 2026
- 2026STARS: Skill-Triggered Audit for Request-Conditioned Invocation Safety in Agent Systems11 Apr 2026
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injection9 Apr 2026
- 2026"I See What You Did There": Can Large Vision-Language Models Understand Multimodal Puns?7 Apr 2026
- 2026Evaluating Privilege Usage of Agents with Real-World Tools30 Mar 2026
- 2026A Framework for Formalizing LLM Agent Security19 Mar 2026
- 2026Security Considerations for Artificial Intelligence Agents12 Mar 2026
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey11 Mar 2026
- 2026AttriGuard: Defeating Indirect Prompt Injection in LLM Agents via Causal Attribution of Tool Invocations11 Mar 2026
- 2026From Thinker to Society: Security in Hierarchical Autonomy Evolution of AI Agents8 Mar 2026
- 2026LLM-enabled Applications Require System-Level Threat Monitoring23 Feb 2026
- 2026SOK: A Taxonomy of Attack Vectors and Defense Strategies for Agentic Supply Chain Runtime23 Feb 2026
- 2026Agent-Fence: Mapping Security Vulnerabilities Across Deep Research Agents7 Feb 2026
- 2026AgentSys: Secure and Dynamic LLM Agents Through Explicit Hierarchical Memory Management7 Feb 2026
- 2026Learning to Inject: Automated Prompt Injection via Reinforcement Learning5 Feb 2026
- 2026AgenTRIM: Tool Risk Mitigation for Agentic AI18 Jan 2026
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedback15 Jan 2026
50 newest of 54 All 54 (JSON)
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 72
- 2026AttriGuard: Defeating Indirect Prompt Injection in LLM Agents via Causal Attribution of Tool Invocationscited by 38
- 2025MAGPIE: A benchmark for Multi-AGent contextual PrIvacy Evaluationcited by 29
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Surveycited by 28
- 2026Learning to Inject: Automated Prompt Injection via Reinforcement Learningcited by 16
- 2026A Framework for Formalizing LLM Agent Securitycited by 16
- 2026AgenTRIM: Tool Risk Mitigation for Agentic AIcited by 11
- 2026AgentSys: Secure and Dynamic LLM Agents Through Explicit Hierarchical Memory Managementcited by 10
- 2025Taxonomy, Evaluation and Exploitation of IPI-Centric LLM Agent Defense Frameworkscited by 9
- 2026SOK: A Taxonomy of Attack Vectors and Defense Strategies for Agentic Supply Chain Runtimecited by 8
- 2026SafeAgent: A Runtime Protection Architecture for Agentic Systemscited by 7
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 7
12 most cited of 42 All 42 (JSON)
- 2026From Acoustic Sensing to Physical Actions: A Comprehensive Survey of Security Risks in Edge-Deployed Audio LLM-Based Agents11 Oct 2026
- 2026G-CARB: Graph-Localized Conformal Agent Risk Budget for Compositional Harm4 Oct 2026
- 2026APEX: Active Protection at Execution Boundaries for LLM Agents3 Oct 2026
- 2026PACE: Provenance-Aware Capability Enforcement for Tool-Using LLM Agents1 Oct 2026
- 2026ActionGuard: Tool Call Authorization under Poisoned Skills30 Sep 2026
- 2026Silent Failures in Agentic Security Evaluation: A Validated Harness for Tool-Call Mediation Under Indirect Prompt Injection26 Sep 2026
- 2026Control-Token Injection Suppresses Chain-of-Thought and Defeats Reasoning-Based Oversight in Tool-Using Agents23 Sep 2026
- 2026Defusing Explosive Prompts: Understanding and Preventing Trigger-Based Prompt Injections in LLM Agents18 Sep 2026
- 2026Universal Defenses for Tool-Integrated LLM Agents Against Adversarial Attacks14 Sep 2026
- 2026ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agents14 Sep 2026
- 2026DriftNet: A Dual-Head Trajectory Transformer for Detecting and Localizing Prompt Injection in LLM Agents9 Sep 2026
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories7 Sep 2026
12 newest of 42 All 42 (JSON)
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 129
- 2025Defending Against Prompt Injection with DataFiltercited by 35
- 2026Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifoldscited by 1
- 2026Blocking at the Boundary: Auditing Long-Horizon Agents against Staged Prompt Injectioncited by 0
- 2026BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Viewscited by 0
- 2026BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views12 Oct 2026
- 2026Blocking at the Boundary: Auditing Long-Horizon Agents against Staged Prompt Injection4 Oct 2026
- 2026Beyond Over-Refusal: Defending Indirect Prompt Injection via Latent Instruction Manifolds23 Aug 2026
- 2025Defending Against Prompt Injection with DataFilter22 Oct 2025
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injections10 Oct 2025
- 2026Security Considerations for Artificial Intelligence Agentscited by 8
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injectioncited by 7
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skillscited by 7
- 2026LLM-enabled Applications Require System-Level Threat Monitoringcited by 2
- 2026CapSeal: Capability-Sealed Secret Mediation for Secure Agent Executioncited by 1
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skills28 Apr 2026
- 2026CapSeal: Capability-Sealed Secret Mediation for Secure Agent Execution18 Apr 2026
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injection9 Apr 2026
- 2026Security Considerations for Artificial Intelligence Agents12 Mar 2026
- 2026LLM-enabled Applications Require System-Level Threat Monitoring23 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis
- 2026ClawGuard: A Runtime Security Framework for Tool-Augmented LLM Agents Against Indirect Prompt Injection
- 2026AgentSentry: Mitigating Indirect Prompt Injection in LLM Agents via Temporal Causal Diagnostics and Context Purification
- 2026Defense Against Indirect Prompt Injection via Tool Result Parsing
- 2026PlanGuard: Defending Agents against Indirect Prompt Injection via Planning-based Consistency Verification
- 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMs
- 2026ARGUS: Defending LLM Agents Against Context-Aware Prompt Injection
- 2025Mitigating Indirect Prompt Injection via Instruction-Following Intent Analysis