mlsanityData to 7 Oct 2026

AttriGuard: Defeating Indirect Prompt Injection in LLM Agents via Causal Attribution of Tool Invocations

arXiv 2603.10749 ↗First posted 11 Mar 2026cs.CRcited by 33

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

LLM agents are highly vulnerable to Indirect Prompt Injection (IPI), where adversaries embed malicious directives in untrusted tool outputs to hijack execution. Most existing defenses treat IPI as an input-level semantic discrimination problem, which often fails to generalize to unseen payloads. We propose a new paradigm, action-level causal attribution, which secures agents by asking why a particular tool call is produced. The central goal is to distinguish tool calls supported by the user's intent from those causally driven by untrusted observations. We instantiate this paradigm with AttriGuard, a runtime defense based on parallel counterfactual tests. For each proposed tool call, AttriGuard verifies its necessity by re-executing the agent under a control-attenuated view of external observations. Technically, AttriGuard combines teacher-forced shadow replay to prevent attribution confounding, hierarchical control attenuation to suppress diverse control channels while preserving task-relevant information, and a fuzzy survival criterion that is robust to LLM stochasticity. Across four LLMs and two agent benchmarks, AttriGuard achieves 0% ASR under static attacks with negligible utility loss and moderate overhead. Importantly, it remains resilient under adaptive optimization-based attacks in settings where leading defenses degrade significantly.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 48 of its 67 references that are in the map. First posted on arXiv 11 Mar 2026.

Builds on

48 of 67 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025Soft Instruction De-escalation Defense24 Oct
  2. 2025IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents21 Aug
  3. 2025MCPSecBench: A Systematic Security Benchmark and Playground for Testing Model Context Protocols17 Aug
  4. 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
  5. 2025LlamaFirewall: An open source guardrail system for building secure AI agents6 May
  6. 2025Defeating Prompt Injections by Design24 Mar
  7. 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb
  8. 2025MELON: Provable Defense Against Indirect Prompt Injection Attacks in AI Agents7 Feb
  9. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  10. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  11. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  12. 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents19 Jun
2 more
  1. 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systems8 Mar
  2. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 34

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  8. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  9. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  10. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  11. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  12. 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 568
22 more
  1. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 457
  2. 2015Illuminating search spaces by mapping elitescited by 406
  3. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
  4. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
  5. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
  6. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
  7. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
  8. 2023Mitigating the Alignment Tax of RLHFcited by 181
  9. 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 179
  10. 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Gamecited by 135
  11. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
  12. 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
  13. 2021Measure and Improve Robustness in NLP Models: A Surveycited by 107
  14. 2024System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspectivecited by 91
  15. 2024Neural Exec: Learning (and Learning from) Execution Triggers for Prompt Injection Attackscited by 78
  16. 2024Get my drift? Catching LLM Task Drift with Activation Deltascited by 61
  17. 2023Assessing Prompt Injection Risks in 200+ Custom GPTscited by 49
  18. 2025Lessons from Defending Gemini Against Indirect Prompt Injectionscited by 40
  19. 2025EchoLeak: The First Real-World Zero-Click Prompt Injection Exploit in a Production LLM Systemcited by 26
  20. 2025Defending against Indirect Prompt Injection by Instruction Detectioncited by 25
  21. 2025ETDI: Mitigating Tool Squatting and Rug Pull Attacks in Model Context Protocol (MCP) by using OAuth-Enhanced Tool Definitions and Policy-Based Access Controlcited by 18
  22. 2025Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Reviewcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 33.

33 papers.

Sort:

By area:

  1. 2026How Your Credentials Are Leaked by LLM Agent Skills: An Empirical Studycited by 14
  2. 2026AIRGuard: Guarding Agent Actions with Runtime Authority Controlcited by 9
  3. 2026Auditing Provenance Sensitivity in LLM Agent Action Selectioncited by 9
  4. 2026SoK: Security of Autonomous LLM Agents in Agentic Commercecited by 8
  5. 2026Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agentscited by 8
  6. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
  7. 2026Long-Horizon Agent Trajectory Attribution: A Unified Benchmark and Fine-Grained Annotation Frameworkcited by 4
  8. 2026Intent-Governed Tool Authorization for AI Agentscited by 3
  9. 2026Your Agentic LLMs Secretly Encode Indirect Prompt-Injection Exposure in Hidden Statescited by 3
  10. 2026ASPI: Seeking Ambiguity Clarification Amplifies Prompt Injection Vulnerability in LLM Agentscited by 1
  11. 2026Isolation as a First-Class Principle for LLM-Agent System Safety: Concepts, Taxonomy, Challenges and Future Directionscited by 1
  12. 2026ToolGuardian: Declarative Security for AI Agent-Tool Interactionscited by 1
21 more
  1. 2026Explanation-Bound Tool Execution for AI Agents: Server-Verified Action Claims Without Trusting Model Rationalescited by 1
  2. 2026Authorization Before Context: A Model-Neutral Audience Boundary Against Cross-Audience Memory Leakage in Agentic Systemscited by 1
  3. 2026Reachability-Based Capability Confinement for LLM Agents under Indirect Prompt Injectioncited by 1
  4. 2026Misleading the Planner through Deceptive Resumes: Registration-Time Injection in Centralized Multi-Agent Systemscited by 1
  5. 2026Depth-Dependent Indirect Prompt Injection in Tool-Calling ReAct Agents: Injection Depth, Payload Framing, and Turn-Budget Sensitivitycited by 0
  6. 2026Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across LLM Agentscited by 0
  7. 2026ContainmentBench: Trace-Based Evaluation of Post-Exposure Containment in Tool-Using LLM Agentscited by 0
  8. 2026AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injectioncited by 0
  9. 2026ActBench: Self-Evolving Benchmark of Behavioral Safety in Cowork Agentscited by 0
  10. 2026WebMCP-Phalanx: Enforcing and Characterizing Trust Boundaries for Browser-Integrated LLM Agentscited by 0
  11. 2026Influence Is Not Authority: When Causal Guardrail Signals Make Legitimate Tool Use Look Like an Attack in Tool-Using LLM Agentscited by 0
  12. 2026Causal Attribution for Agentic Decisions: Estimators, Coupling, and a Traceability Specificationcited by 0
  13. 2026DriftNet: A Dual-Head Trajectory Transformer for Detecting and Localizing Prompt Injection in LLM Agentscited by 0
  14. 2026ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agentscited by 0
  15. 2026TwinCheck: Evidence-Grounded Negative-Twin Verification for Stateful Tool Agentscited by 0
  16. 2026ChronosAttack: Adversarial Tool Scheduling Attacks on LLM Agentscited by 0
  17. 2026Auditing Agent Actions through Query-Conditioned Attributioncited by 0
  18. 2026SEAD: A State-Based Perspective on Attack and Defense in Tool-Using Agentscited by 0
  19. 2026When Valid Tool Calls Change Meaning: Formation-Consistent Dispatch for LLM Agentscited by 0
  20. 2026Reliability Engineering for AI Systems: Challenges, Methods, and Directionscited by 0
  21. 2026ActionGuard: Tool Call Authorization under Poisoned Skillscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026CausalArmor: Efficient Indirect Prompt Injection Guardrails via Causal Attribution
  2. 2026AgentSentry: Mitigating Indirect Prompt Injection in LLM Agents via Temporal Causal Diagnostics and Context Purification
  3. 2026Silent Failures in Agentic Security Evaluation: A Validated Harness for Tool-Call Mediation Under Indirect Prompt Injection
  4. 2026Defense Against Indirect Prompt Injection via Tool Result Parsing
  5. 2026AgentSecBench: Measuring Prompt Injection, Privacy Leakage, and Tool-Use Integrity in LLM Agents
  6. 2026ROPE: Routed Origin Policy Enforcement against Indirect Prompt Injection
  7. 2026CounterSteer: Suppressing Indirect Prompt Injection with Activation Steering
  8. 2026ARGUS: Defending LLM Agents Against Context-Aware Prompt Injection