ARGUS: Defending LLM Agents Against Context-Aware Prompt Injection
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Large Language Model (LLM) agents are increasingly deployed as task-oriented software systems that use runtime context to decide and act on behalf of users. This delegation model makes prompt injection especially dangerous: an attacker can hide a context-aware instruction inside evidence the agent must use to decide what to do. Existing benchmarks and defenses largely miss this setting. Benchmarks often use context-insensitive tasks where the user prompt already specifies the intended action, together with generic attack payloads independent of context. Existing defenses also do not capture the causal support from runtime evidence to concrete actions, which makes them incomplete and ineffective for context-dependent tasks. We present AgentLure, a benchmark for context-dependent tasks under context-aware prompt injection. AgentLure spans four agentic domains and eight attack vectors across six attack surfaces. To defend this setting, we propose ARGUS, a causal-provenance auditor for LLM agents. Instead of relying only on tool authorization or suspicious-context detection, ARGUS verifies whether each proposed action has a complete benign causal justification. It builds an influence-provenance graph, labels runtime spans, grounds action arguments in supporting evidence, and releases an action only when benign evidence entails it and task invariants hold. On AgentLure, ARGUS reduces attack success rate from 28.8% to 3.8% while preserving 87.5% clean utility, significantly outperforming existing defenses in the security-utility tradeoff.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 56 of its 73 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
56 of 73 references.
Closest ancestors · 19
Same direction, newest first
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks23 Feb
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis11 Feb
- 2025DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agents13 Jun
- 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
- 2025Defeating Prompt Injections by Design24 Mar
- 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
- 2025Multi-Agent Systems Execute Arbitrary Malicious Code15 Mar
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb
- 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
- 2025MELON: Provable Defense Against Indirect Prompt Injection Attacks in AI Agents7 Feb
- 2024The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agents21 Dec
7 more
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systems8 Mar
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep
Other references · 37
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 738
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
25 more
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 237
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 179
- 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
- 2025Securing AI Agents with Information-Flow Controlcited by 108
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
- 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuningcited by 89
- 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectoriescited by 75
- 2024LegalAgentBench: Evaluating LLM Agents in Legal Domaincited by 56
- 2025Contextual Agent Security: A Policy for Every Purposecited by 55
- 2025ACE: A Security Architecture for LLM-Integrated App Systemscited by 52
- 2024You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projectscited by 45
- 2024Human-In-the-Loop Software Development Agentscited by 42
- 2024InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail Modelscited by 36
- 2025PROV-AGENT: Unified Provenance for Tracking AI Agent Interactions in Agentic Workflowscited by 29
- 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Taskscited by 20
- 2024StackEval: Benchmarking LLMs in Coding Assistancecited by 14
- 2024Watson: A Cognitive Observability Framework for the Reasoning of LLM-Powered Agentscited by 8
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026AIRGuard: Guarding Agent Actions with Runtime Authority Controlcited by 9
- 2026Context-to-Execution Integrity for LLM Agentscited by 7
- 2026CONTINUITY: Security-Context Contracts for Composable LLM Agent Controlscited by 3
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 2
- 2026ActGov: Governing LLM Agent Actions via Policy-Constrained Validationcited by 1
- 2026An Empirical Study of Privacy Leakage Chains via Prompt Injection in Black-Box Chatbot Environmentscited by 0
- 2026The Balkanization of Execution-Security Research for AI Coding Agents: Isolation, Access Control, and Time-of-Check-to-Time-of-Use Vulnerabilitiescited by 0
- 2026AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injectioncited by 0
- 2026PromptShield Home: Ambient Multimodal Prompt Injection Defense for Smart-Home Agentscited by 0
- 2026Influence Is Not Authority: When Causal Guardrail Signals Make Legitimate Tool Use Look Like an Attack in Tool-Using LLM Agentscited by 0
- 2026Skill-as-API: Confidential Multi-Agent Coordination for Agentic Software Engineeringcited by 0
- 2026Certified Multi-Source Integrity for Structured Agent Actionscited by 0
- 2026Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems30 Sep 2026
- 2026Certified Multi-Source Integrity for Structured Agent Actions28 Sep 2026
- 2026ActGov: Governing LLM Agent Actions via Policy-Constrained Validation21 Sep 2026
- 2026CONTINUITY: Security-Context Contracts for Composable LLM Agent Controls4 Sep 2026
- 2026Skill-as-API: Confidential Multi-Agent Coordination for Agentic Software Engineering1 Sep 2026
- 2026Influence Is Not Authority: When Causal Guardrail Signals Make Legitimate Tool Use Look Like an Attack in Tool-Using LLM Agents30 Aug 2026
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026PromptShield Home: Ambient Multimodal Prompt Injection Defense for Smart-Home Agents6 Aug 2026
- 2026AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injection4 Aug 2026
- 2026Context-to-Execution Integrity for LLM Agents7 Jul 2026
- 2026The Balkanization of Execution-Security Research for AI Coding Agents: Isolation, Access Control, and Time-of-Check-to-Time-of-Use Vulnerabilities7 Jul 2026
- 2026AIRGuard: Guarding Agent Actions with Runtime Authority Control27 May 2026
- 2026AIRGuard: Guarding Agent Actions with Runtime Authority Controlcited by 9
- 2026Context-to-Execution Integrity for LLM Agentscited by 7
- 2026CONTINUITY: Security-Context Contracts for Composable LLM Agent Controlscited by 3
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 2
- 2026ActGov: Governing LLM Agent Actions via Policy-Constrained Validationcited by 1
- 2026The Balkanization of Execution-Security Research for AI Coding Agents: Isolation, Access Control, and Time-of-Check-to-Time-of-Use Vulnerabilitiescited by 0
- 2026AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injectioncited by 0
- 2026Influence Is Not Authority: When Causal Guardrail Signals Make Legitimate Tool Use Look Like an Attack in Tool-Using LLM Agentscited by 0
- 2026Skill-as-API: Confidential Multi-Agent Coordination for Agentic Software Engineeringcited by 0
- 2026Certified Multi-Source Integrity for Structured Agent Actionscited by 0
- 2026Certified Multi-Source Integrity for Structured Agent Actions28 Sep 2026
- 2026ActGov: Governing LLM Agent Actions via Policy-Constrained Validation21 Sep 2026
- 2026CONTINUITY: Security-Context Contracts for Composable LLM Agent Controls4 Sep 2026
- 2026Skill-as-API: Confidential Multi-Agent Coordination for Agentic Software Engineering1 Sep 2026
- 2026Influence Is Not Authority: When Causal Guardrail Signals Make Legitimate Tool Use Look Like an Attack in Tool-Using LLM Agents30 Aug 2026
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injection4 Aug 2026
- 2026Context-to-Execution Integrity for LLM Agents7 Jul 2026
- 2026The Balkanization of Execution-Security Research for AI Coding Agents: Isolation, Access Control, and Time-of-Check-to-Time-of-Use Vulnerabilities7 Jul 2026
- 2026AIRGuard: Guarding Agent Actions with Runtime Authority Control27 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026AgentSentry: Mitigating Indirect Prompt Injection in LLM Agents via Temporal Causal Diagnostics and Context Purification
- 2026AgentVisor: Defending LLM Agents Against Prompt Injection via Semantic Virtualization
- 2025SIEVE: Selective Integrity Verification and Escalation for Defending LLM Agents against Indirect Prompt Injection
- 2026ContextLeak: Exfiltrating LLM Agent Context via Malicious Tools
- 2025IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents
- 2026A Framework for Formalizing LLM Agent Security
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
- 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injection