mlsanityData to 7 Oct 2026

ARGUS: Defending LLM Agents Against Context-Aware Prompt Injection

arXiv 2605.03378 ↗First posted 5 May 2026cs.CR cs.SEcited by 13

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Large Language Model (LLM) agents are increasingly deployed as task-oriented software systems that use runtime context to decide and act on behalf of users. This delegation model makes prompt injection especially dangerous: an attacker can hide a context-aware instruction inside evidence the agent must use to decide what to do. Existing benchmarks and defenses largely miss this setting. Benchmarks often use context-insensitive tasks where the user prompt already specifies the intended action, together with generic attack payloads independent of context. Existing defenses also do not capture the causal support from runtime evidence to concrete actions, which makes them incomplete and ineffective for context-dependent tasks. We present AgentLure, a benchmark for context-dependent tasks under context-aware prompt injection. AgentLure spans four agentic domains and eight attack vectors across six attack surfaces. To defend this setting, we propose ARGUS, a causal-provenance auditor for LLM agents. Instead of relying only on tool authorization or suspicious-context detection, ARGUS verifies whether each proposed action has a complete benign causal justification. It builds an influence-provenance graph, labels runtime spans, grounds action arguments in supporting evidence, and releases an action only when benign evidence entails it and task invariants hold. On AgentLure, ARGUS reduces attack success rate from 28.8% to 3.8% while preserving 87.5% clean utility, significantly outperforming existing defenses in the security-utility tradeoff.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 56 of its 73 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

56 of 73 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks23 Feb
  2. 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis11 Feb
  3. 2025DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agents13 Jun
  4. 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
  5. 2025Defeating Prompt Injections by Design24 Mar
  6. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
  7. 2025Multi-Agent Systems Execute Arbitrary Malicious Code15 Mar
  8. 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
  9. 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb
  10. 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
  11. 2025MELON: Provable Defense Against Indirect Prompt Injection Attacks in AI Agents7 Feb
  12. 2024The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agents21 Dec
7 more
  1. 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems9 Oct
  2. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  3. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
  4. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  5. 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systems8 Mar
  6. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
  7. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 37

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  5. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  6. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  7. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
  8. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  9. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  10. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 738
  11. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
  12. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
25 more
  1. 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
  2. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  3. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
  4. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
  5. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
  6. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
  7. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 237
  8. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
  9. 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 179
  10. 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
  11. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
  12. 2025Securing AI Agents with Information-Flow Controlcited by 108
  13. 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
  14. 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuningcited by 89
  15. 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectoriescited by 75
  16. 2024LegalAgentBench: Evaluating LLM Agents in Legal Domaincited by 56
  17. 2025Contextual Agent Security: A Policy for Every Purposecited by 55
  18. 2025ACE: A Security Architecture for LLM-Integrated App Systemscited by 52
  19. 2024You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projectscited by 45
  20. 2024Human-In-the-Loop Software Development Agentscited by 42
  21. 2024InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail Modelscited by 36
  22. 2025PROV-AGENT: Unified Provenance for Tracking AI Agent Interactions in Agentic Workflowscited by 29
  23. 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Taskscited by 20
  24. 2024StackEval: Benchmarking LLMs in Coding Assistancecited by 14
  25. 2024Watson: A Cognitive Observability Framework for the Reasoning of LLM-Powered Agentscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentSentry: Mitigating Indirect Prompt Injection in LLM Agents via Temporal Causal Diagnostics and Context Purification
  2. 2026AgentVisor: Defending LLM Agents Against Prompt Injection via Semantic Virtualization
  3. 2025SIEVE: Selective Integrity Verification and Escalation for Defending LLM Agents against Indirect Prompt Injection
  4. 2026ContextLeak: Exfiltrating LLM Agent Context via Malicious Tools
  5. 2025IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents
  6. 2026A Framework for Formalizing LLM Agent Security
  7. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
  8. 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injection