mlsanityData to 14 Oct 2026

Blocking at the Boundary: Auditing Long-Horizon Agents against Staged Prompt Injection

arXiv 2610.05163 ↗First posted 4 Oct 2026cs.CR cs.AIcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Long-horizon agents consume external content, invoke tools, and modify persistent state. Indirect prompt injection can exploit task-specific context, propagate across causally connected stages, and alter a consequential action while the workflow continues; we term this staged prompt injection. We build an automated, feedback-guided attack generation pipeline and apply it to Claude Code and Codex in their native runtimes. The confirmed attacks span eight workflow scenarios, seven attack goals, and six injection surfaces, showing that production agents are vulnerable to context-aware, multi-step injection over long horizons. Stopping such attacks requires a decision before each consequential action: input screening and completed-run evaluation cannot locate the intervention point, and existing pre-action methods use incompatible units and labels. We therefore formulate boundary action auditing: given initial context, a trajectory prefix, and a fully specified pending message or tool call, an auditor predicts Pass or Block before its effect occurs. Pairing attacked and benign executions yields a 479-pair, 3,112-unit benchmark. We further propose Path-Aligned Attribution (PAA), a training-free auditor that decomposes pending actions into operative elements and traces what supplied each value and guided each decision. PAA blocks only when the model attributes an unwarranted, material effect on an element to an attacker-reachable source that either provides unqualified steering or conflicts with visible evidence. Under full-benchmark fail-open scoring with Claude Sonnet 5, PAA reaches 86% Block recall at a 6-8% false-block rate (FBR), whereas ARGUS reaches 44-47% recall at 16-33% FBR. Under the same backend, on the tool calls that all three auditors natively support, PAA has higher recall and lower FBR than VIGIL and ARGUS; all paired 95% confidence intervals exclude zero.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 61 of its 76 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

61 of 76 references.

Closest ancestors · 37

Same direction, newest first

  1. 2026StepJack: Benchmarking Computer-Use Agent Safety Against Multi-Step Indirect Prompt Injection6 Aug
  2. 2026PI-Hunter: Automated Red-Teaming for Exposing and Localizing Prompt Injections10 Jun
  3. 2026Assessing Automated Prompt Injection Attacks in Agentic Environments9 Jun
  4. 2026From Prompt Injection to Persistent Control: Defending Agentic Harness Against Trojan Backdoors29 May
  5. 2026AgentSecBench: Measuring Prompt Injection, Privacy Leakage, and Tool-Use Integrity in LLM Agents25 May
  6. 2026IterInject: Indirect Prompt Injection Against LLM Agents via Feedback-Guided Iterative Optimization23 May
  7. 2026ARGUS: Defending LLM Agents Against Context-Aware Prompt Injection5 May
  8. 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Security26 Jan
  9. 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedback15 Jan
  10. 2026VIGIL: Defending LLM Agents Against Tool Stream Injection via Verify-Before-Commit9 Jan
  11. 2025IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents21 Aug
  12. 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injection2 Aug
25 more
  1. 2025Design Patterns for Securing LLM Agents against Prompt Injections10 Jun
  2. 2025LlamaFirewall: An open source guardrail system for building secure AI agents6 May
  3. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  4. 2025Progent: Securing AI Agents with Privilege Control16 Apr
  5. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attacks15 Apr
  6. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
  7. 2025Defeating Prompt Injections by Design24 Mar
  8. 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb
  9. 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection17 Feb
  10. 2025MELON: Provable Defense Against Indirect Prompt Injection Attacks in AI Agents7 Feb
  11. 2024The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agents21 Dec
  12. 2024Attention Tracker: Detecting Prompt Injection Attacks in LLMs1 Nov
  13. 2024SecAlign: Defending Against Prompt Injection with Preference Optimization7 Oct
  14. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  15. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  16. 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning13 Jun
  17. 2024Get my drift? Catching LLM Task Drift with Activation Deltas2 Jun
  18. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions19 Apr
  19. 2024Defending Against Indirect Prompt Injection Attacks With Spotlighting20 Mar
  20. 2024Neural Exec: Learning (and Learning from) Execution Triggers for Prompt Injection Attacks6 Mar
  21. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
  22. 2024StruQ: Defending Against Prompt Injection with Structured Queries9 Feb
  23. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defenses19 Oct
  24. 2023Prompt Injection attack against LLM-integrated Applications8 Jun
  25. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb

Other references · 24

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  4. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  6. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  7. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
  8. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agentscited by 306
  9. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 288
  10. 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 144
  11. 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systemscited by 130
  12. 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 129
12 more
  1. 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agentscited by 90
  2. 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 84
  3. 2020Loghub: A Large Collection of System Log Datasets for AI-driven Log Analyticscited by 70
  4. 2024Imprompter: Tricking LLM Agents into Improper Tool Usecited by 68
  5. 2026AgentDyn: Are Your Agent Security Defenses Deployable in Real-World Dynamic Environments?cited by 59
  6. 2024WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Settingcited by 53
  7. 2024Navigating the OverKill in Large Language Modelscited by 44
  8. 2026AgentLAB: Benchmarking LLM Agents against Long-Horizon Attackscited by 39
  9. 2019The TechQA Datasetcited by 30
  10. 2026TraceSafe: A Systematic Assessment of LLM Guardrails on Multi-Step Tool-Calling Trajectoriescited by 16
  11. 2026Auditing Provenance Sensitivity in LLM Agent Action Selectioncited by 12
  12. 2026TRACES: Proactive Safety Auditing for Multi-Turn LLM Agents via Trajectory-State Modelingcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agents
  2. 2026Boundary-State Control for Tool-Using Language-Model Agents: Commit-Time Consistency under State Drift
  3. 2026When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents
  4. 2026Injection-Execution Dissociation: A Mechanistic Evaluation of Persistent Memory Attacks and Defenses in Stateful LLM Agents
  5. 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories
  6. 2026Agent Flight Recorder: Tamper-Evident Audit Trails with On-Chain Anchoring for Long-Horizon Tool-Using Agents
  7. 2026What If Prompt Injection Never Left? Rethinking Agent Security through Cross-Session Stored Prompt Injection
  8. 2026ECLIPSE: Self-Evolving Stealthy Prompt Injection Attack against Long-Horizon Agentic Systems