mlsanityData to 14 Oct 2026

The Framing Gap: Indirect Prompt-Injection Exfiltration Defeats Surface-Level Defenses in Tool-Using Agents

arXiv 2608.27092 ↗First posted 27 Aug 2026cs.CRcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

A tool-using LLM agent that reads attacker-controlled web content while holding a secret faces indirect prompt injection: the content may make it exfiltrate the secret. In a safe synthetic lab (canary secret, mock tools, matched clean-vs-poisoned metric) we report the framing gap: across six models, ten overt injection classes are refused (gpt-4o 0%), but reframing the identical leak as a mandatory integrity signature, config field, or look-alike "trusted" host drives gpt-4o 0% to 100%. The attack is cheap, and its cost is three-level: paraphrasing a known mechanism is trivial (96% at 3 wordings), swapping the field inside a known-effective template is also cheap (up to 60%), while authoring a fresh page around a new mechanism is hard (0/130) -- the reusable asset is the template, not the mechanism. An ablation shows the mechanism is instruction/data confusion, not defeated alignment: removing the confidentiality policy leaves base attacks at 0% and moves reframing only 31.9% to 38.1%. What closes the gap is payload-blind checks: a destination allow-list (0%, when destinations are closed) and a capability-isolating planner/reader split (0%). A broad "in any form" policy clause also closes it at the acting model (to 0%) but is brittle (dropping the catch-all reopens it to 48.8%). A published fine-tuning defense (SecAlign, CCS 2025) does not close it on a tool agent (32.5%, positive-control-validated), nor does channel separation (38.8%); an output-normalizing guard loses to a held-out encoding (ROT13, 100%). Robustness comes from constraining the destination or isolating the capability, not from the acting model recognizing the attack.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 15 of its 20 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

15 of 20 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Your Agent's Memories Are Not Its Own: Forged Reasoning Attacks on LLM Agent Memory and Defenses6 Jul
  2. 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents27 Feb
  3. 2025RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage13 Feb
  4. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  5. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 10

  1. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  2. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  3. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  4. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
  5. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
  6. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  7. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
  8. 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 210
  9. 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Gamecited by 145
  10. 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuningcited by 106

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Silent Failures in Agentic Security Evaluation: A Validated Harness for Tool-Call Mediation Under Indirect Prompt Injection
  2. 2026Agent Privilege Separation in OpenClaw: A Structural Defense Against Prompt Injection
  3. 2026Depth-Dependent Indirect Prompt Injection in Tool-Calling ReAct Agents: Injection Depth, Payload Framing, and Turn-Budget Sensitivity
  4. 2026NetInjectBench: Benchmarking Indirect Prompt Injection in Tool-Using Large Language Model Agents for Network Operations
  5. 2026Silent Egress: When Implicit Prompt Injection Makes LLM Agents Leak Without a Trace
  6. 2026ROPE: Routed Origin Policy Enforcement against Indirect Prompt Injection
  7. 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMs
  8. 2026The Surface You Test Is Not the Surface That Breaks