mlsanityData to 14 Oct 2026

Send a SCOUT First: Pre-hoc Reasoning for Adaptive Detector Allocation in Prompt-Injection Defense

arXiv 2605.30837 ↗First posted 29 May 2026cs.CR cs.LGcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Prompt-injection detectors are heterogeneous: each is strong on a different slice of attacks, and none is always reliable. Yet existing systems still treat detection as a fixed single-detector pipeline, committing every request to one detector's blind spots. We reframe defense as detector allocation: given a heterogeneous pool, decide per request which detectors to run and whether to escalate to an LLM judge. Our framework SCOUT (Scalable and Controllable Outcome-prediction for Uncertainty-aware Triage) makes this decision dynamic by predicting each detector's per-sample reliability and latency from how it behaved on similar past inputs, and exposes a single safety-utility threshold to the operator (where utility bundles benign-pass rate and wall-clock). To evaluate this setting, we build SCOUT-450, a benchmark that captures the structurally complex, agent-facing injections that older prompt-injection sets under-represent. On SCOUT-450, a safety-oriented operating point reduces attack-success rate by 46% and total wall-clock by 40% relative to an always-on GPT-4o judge, at a 5.1-point benign-utility drop. SCOUT also transfers to three external benchmarks (BIPIA, IPI, and IHEval), improving the safety-utility frontier.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 24 of its 58 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

24 of 58 references.

References · 24

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  7. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  8. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  9. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  10. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  11. 2025OpenAI GPT-5 System Cardcited by 989
  12. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
12 more
  1. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  2. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  3. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
  4. 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agentscited by 24
  5. 2025On the Impossibility of Separating Intelligence from Judgment: The Computational Intractability of Filtering for AI Alignmentcited by 12
  6. 2025A Multi-Agent LLM Defense Pipeline Against Prompt Injection Attackscited by 11
  7. 2025PromptSleuth: Detecting Prompt Injection via Semantic Intent Invariancecited by 8
  8. 2026AlignSentinel: Alignment-Aware Detection of Prompt Injection Attackscited by 5
  9. 2026Models Under SCOPE: Scalable and Controllable Routing via Pre-hoc Reasoningcited by 4
  10. 2026Trust The Typicalcited by 3
  11. 2026Prompt Attack Detection with LLM-as-a-Judge and Mixture-of-Modelscited by 1
  12. 2026Layerwise Convergence Fingerprints for Runtime Misbehavior Detection in Large Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RedVisor: Reasoning-Aware Prompt Injection Defense via Zero-Copy KV Cache Reuse
  2. 2026Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment
  3. 2026Adaptive Evaluation of Out-of-Band Defenses Against Prompt Injection in LLM Agents
  4. 2026BASIS: Breach-Aware Selective Prompt Injection Shielding with Prefill Attention Probes
  5. 2026Passing the Test You Trained On: Re-evaluating Prompt-Injection Detectors for LLM Agents
  6. 2026The Price of Safety: Benign-Case Utility and Token Overhead of Memory-Poisoning Defenses in LLM Agents
  7. 2025PromptShield: Deployable Detection for Prompt Injection Attacks
  8. 2026ZERO-APT: A Closed-Loop Adversarial Framework for LLM-Driven Automated Penetration Testing under Intelligent Defense ↗