mlsanityData to 14 Oct 2026

Evaluating Prompting-Based Defenses Against Domain-Camouflaged Injection Attacks

arXiv 2606.18530 ↗First posted 16 Jun 2026cs.CR cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Domain-camouflaged injection attacks embed malicious instructions in retrieved content using domain-appropriate vocabulary, evading standard detectors that rely on syntactic injection markers. When detection fails, practitioners need to know which defense architectures reduce attack success. We evaluate five prompting-based defenses (spotlighting, paraphrasing, prompt sandwiching, and two combinations) against domain-camouflaged injection across three model families (Claude Haiku, Llama 3.1 8B, Gemini 2.0 Flash) and three deployment domains (financial, legal, general) using 3,510 trials. Paraphrasing retrieved content before agent processing is the most consistently effective defense in this benchmark, reducing camouflage attack success rate by 55-84% depending on model, and achieves lower attack success rates than our Llama Guard 4 configuration on every model tested. Defense effectiveness is strongly model-dependent: spotlighting halves attack success on Claude Haiku but provides no benefit on Llama 3.1 8B. Financial domain deployments face the highest residual risk at 26-33% baseline attack success rate, with no prompting-based defense fully eliminating the threat on weaker models. These results provide the first systematic evaluation of prompting-based defenses specifically against camouflage-class injection attacks and establish benchmark-based recommendations for practitioners. All tasks use synthetically constructed professional documents; whether these benchmark rankings generalize to real enterprise documents remains an open question.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 12 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

6 of 12 references.

References · 6

  1. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  2. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  3. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
  4. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
  5. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  6. 2026Blind Spots in the Guard: How Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systemscited by 3

Built on by

Not cited yet.