Which Defense Closes Which Threat? Attributing OWASP-LLM-Top-10 Coverage and Its Brittleness Under Paraphrasing
Not on the map. Why?
Abstract (arXiv)
Production LLM applications stack several defense families -- refusal-phrase filters, token-budget controls, model allowlists, rate limits, tool-registry authentication -- yet existing breach-and-attack-simulation (BAS) benchmarks report a single aggregate coverage number, hiding which family closes which threat. We measure attribution. We add four OWASP-LLM-Top-10-aware agents to a 21-agent baseline scanner and target a lattice of four synthetic LLM endpoints: L0 (no defenses), L1 (refusal-only), L2 (budget-only), and L3 (full stack). L1 and L2 are sibling single-axis ablations, not subsets of each other; L3 is their union plus tool-registry authentication and credential scrubbing. Across N=10 replications, the per-OWASP finding count is clean: refusal alone removes all LLM01 (jailbreak) and LLM07 (system-prompt leakage) findings; budget alone removes all LLM02 (sensitive-info disclosure) and LLM10 (unbounded consumption) findings by terminating multi-step sequences; LLM06 (excessive agency) requires the full stack. We probe brittleness under paraphrasing: with 300 Gemini-generated paraphrases (K=5 over a 60-template brittleness corpus), L1 refusal block rate falls 15 pp on LLM01 and 25 pp on LLM07. A fifth target, L4-real, swaps the stub backend for Gemini-2.5-flash behind the same L3 regex and matches L1 exactly, indicating no measurable alignment contribution beyond the regex (not a general claim about alignment). Budget controls show no drop (0 pp once the rate-limit floor is factored out). A refusal whitelist that clears a static benchmark can be defeated by an LLM-driven paraphraser without changing attack intent; a budget control resists the same mutation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 9 of its 32 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
9 of 32 references.
References · 9
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 619
- 2025ACE: A Security Architecture for LLM-Integrated App Systemscited by 52
- 2024garak: A Framework for Security Probing Large Language Modelscited by 48
- 2026Mitigating the OWASP Top 10 For Large Language Models Applications using Intelligent Agentscited by 3
- 2025Countermind: A Multi-Layered Security Architecture for Large Language Modelscited by 2
- 2020Is the OWASP Top 10 list comprehensive enough for writing secure code?cited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.