A Content-Based Framework for Cybersecurity Refusal Decisions in Large Language Models
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Large language models and LLM-based agents are increasingly used for cybersecurity tasks that are inherently dual-use. Existing approaches to refusal, spanning academic policy frameworks and commercially deployed systems, often rely on broad topic-based bans or offensive-focused taxonomies. As a result, they can yield inconsistent decisions, over-restrict legitimate defenders, and behave brittlely under obfuscation or request segmentation. We argue that effective refusal requires explicitly modeling the trade-off between offensive risk and defensive benefit, rather than relying solely on intent or offensive classification. In this paper, we introduce a content-based framework for designing and auditing cyber refusal policies that makes offense-defense tradeoffs explicit. The framework characterizes requests along five dimensions: Offensive Action Contribution, Offensive Risk, Technical Complexity, Defensive Benefit, and Expected Frequency for Legitimate Users, grounded in the technical substance of the request rather than stated intent. We demonstrate that this content-grounded approach resolves inconsistencies in current frontier model behavior and allows organizations to construct tunable, risk-aware refusal policies.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 15 of its 26 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
15 of 26 references.
Closest ancestors · 2
Same direction, newest first
- 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Execution21 May
- 2024EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities24 Sep
Other references · 13
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 292
- 2025Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teamingcited by 172
- 2024Know Your Limits: A Survey of Abstention in Large Language Modelscited by 116
- 2024CyberSecEval 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Modelscited by 84
- 2024Safeguarding Large Language Models: A Surveycited by 73
- 2025From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Trainingcited by 49
- 2022Structured access: an emerging paradigm for safe AI deploymentcited by 40
- 2025A Framework for Evaluating Emerging Cyberattack Capabilities of AIcited by 15
- 2025Benchmarking Misuse Mitigation Against Covert Adversariescited by 8
1 more
- 2025LLM Cyber Evaluations Don't Capture Real-World Riskcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Defensive Refusal Bias: How Safety Alignment Fails Cyber Defenders
- 2026A New Framework for Cybersecurity Refusals in AI Agents
- 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal
- 2026Ablating Safety: Mechanisms for Removing Alignment in Language Models for Security Applications
- 2026Do LLMs Know Their Vulnerable Scenarios?
- 2026Not All Refusals Are Equal: How Safety Alignment Fails Cybersecurity at Scale
- 2026Beyond Refusal: A Same-Lineage Study of Aligned and Abliterated LLMs for Vulnerability Analysis
- 2026Structured but Fragile: On the Limits of LLMs in Cybersecurity Decision-Making