Internal Safety Collapse in Frontier Large Language Models
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
This work identifies a critical failure mode in frontier large language models (LLMs), which we term Internal Safety Collapse (ISC): under certain task conditions, models enter a state in which they continuously generate harmful content while executing otherwise benign tasks. We introduce TVD (Task, Validator, Data), a framework that triggers ISC through domain tasks where generating harmful content is the only valid completion, and construct ISC-Bench containing 53 scenarios across 8 professional disciplines. Evaluated on JailbreakBench, three representative scenarios yield worst-case safety failure rates averaging 95.3% across four frontier LLMs (including GPT-5.2 and Claude Sonnet 4.5), substantially exceeding standard jailbreak attacks. Frontier models are more vulnerable than earlier LLMs: the very capabilities that enable complex task execution become liabilities when tasks intrinsically involve harmful content. This reveals a growing attack surface: almost every professional domain uses tools that process sensitive data, and each new dual-use tool automatically expands this vulnerability--even without any deliberate attack. Despite substantial alignment efforts, frontier LLMs retain inherently unsafe internal capabilities: alignment reshapes observable outputs but does not eliminate the underlying risk profile. These findings underscore the need for caution when deploying LLMs in high-stakes settings. Source code: https://github.com/wuyoscar/ISC-Bench
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. First posted on arXiv 4 Mar 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agentscited by 16
- 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agentscited by 4
- 2026Agent Hacks Agent: Autoresearch for Production-Agent Red-Teamingcited by 2
- 2026SafeRedirect: Defeating Internal Safety Collapse via Task-Completion Redirection in Frontier LLMscited by 1
- 2026Mitigating Many-shot Jailbreak Attacks with One Single Demonstrationcited by 0
- 2026Beyond the Prompt: Jailbreaking Function-Calling LLMs via Simulated Moderation Tracescited by 0
- 2026HazardAuditor: From Executable Threats to Safer Computer-Use Agentscited by 0
- 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformationcited by 0
- 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation28 Sep 2026
- 2026HazardAuditor: From Executable Threats to Safer Computer-Use Agents14 Sep 2026
- 2026Agent Hacks Agent: Autoresearch for Production-Agent Red-Teaming13 Jul 2026
- 2026Beyond the Prompt: Jailbreaking Function-Calling LLMs via Simulated Moderation Traces1 Jul 2026
- 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agents31 May 2026
- 2026Mitigating Many-shot Jailbreak Attacks with One Single Demonstration8 May 2026
- 2026SafeRedirect: Defeating Internal Safety Collapse via Task-Completion Redirection in Frontier LLMs22 Apr 2026
- 2026AgentHazard: A Benchmark for Evaluating Harmful Behavior in Computer-Use Agents3 Apr 2026