Strong but Brittle: Simple Attacks Subvert Reasoning-based Safety Guardrails
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Open-weight Large Reasoning Models (LRMs) are approaching the capabilities of their frontier counterparts but pose significant safety concerns, as they are difficult to patch or monitor post-release. To prevent misuse, reasoning-based safety guardrails, where models explicitly reason on safety justifications before answering, have become a promising primary defense, achieving near-perfect refusal rates on harmful queries. We show that this strong defense is alarmingly brittle and can be subverted by embarrassingly simple attacks to elicit extremely forbidden questions, such as `How to kill a man without being caught?' Specifically, we identify one systematic vulnerability from the reasoning-then-answer mechanism: the stage-transition logic that governs when safety reasoning begins and ends can be trivially manipulated. Based on this finding, we develop four simple yet effective red-teaming methods that systematically subvert different stages of the guardrails, either by bypassing reasoning entirely or exploiting it to produce targeted harmful content. These methods achieve attack success rates up to 90% across five benchmarks on multiple LRM families. Our findings reveal that reasoning-based guardrails are necessary but not sufficient and must be paired with robust triggering mechanisms and stronger base-model alignment. Code is in https://chenxshuo.github.io/bag-of-tricks/.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 33 of its 42 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
33 of 42 references.
Closest ancestors · 19
Same direction, newest first
- 2025Reasoned Safety Alignment: Ensuring Jailbreak Defense via Answer-Then-Check15 Sep
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models4 Sep
- 2025Reasoning as an Adaptive Defense for Safety1 Jul
- 2025Three Minds, One Legend: Jailbreak Large Reasoning Model with Adaptive Stacked Ciphers22 May
- 2025SafeKey: Amplifying Aha-Moment Insights for Safety Reasoning22 May
- 2025AutoRAN: Automated Hijacking of Safety Reasoning in Large Reasoning Models16 May
- 2025Practical Reasoning Interruption Attacks on Reasoning Large Language Models10 May
- 2025RealSafe-R1: Safety-Aligned DeepSeek-R1 without Compromising Reasoning Capability14 Apr
- 2025SAFER: Advancing Safety Alignment via Efficient Ex-Ante Reasoning3 Apr
- 2025Safety is Not Only About Refusal: Reasoning-Enhanced Fine-tuning for Interpretable LLM Safety6 Mar
- 2025A Mousetrap: Fooling Large Reasoning Models for Jailbreak with Chain of Iterative Chaos19 Feb
- 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking18 Feb
7 more
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
- 2025Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models16 Feb
- 2025Safety Reasoning with Guidelines6 Feb
- 2025STAIR: Improving Safety Alignment with Introspective Reasoning4 Feb
- 2025Enhancing Model Defense Against Jailbreaks with Proactive Safety Reasoning31 Jan
- 2025International AI Safety Report29 Jan
- 2024Deliberative Alignment: Reasoning Enables Safer Language Models20 Dec
Other references · 14
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
- 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 222
- 2025Phi-4-reasoning Technical Reportcited by 146
- 2024Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmeticcited by 105
- 2024On the Societal Impact of Open Foundation Modelscited by 64
- 2024AdvPrefix: An Objective for Nuanced LLM Jailbreakscited by 25
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Prompt Injection as Role Confusioncited by 11
- 2026Jailbreaking LLMs via Calibrationcited by 0
- 2026Prompt Injection as Role Confusion22 Feb 2026
- 2026Jailbreaking LLMs via Calibration31 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Safety Through Reasoning: An Empirical Study of Reasoning Guardrail Models
- 2025ReasoningGuard: Safeguarding Large Reasoning Models with Inference-time Safety Aha Moments
- 2025When Models Outthink Their Safety: Unveiling and Mitigating Self-Jailbreak in Large Reasoning Models
- 2026Beyond Content Safety: Real-Time Monitoring for Reasoning Vulnerabilities in Large Language Models
- 2026Robust and Efficient Guardrails with Latent Reasoning
- 2026Chain of Risk: Safety Failures in Large Reasoning Models and Mitigation via Adaptive Multi-Principle Steering
- 2026TRACE: An Evidence-Grounded Benchmark for Safety Evaluation of Large Reasoning Models
- 2025HauntAttack: When Attack Follows Reasoning as a Shadow