mlsanityData to 7 Oct 2026

Strong but Brittle: Simple Attacks Subvert Reasoning-based Safety Guardrails

arXiv 2510.11570 ↗First posted 13 Oct 2025cs.CR cs.CLcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Open-weight Large Reasoning Models (LRMs) are approaching the capabilities of their frontier counterparts but pose significant safety concerns, as they are difficult to patch or monitor post-release. To prevent misuse, reasoning-based safety guardrails, where models explicitly reason on safety justifications before answering, have become a promising primary defense, achieving near-perfect refusal rates on harmful queries. We show that this strong defense is alarmingly brittle and can be subverted by embarrassingly simple attacks to elicit extremely forbidden questions, such as `How to kill a man without being caught?' Specifically, we identify one systematic vulnerability from the reasoning-then-answer mechanism: the stage-transition logic that governs when safety reasoning begins and ends can be trivially manipulated. Based on this finding, we develop four simple yet effective red-teaming methods that systematically subvert different stages of the guardrails, either by bypassing reasoning entirely or exploiting it to produce targeted harmful content. These methods achieve attack success rates up to 90% across five benchmarks on multiple LRM families. Our findings reveal that reasoning-based guardrails are necessary but not sufficient and must be paired with robust triggering mechanisms and stronger base-model alignment. Code is in https://chenxshuo.github.io/bag-of-tricks/.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 33 of its 42 references that are in the map. First posted on arXiv 13 Oct 2025.

Builds on

33 of 42 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025Reasoned Safety Alignment: Ensuring Jailbreak Defense via Answer-Then-Check15 Sep
  2. 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models4 Sep
  3. 2025Reasoning as an Adaptive Defense for Safety1 Jul
  4. 2025Three Minds, One Legend: Jailbreak Large Reasoning Model with Adaptive Stacked Ciphers22 May
  5. 2025SafeKey: Amplifying Aha-Moment Insights for Safety Reasoning22 May
  6. 2025AutoRAN: Automated Hijacking of Safety Reasoning in Large Reasoning Models16 May
  7. 2025Practical Reasoning Interruption Attacks on Reasoning Large Language Models10 May
  8. 2025RealSafe-R1: Safety-Aligned DeepSeek-R1 without Compromising Reasoning Capability14 Apr
  9. 2025SAFER: Advancing Safety Alignment via Efficient Ex-Ante Reasoning3 Apr
  10. 2025Safety is Not Only About Refusal: Reasoning-Enhanced Fine-tuning for Interpretable LLM Safety6 Mar
  11. 2025A Mousetrap: Fooling Large Reasoning Models for Jailbreak with Chain of Iterative Chaos19 Feb
  12. 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking18 Feb
7 more
  1. 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
  2. 2025Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models16 Feb
  3. 2025Safety Reasoning with Guidelines6 Feb
  4. 2025STAIR: Improving Safety Alignment with Introspective Reasoning4 Feb
  5. 2025Enhancing Model Defense Against Jailbreaks with Proactive Safety Reasoning31 Jan
  6. 2025International AI Safety Report29 Jan
  7. 2024Deliberative Alignment: Reasoning Enables Safer Language Models20 Dec

Other references · 14

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  4. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  5. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  6. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  7. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
  8. 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 222
  9. 2025Phi-4-reasoning Technical Reportcited by 146
  10. 2024Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmeticcited by 105
  11. 2024On the Societal Impact of Open Foundation Modelscited by 64
  12. 2024AdvPrefix: An Objective for Nuanced LLM Jailbreakscited by 25
2 more
  1. 2025Why Safeguarded Ships Run Aground? Aligned Large Language Models' Safety Mechanisms Tend to Be Anchored in The Template Regioncited by 5
  2. 2025Backtracking for Safetycited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Safety Through Reasoning: An Empirical Study of Reasoning Guardrail Models
  2. 2025ReasoningGuard: Safeguarding Large Reasoning Models with Inference-time Safety Aha Moments
  3. 2025When Models Outthink Their Safety: Unveiling and Mitigating Self-Jailbreak in Large Reasoning Models
  4. 2026Beyond Content Safety: Real-Time Monitoring for Reasoning Vulnerabilities in Large Language Models
  5. 2026Robust and Efficient Guardrails with Latent Reasoning
  6. 2026Chain of Risk: Safety Failures in Large Reasoning Models and Mitigation via Adaptive Multi-Principle Steering
  7. 2026TRACE: An Evidence-Grounded Benchmark for Safety Evaluation of Large Reasoning Models
  8. 2025HauntAttack: When Attack Follows Reasoning as a Shadow