SafeRBench: Dissecting the Reasoning Safety of Large Language Models
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large Reasoning Models (LRMs) have significantly improved problem-solving through explicit Chain-of-Thought (CoT) reasoning. However, this capability creates a Safety-Helpfulness Paradox: the reasoning process itself can be misused to justify harmful actions or conceal malicious intent behind lengthy intermediate steps. Most existing benchmarks only check the final output, missing how risks evolve, or ``drift'', during the model's internal reasoning. To address this, we propose SafeRBench, the first framework to evaluate LRM safety end-to-end, from the initial input to the reasoning trace and final answer. Our approach introduces: (i) a Risk Stratification Probing that uses specific risk levels to stress-test safety boundaries beyond simple topics; (ii) Micro-Thought Analysis, a new chunking method that segments traces to pinpoint exactly where safety alignment breaks down; and (iii) a comprehensive suite of 10 fine-grained metrics that, for the first time, jointly measure a model's Risk Exposure (e.g., risk level, execution feasibility) and Safety Awareness (e.g., intent awareness). Experiments on 19 LRMs reveal that while enabling Thinking modes improves safety in mid-sized models, it paradoxically increases actionable risks in larger models due to a strong always-help tendency.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 25 of its 44 references that are in the map. First posted on arXiv 19 Nov 2025.
Builds on
25 of 44 references.
Closest ancestors · 4
Same direction, newest first
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models4 Sep
- 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R118 Feb
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
- 2024OpenAI o1 System Card21 Dec
Other references · 21
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2025s1: Simple test-time scalingcited by 1,341
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2025LIMO: Less is More for Reasoningcited by 498
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2024TrustLLM: Trustworthiness in Large Language Modelscited by 285
9 more
- 2024SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Modelscited by 228
- 2024Marco-o1: Towards Open Reasoning Models for Open-Ended Solutionscited by 144
- 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 66
- 2023Making Large Language Models Better Reasoners with Alignmentcited by 63
- 2020Text Segmentation by Cross Segment Attentioncited by 54
- 2024Is Semantic Chunking Worth the Computational Cost?cited by 43
- 2025EXAONE Deep: Reasoning Enhanced Language Modelscited by 21
- 2025Loong: Synthesize Long Chain-of-Thoughts at Scale through Verifierscited by 14
- 2025SafetyFlow: An Agent-Flow System for Automated LLM Safety Benchmarkingcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Do Reasoning LLMs Refuse What They Infer in Long Contexts?cited by 3
- 2026Reasoning on the Manifold: Bidirectional Consistency for Self-Verification in Diffusion Language Modelscited by 2
- 2026Fool's Gold: Defensive Deception Against Safety-Removal Attacks on Open-Weight Modelscited by 0
- 2026Towards Mitigating Deceptive Safety Alignment in Large Reasoning Modelscited by 0
- 2026Towards Mitigating Deceptive Safety Alignment in Large Reasoning Models28 Sep 2026
- 2026Fool's Gold: Defensive Deception Against Safety-Removal Attacks on Open-Weight Models17 Aug 2026
- 2026Reasoning on the Manifold: Bidirectional Consistency for Self-Verification in Diffusion Language Models17 Apr 2026
- 2026Do Reasoning LLMs Refuse What They Infer in Long Contexts?9 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Safe Answers: A Benchmark for Evaluating True Risk Awareness in Large Reasoning Models
- 2026Chain of Risk: Safety Failures in Large Reasoning Models and Mitigation via Adaptive Multi-Principle Steering
- 2026How Does the Thinking Step Influence Model Safety? An Entropy-based Safety Reminder for LRMs
- 2025How Should We Enhance the Safety of Large Reasoning Models: An Empirical Study
- 2026Beyond Content Safety: Real-Time Monitoring for Reasoning Vulnerabilities in Large Language Models
- 2025ReasoningShield: Safety Detection over Reasoning Traces of Large Reasoning Models
- 2026Towards Safer Large Reasoning Models by Promoting Safety Decision-Making before Chain-of-Thought Generation
- 2026TRACE: An Evidence-Grounded Benchmark for Safety Evaluation of Large Reasoning Models