Beyond Content Safety: Real-Time Monitoring for Reasoning Vulnerabilities in Large Language Models
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large language models increasingly rely on explicit chain-of-thought reasoning to solve complex tasks, yet the safety of the reasoning process itself remains largely unaddressed. Existing work focuses predominantly on content safety (i.e., detecting harmful, biased, or factually incorrect outputs), while treating the underlying reasoning chain as an opaque intermediate artifact. We argue that reasoning safety constitutes a fundamental security dimension orthogonal to content safety: the requirement that a model's reasoning trajectory be logically consistent, computationally efficient, and resistant to adversarial manipulation. In this paper, we formalize reasoning safety and introduce a systematic taxonomy of nine unsafe reasoning behaviors. We then conduct a large-scale prevalence study, annotating over 4,000 reasoning chains across benign benchmarks and four state-of-the-art reasoning attacks, empirically demonstrating that all nine error types occur in practice with mechanistically interpretable signatures. To mitigate these threats, we propose the Reasoning Safety Monitor: an external, zero-shot verification framework that runs in parallel with the target LLM. It inspects each reasoning step in real time via a taxonomy-embedded prompt and dispatches an interrupt signal upon detecting unsafe behavior. Extensive evaluations show our monitor achieves up to 87.11% step-level localization accuracy, outperforming hallucination detectors and the best process reward model baselines by a substantial margin. Crucially, the monitor maintains a low false positive rate on correct reasoning paths, operates with negligible latency overhead, and exhibits robust resilience against adaptive adversarial evasion. These findings establish reasoning safety monitoring as a highly feasible and essential component for the secure deployment of large reasoning models.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 21 of its 39 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
21 of 39 references.
Closest ancestors · 8
Same direction, newest first
- 2026ReasoningBomb: A Stealthy Denial-of-Service Attack by Inducing Pathologically Long Reasoning in Large Reasoning Models29 Jan
- 2025ThinkTrap: Denial-of-Service Attacks against Black-box LLM Services via Infinite Thinking8 Dec
- 2025BadThink: Triggered Overthinking Attacks on Chain-of-Thought Reasoning in Large Language Models13 Nov
- 2025One Token Embedding Is Enough to Deadlock Your Large Reasoning Model12 Oct
- 2025Safety in Large Reasoning Models: A Survey24 Apr
- 2025ShadowCoT: Cognitive Hijacking for Stealthy Reasoning Backdoors in LLMs8 Apr
- 2025OverThink: Slowdown Attacks on Reasoning LLMs4 Feb
- 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models20 Jan
Other references · 13
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Let's Verify Step by Stepcited by 3,789
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2025OpenAI GPT-5 System Cardcited by 989
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 415
- 2024Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Basescited by 77
- 2025Detection and Mitigation of Hallucination in Large Reasoning Models: A Mechanistic Perspectivecited by 34
- 2024Preemptive Answer "Attacks" on Chain-of-Thought Reasoningcited by 19
1 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025SafeRBench: Dissecting the Reasoning Safety of Large Language Models
- 2026SFCoT: Safer Chain-of-Thought via Active Safety Evaluation and Calibration
- 2026TRACE: An Evidence-Grounded Benchmark for Safety Evaluation of Large Reasoning Models
- 2025When Models Outthink Their Safety: Unveiling and Mitigating Self-Jailbreak in Large Reasoning Models
- 2025SafeMLRM: Demystifying Safety in Multi-modal Large Reasoning Models
- 2025Safety is Not Only About Refusal: Reasoning-Enhanced Fine-tuning for Interpretable LLM Safety
- 2026Chain of Risk: Safety Failures in Large Reasoning Models and Mitigation via Adaptive Multi-Principle Steering
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities