mlsanityData to 14 Oct 2026

R1-ACT: Efficient Reasoning Model Safety Alignment by Activating Safety Knowledge

arXiv 2508.00324 ↗First posted 1 Aug 2025cs.AI cs.CLcited by 6

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 2 more
Abstract (arXiv)

Although large reasoning models (LRMs) have demonstrated impressive capabilities on complex tasks, recent studies reveal that these models frequently fulfill harmful user instructions, raising significant safety concerns. In this paper, we investigate the underlying cause of LRM safety risks and find that models already possess sufficient safety knowledge but fail to activate it during reasoning. Based on this insight, we propose R1-Act, a simple and efficient post-training method that explicitly triggers safety knowledge through a structured reasoning process. R1-Act achieves strong safety improvements while preserving reasoning performance, outperforming prior alignment methods. Notably, it requires only 1,000 training examples and 90 minutes of training on a single RTX A6000 GPU. Extensive experiments across multiple LRM backbones and sizes demonstrate the robustness, scalability, and practical efficiency of our approach.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 21 of its 27 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

21 of 27 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills15 Jun
  2. 2025SafeKey: Amplifying Aha-Moment Insights for Safety Reasoning22 May
  3. 2025How Should We Enhance the Safety of Large Reasoning Models: An Empirical Study21 May
  4. 2025R-TOFU: Unlearning in Large Reasoning Models21 May
  5. 2025RealSafe-R1: Safety-Aligned DeepSeek-R1 without Compromising Reasoning Capability14 Apr
  6. 2025STAR-1: Safer Alignment of Reasoning LLMs with 1K Data2 Apr
  7. 2025Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable1 Mar
  8. 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R118 Feb
  9. 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
  10. 2024OpenAI o1 System Card21 Dec
  11. 2024Deliberative Alignment: Reasoning Enables Safer Language Models20 Dec

Other references · 10

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2025s1: Simple test-time scalingcited by 1,341
  6. 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 505
  7. 2024A StrongREJECT for Empty Jailbreakscited by 385
  8. 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusalcited by 240
  9. 2025Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning?cited by 44
  10. 2025Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Modelscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reasoning Structure Matters for Safety Alignment of Reasoning Models
  2. 2025Beyond Safe Answers: A Benchmark for Evaluating True Risk Awareness in Large Reasoning Models
  3. 2026THINKSAFE: Self-Generated Safety Alignment for Reasoning Models
  4. 2025LoRA is All You Need for Safety Alignment of Reasoning LLMs
  5. 2026Mitigating the Safety-utility Trade-off in LLM Alignment via Adaptive Safe Context Learning
  6. 2026Towards Safer Large Reasoning Models by Promoting Safety Decision-Making before Chain-of-Thought Generation
  7. 2026Towards Mitigating Deceptive Safety Alignment in Large Reasoning Models
  8. 2025Beyond SFT: Reinforcement Learning for Safer Large Reasoning Models with Better Reasoning Ability