STaR: Sensitive Trajectory Regulation for Unlearning in Large Reasoning Models
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Large Reasoning Models (LRMs) have advanced automated multi-step reasoning, but their ability to generate complex Chain-of-Thought (CoT) trajectories introduces severe privacy risks, as sensitive information may be deeply embedded throughout the reasoning process. Existing Large Language Models (LLMs) unlearning approaches that typically focus on modifying only final answers are insufficient for LRMs, as they fail to remove sensitive content from intermediate steps, leading to persistent privacy leakage and degraded security. To address these challenges, we propose Sensitive Trajectory Regulation (STaR), a parameter-free, inference-time unlearning framework that achieves robust privacy protection throughout the reasoning process. Specifically, we first identify sensitive content via semantic-aware detection. Then, we inject global safety constraints through secure prompt prefix. Next, we perform trajectory-aware suppression to dynamically block sensitive content across the entire reasoning chain. Finally, we apply token-level adaptive filtering to prevent both exact and paraphrased sensitive tokens during generation. Furthermore, to overcome the inadequacies of existing evaluation protocols, we introduce two metrics: Multi-Decoding Consistency Assessment (MCS), which measures the consistency of unlearning across diverse decoding strategies, and Multi-Granularity Membership Inference Attack (MIA) Evaluation, which quantifies privacy protection at both answer and reasoning-chain levels. Experiments on the R-TOFU benchmark demonstrate that STaR achieves comprehensive and stable unlearning with minimal utility loss, setting a new standard for privacy-preserving reasoning in LRMs.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 32 of its 46 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
32 of 46 references.
Closest ancestors · 4
Same direction, newest first
- 2025R-TOFU: Unlearning in Large Reasoning Models21 May
- 2025SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities17 Feb
- 2024OpenAI o1 System Card21 Dec
- 2024UnStar: Unlearning with Self-Taught Anti-Sample Reasoning for LLMs22 Oct
Other references · 28
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 507
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 484
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 218
- 2023Unlearn What You Want to Forget: Efficient Unlearning for LLMscited by 211
- 2023Copyright Violations and Large Language Modelscited by 108
- 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearningcited by 104
- 2024A Closer Look at Machine Unlearning for Large Language Modelscited by 54
16 more
- 2024Soft Prompting for Unlearning in Large Language Modelscited by 42
- 2025Improving LLM Safety Alignment with Dual-Objective Optimizationcited by 40
- 2024Alternate Preference Optimization for Unlearning Factual Knowledge in Large Language Modelscited by 32
- 2025BLUR: A Bi-Level Optimization Approach for LLM Unlearningcited by 23
- 2024When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?cited by 20
- 2025Proactive Privacy Amnesia for Large Language Models: Safeguarding PII with Negligible Impact on Model Utilitycited by 9
- 2025OBLIVIATE: Robust and Practical Machine Unlearning for Large Language Modelscited by 9
- 2025The Landscape of Memorization in LLMs: Mechanisms, Measurement, and Mitigationcited by 9
- 2024Harnessing Business and Media Insights with Large Language Modelscited by 7
- 2025Does Machine Unlearning Truly Remove Knowledge?cited by 7
- 2025Existing Large Language Model Unlearning Evaluations Are Inconclusivecited by 7
- 2025Not Every Token Needs Forgetting: Selective Unlearning to Limit Change in Utility in Large Language Model Unlearningcited by 7
- 2025Model Collapse Is Not a Bug but a Feature in Machine Unlearning for LLMscited by 7
- 2025Harry Potter is Still Here! Probing Knowledge Leakage in Targeted Unlearned Large Language Models via Automated Adversarial Promptingcited by 6
- 2024Learning and Unlearning of Fabricated Knowledge in Language Modelscited by 4
- 2025What Should LLMs Forget? Quantifying Personal Data in LLMs for Right-to-Be-Forgotten Requestscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills
- 2026Explainable LLM Unlearning Through Reasoning
- 2026From Leaky Thoughts to Private Reasoning: Controlling What LRMs Say to Themselves
- 2026Selective Forgetting for Large Reasoning Models
- 2026Towards Unveiling Vulnerabilities of Large Reasoning Models in Machine Unlearning
- 2026Secure Forgetting: A Framework for Privacy-Driven Unlearning in Large Language Model (LLM)-Based Agents
- 2026Operationalising the Right to be Forgotten in LLMs: A Lightweight Sequential Unlearning Framework for Privacy-Aligned Deployment in Politically Sensitive Environments
- 2026GUARD: Natural Forgetting in Large Reasoning Models via Guided Answer-Reasoning Distillation