mlsanityData to 14 Oct 2026

REDaCT: Collapse-Free Unlearning in Large Reasoning Models

arXiv 2610.12769 ↗First posted 8 Oct 2026cs.LG cs.AI cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Unlearning in large reasoning models (LRMs) requires removing forget-set information from both the reasoning trace and the final answer. Existing approaches achieve this objective at the cost of reasoning collapse, where the model fails to produce a coherent chain-of-thought (CoT) and does not properly terminate its reasoning process. To address this challenge, we propose REDaCT (REgenerate via Detection and Corrective Tuning), an inference-time unlearning framework for LRMs. REDaCT consists of two key components: (1) a binary leak detector that identifies sentences in the reasoning trace that leak forget-set information, and (2) an embedding optimization module that learns a corrective embedding offline, such that when injected at the first detected leak during inference, it guides subsequent reasoning towards sentences that do not leak forget-set information. Experimental results show that REDaCT completely avoids reasoning collapse, substantially improving reasoning preservation compared to state-of-the-art unlearning methods while maintaining perfect answer forgetting and near-perfect CoT forgetting. Our code is available at: https://github.com/jmaccoby/redact.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 20 of its 41 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

20 of 41 references.

References · 20

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  4. 2019Machine Unlearningcited by 1,061
  5. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  6. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
  7. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
  8. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
  9. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
  10. 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 224
  11. 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearningcited by 172
  12. 2018Generating Informative and Diverse Conversational Responses via Adversarial Information Maximizationcited by 116
8 more
  1. 2024Large Language Model Unlearning via Embedding-Corrupted Promptscited by 116
  2. 2024Guardrail Baselines for Unlearning in LLMscited by 96
  3. 2025STAR-1: Safer Alignment of Reasoning LLMs with 1K Datacited by 68
  4. 2024Soft Prompting for Unlearning in Large Language Modelscited by 46
  5. 2024On Effects of Steering Latent Representation for Large Language Model Unlearningcited by 32
  6. 2024Learning to Refuse: Towards Mitigating Privacy Risks in LLMscited by 23
  7. 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skillscited by 14
  8. 2025R-TOFU: Unlearning in Large Reasoning Modelscited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GUARD: Natural Forgetting in Large Reasoning Models via Guided Answer-Reasoning Distillation
  2. 2026Selective Forgetting for Large Reasoning Models
  3. 2025Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models
  4. 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths
  5. 2025ThinkLess: A Training-Free Inference-Efficient Method for Reducing Reasoning Redundancy
  6. 2026Leak-Resistant Unlearning: A New Benchmark for Evaluating Multi-Hop Reasoning Consistency and Recovery Robustness
  7. 2025Efficient Inference for Large Reasoning Models: A Survey
  8. 2026DoubtLess: Training-Free Contrastive Decoding for Efficient Reasoning