Information-Preserving Reformulation of Reasoning Traces for Antidistillation
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Recent advances in Large Language Models (LLMs) show that extending the length of reasoning chains significantly improves performance on complex tasks. While revealing these reasoning traces helps users better follow, verify, and learn from the model's problem-solving process, it also makes them highly vulnerable to unauthorized distillation. To mitigate this risk, proprietary model providers often adopt aggressive protection strategies, such as replacing detailed reasoning with brief summaries, which deprive users of valuable intermediate information. To address this trade-off, we propose PART, an information-preserving antidistillation reformulation of reasoning traces. Motivated by the difference between how humans understand reasoning traces and how LLMs exploit them for supervised fine-tuning, we design a simple but effective two-step reformulation: removing self-talk behaviors and reordering sub-conclusions. A small auxiliary model is trained to perform this reformulation, incurring minimal computational overhead. Extensive experiments demonstrate that PART consistently disrupts distillation across student models of different sizes and types on various reasoning benchmarks. For instance, when training on reformulated traces, even the performance of a large 32B student model decreases from 54.17 to 46.88 on AIME 2024, corresponding to a 13.5% degradation.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 32 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
5 of 32 references.
References · 5
- 2024GPT-4o System Cardcited by 4,467
- 2024OpenAI o1 System Cardcited by 1,220
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2025Antidistillation Samplingcited by 24
- 2025DOGe: Defensive Output Generation for LLM Protection Against Knowledge Distillationcited by 14
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Protecting Language Models Against Unauthorized Distillation through Trace Rewritingcited by 6
- 2026RedAct: Redacting Agent Capability Traces for Procedural Skill Protectioncited by 2
- 2026Asking Back: Interaction-Layer Antidistillation Watermarkscited by 1
- 2026Safeguarding Text-to-Image Generative Models Against Unauthorized Knowledge Distillationcited by 1
- 2026What Does It Mean to Break a Distillation Defense?cited by 1
- 2026Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answeringcited by 0
- 2026Hiding in Plain Sight: Detectability-Aware Antidistillation of Reasoning Modelscited by 0
- 2026The Distillation Game: Adaptive Evaluations & Efficient Defensescited by 0
- 2026What Does It Mean to Break a Distillation Defense?23 Jun 2026
- 2026RedAct: Redacting Agent Capability Traces for Procedural Skill Protection9 Jun 2026
- 2026The Distillation Game: Adaptive Evaluations & Efficient Defenses21 May 2026
- 2026Safeguarding Text-to-Image Generative Models Against Unauthorized Knowledge Distillation21 May 2026
- 2026Asking Back: Interaction-Layer Antidistillation Watermarks15 May 2026
- 2026Hiding in Plain Sight: Detectability-Aware Antidistillation of Reasoning Models25 Apr 2026
- 2026Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answering26 Feb 2026
- 2026Protecting Language Models Against Unauthorized Distillation through Trace Rewriting16 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025In Their Own Words: Reasoning Traces Tailored for Small Models Make Them Better Reasoners
- 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
- 2026TRACES: Tagging Reasoning Steps for Adaptive Cost-Efficient Early-Stopping
- 2026Hidden Thoughts Are Not Secret: Reasoning Trace Exposure in LLMs
- 2026Masked Distillation: Internalizing the Chain-of-Thought in Language Models
- 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills
- 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
- 2026Backtracking When It Strays: Mitigating Dual Exposure Biases in LLM Reasoning Distillation