mlsanityData to 7 Oct 2026

Answer-Conditioned Chains of Thought Degrade Verifiable-Reasoning Distillation in Large Language Models

arXiv 2607.14552 ↗First posted 16 Jul 2026cs.CL cs.AIcited by 5

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

A standard recipe for distilling the reasoning ability of large language models (LLMs) is to sample chains of thought from the model, keep those that reach the correct final answer, and fine-tune on the survivors. When sampling fails, a common fix shows the generator the gold answer and asks it to write a chain that reaches that answer. We show that this second step degrades the training data in a way that correctness filtering cannot catch. We run a controlled experiment that fixes the generator, the problem set, and the correctness filter, and varies only whether the chain is generated under answer-conditioning, the gold answer shown with a request to reach it. Training a strong instruction-tuned reasoning model on its own answer-conditioned chains sharply lowers its verifiable-reasoning accuracy. The loss grows with difficulty, reaching as much as about 27 points on the hardest competition problems. The mechanism is legible in the chains themselves, which rationalize backward from the shown answer instead of deriving it, with the early final-answer statement as the measurable symptom. The harm is a property of the data rather than the generator, read off unlabeled generations before any fine-tuning, ordering the penalty across eight thinking models from four families, and transferring across teacher families. A prompt ablation localizes it to the rationalize-toward instruction rather than the answer's bare visibility. The practical takeaway is to generate answer-blind, because no correctness filter can see this damage in the data.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 50 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

23 of 50 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026CRISP: Compressed Reasoning via Iterative Self-Policy Distillation5 Mar
  2. 2025Mitigating Spurious Correlations Between Question and Answer via Chain-of-Thought Correctness Perception Distillation6 Sep
  3. 2025Reasoning Models Don't Always Say What They Think8 May
  4. 2023Measuring Faithfulness in Chain-of-Thought Reasoning17 Jul

Other references · 19

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2023Let's Verify Step by Stepcited by 3,598
  5. 2024OpenAI o1 System Cardcited by 1,220
  6. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  7. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
  8. 2023Reinforced Self-Training (ReST) for Language Modelingcited by 486
  9. 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 426
  10. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
  11. 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 325
  12. 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 292
7 more
  1. 2024V-STaR: Training Verifiers for Self-Taught Reasonerscited by 214
  2. 2025Llama-Nemotron: Efficient Reasoning Modelscited by 151
  3. 2025Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Modelscited by 45
  4. 2024Reverse Thinking Makes LLMs Stronger Reasonerscited by 29
  5. 2026HEAL: Hindsight Entropy-Assisted Learning for Reasoning Distillationcited by 2
  6. 2026RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgettingcited by 1
  7. 2026Robust Reasoning via Dynamic Token Selection for Distribution-Aligned Self-Distillationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoning
  2. 2026Masked Distillation: Internalizing the Chain-of-Thought in Language Models
  3. 2025Sample Smart, Not Hard: Correctness-First Decoding for Better Reasoning in LLMs
  4. 2025Early Stopping Chain-of-thoughts in Large Language Models
  5. 2026Large Language Models Decide Early and Explain Later
  6. 2025Robust Answers, Fragile Logic: Probing the Decoupling Hypothesis in LLM Reasoning
  7. 2024Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoning
  8. 2026Learning from Partial Chain-of-Thought via Truncated-Reasoning Self-Distillation