mlsanityData to 14 Oct 2026

Reasoning-Trace Collapse: Evaluating the Loss of Explicit Reasoning During Fine-Tuning

arXiv 2605.21127 ↗First posted 20 May 2026cs.LGcited by 4

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Explicit reasoning models are trained to produce intermediate reasoning traces before final answers, but downstream fine-tuning is often performed on ordinary instruction--response data that contains no such traces. We show that this mismatch can induce reasoning-trace collapse: a fine-tuned model continues to produce plausible final answers while losing the structurally valid explicit reasoning traces that made it a reasoning model in the first place. We introduce a structural evaluation framework that separates answer correctness from reasoning-trace validity, measuring valid, empty, missing, and truncated reasoning alongside reasoning-conditioned task performance. Using this framework, we study four open-weight reasoning models and find that standard supervised fine-tuning can rapidly suppress valid reasoning traces, and that answer-only metrics can substantially obscure this failure: in several settings, performance conditional on valid reasoning remains high while the rate of valid reasoning falls sharply. We further show that simple loss-masking strategies can substantially mitigate collapse without requiring teacher-generated reasoning traces. These results suggest that evaluations of fine-tuned reasoning models should report structural reasoning reliability metrics in addition to final-answer performance, especially when adaptation data does not contain explicit reasoning traces.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 23 of its 34 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

23 of 34 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024On the Impact of Fine-Tuning on Chain-of-Thought Reasoning22 Nov
  2. 2023SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning1 Aug

Other references · 21

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2023Let's Verify Step by Stepcited by 3,789
  4. 2022Emergent Abilities of Large Language Modelscited by 2,512
  5. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  6. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
  7. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 737
  8. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  9. 2024LoRA Learns Less and Forgets Lesscited by 328
  10. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  11. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
  12. 2026Self-Distillation Enables Continual Learningcited by 247
9 more
  1. 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 204
  2. 2024A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthinesscited by 127
  3. 2023SCOTT: Self-Consistent Chain-of-Thought Distillationcited by 105
  4. 2024LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Modelscited by 70
  5. 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 63
  6. 2025A Survey on Post-training of Large Language Modelscited by 54
  7. 2024Keypoint-based Progressive Chain-of-Thought Distillation for LLMscited by 23
  8. 2025Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Studycited by 17
  9. 2025A Comprehensive Evaluation of Multilingual Chain-of-Thought Reasoning: Performance, Consistency, and Faithfulness Across Languagescited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Models
  2. 2025Scale or Reason? A Compute-Equivalent Analysis of Reasoning Distillation
  3. 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verification
  4. 2025In Their Own Words: Reasoning Traces Tailored for Small Models Make Them Better Reasoners
  5. 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
  6. 2026Efficient Test-Time Scaling via Temporal Reasoning Aggregation
  7. 2025Reasoning or Retrieval? A Study of Answer Attribution on Large Reasoning Models
  8. 2026Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models