mlsanityData to 7 Oct 2026

Revisiting Complete Reasoning Traces for Post-Training

arXiv 2609.07103 ↗First posted 7 Sep 2026cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large language models (LLMs) are often post-trained on pre-collected reasoning trajectories to improve their reasoning capability. Such trajectories tend to be long due to complex, interwoven paths, which often include detours on the path toward the answer. However, it has been underexplored whether LLMs indeed benefit from learning complete trajectories in post-training, such as supervised fine-tuning (SFT). Starting from our pilot study, we find that full trajectories provide only limited benefit, while partial trajectories are effective even under heavy truncation. We analyze redundancy in reasoning trajectories through attention-based analyses and controlled token-removal studies, both of which show that intermediate tokens contribute minimally to final reasoning quality. This suggests that avoiding redundant information may allow LLMs to internally infer coherent alternatives by inferring missing steps from their internal knowledge, given known trajectory endpoints. Furthermore, we show that training LLMs using endpoints leads to consistent changes in reasoning behavior, and that it also benefits post-training methods based on reinforcement learning or on-policy distillation, highlighting the need to revisit complete reasoning traces. Code is available at https://github.com/naver-ai/revisiting-trace.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 29 of its 59 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

29 of 59 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories1 Jul
  2. 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
  3. 2025Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Models4 Jun
  4. 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models28 May
  5. 2025Not All Tokens Are What You Need In Thinking23 May
  6. 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoning23 May
  7. 2025Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning Eliciting Efficient Reasoning in Large Language Models6 May
  8. 2025Reasoning Models Can Be Effective Without Thinking14 Apr
  9. 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr

Other references · 20

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2024GPT-4o System Cardcited by 4,467
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  9. 2023Let's Verify Step by Stepcited by 3,598
  10. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  11. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  12. 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
8 more
  1. 2024DeepSeek-V3 Technical Reportcited by 724
  2. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
  3. 2024OLMo: Accelerating the Science of Language Modelscited by 599
  4. 20242 OLMo 2 Furiouscited by 302
  5. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  6. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
  7. 2023MiniLLM: On-Policy Distillation of Large Language Modelscited by 129
  8. 2025CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratingscited by 109

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMs
  2. 2026Probing the Trajectories of Reasoning Traces in Large Language Models
  3. 2025Thinking About Thinking: Evaluating Reasoning in Post-Trained Language Models
  4. 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
  5. 2026Backtracking When It Strays: Mitigating Dual Exposure Biases in LLM Reasoning Distillation
  6. 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
  7. 2026Oops, Wait: Discourse Tokens Matter in Reasoning Model
  8. 2026Reasoning Shift: How Context Silently Shortens LLM Reasoning