# Diagnosing Harmful Continuation in Answer-Correct Long-CoT Training Traces

arXiv: https://arxiv.org/abs/2605.29288 · HTML: https://mlsanity.com/paper/2605.29288/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning.
- Builds on 14 of its 27 references that are in the map.
- First posted on arXiv 28 May 2026.

## Placed in

- LLM reasoning / [Test-time compute and efficient thinking](https://mlsanity.com/lr/test-time-compute-and-efficient-thinking/)

## Builds on (most cited first, 14 of 14)

- [Qwen3 Technical Report](https://mlsanity.com/paper/2505.09388/) (2025)
- [Chain of Draft: Thinking Faster by Writing Less](https://mlsanity.com/paper/2502.18600/) (2025)
- [O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning](https://mlsanity.com/paper/2501.12570/) (2025)
- [The Best Instruction-Tuning Data are Those That Fit](https://mlsanity.com/paper/2502.04194/) (2025)
- [Deconstructing Long Chain-of-Thought: A Structured Reasoning Optimization Framework for Long CoT Distillation](https://mlsanity.com/paper/2503.16385/) (2025)
- [Not All Correct Answers Are Equal: Why Your Distillation Source Matters](https://mlsanity.com/paper/2505.14464/) (2025)
- [Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment](https://mlsanity.com/paper/2601.14249/) (2026)
- [Shape of Thought: When Distribution Matters More than Correctness in Reasoning Tasks](https://mlsanity.com/paper/2512.22255/) (2025)
- [Probing the Trajectories of Reasoning Traces in Large Language Models](https://mlsanity.com/paper/2601.23163/) (2026)
- [Long-Chain Reasoning Distillation via Adaptive Prefix Alignment](https://mlsanity.com/paper/2601.10064/) (2026)
- [Distilling the Essence: Efficient Reasoning Distillation via Sequence Truncation](https://mlsanity.com/paper/2512.21002/) (2025)
- [On the Role of Reasoning Patterns in the Generalization Discrepancy of Long Chain-of-Thought Supervised Fine-Tuning](https://mlsanity.com/paper/2604.01702/) (2026)
- [Learning from Partial Chain-of-Thought via Truncated-Reasoning Self-Distillation](https://mlsanity.com/paper/2603.13274/) (2026)
- [Empowering Lightweight MLLMs with Reasoning via Long CoT SFT](https://mlsanity.com/paper/2509.03321/) (2025)

## Abstract (arXiv)

Long chain-of-thought (CoT) traces are widely used as supervision for reasoning-oriented LLM SFT, yet answer-correct traces can still lead to markedly different fine-tuning outcomes. We study post-conclusion continuation in answer-correct long-CoT data: a continuation where the answer appears sufficiently supported, but the trace continues with additional reasoning that remains in the supervised target. To test its training effect, we use a delete-only editor to construct answer-preserving suffix removal and compare CoT-based SFT on the original and processed traces. We observe improved SFT outcomes after removing the editor-identified post-conclusion continuation, suggesting that this continuation is harmful to training in our setting. We therefore refer to this empirically supported phenomenon as harmful continuation. Beyond this intervention, we further characterize the removed post-conclusion continuation through uncertainty and hidden-state progress. We observe persistent local uncertainty together with weakened terminal-directional progress, forming an uncertainty--geometry mismatch. Finally, we instantiate Harmful Continuation Cut (HCC), a lightweight boundary proxy that approximates the editor-identified post-conclusion continuation boundary.
