mlsanityData to 14 Oct 2026

To Reason but Not to Stop: Understanding and Recovering Pruned Large Reasoning Models

arXiv 2610.19934 ↗First posted 14 Oct 2026cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Weight pruning can degrade the accuracy of large reasoning models (LRMs), yet it remains unclear whether it damages reasoning itself. We find that much of this degradation stems from a failure to stop rather than to reason. As sparsity increases, pruned LRMs increasingly fail to terminate within the token budget, often after the correct answer has appeared in their reasoning, instead falling into repetitive loops, even though they still recognize where the dense model would stop. We further find that the hidden-state difference between terminating and looping continuations is consistent across pruned checkpoints, suggesting a shared direction associated with committing to an answer. Building on this, we propose Termination-Guided Activation Steering (TGAS), a training-free method that adds this direction to the residual stream at inference time. Across six LRMs, three pruning pipelines, and math and code benchmarks, TGAS improves termination and overall accuracy while reducing repetitive reasoning and generation length, showing that this failure is actionable.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 4 of its 8 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

4 of 8 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Think Before You Prune: Self-Reflective Structured Pruning for Reasoning Language Models1 Dec

Other references · 3

  1. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,121
  2. 2023Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningcited by 415
  3. 2023On the Impact of Calibration Data in Post-training Quantization and Pruningcited by 58

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
  2. 2025Can Pruning Improve Reasoning? Revisiting Long-CoT Compression with Capability in Mind for Better Reasoning
  3. 2025Beyond Token Length: Step Pruner for Efficient and Accurate Reasoning in Large Language Models
  4. 2026OS-Pruner: Pruning Chains-of-Thought of Reasoning Models via Optimal Stopping
  5. 2025Think Before You Prune: Selective Self-Generated Calibration for Pruning Large Reasoning Models
  6. 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning
  7. 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
  8. 2026Circular Reasoning: Understanding Self-Reinforcing Loops in Large Reasoning Models