EntroCut: Entropy-Guided Adaptive Truncation for Efficient Chain-of-Thought Reasoning in Small-scale Large Reasoning Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Reasoning Models (LRMs) excel at complex reasoning tasks through extended chain-of-thought generation, but their reliance on lengthy intermediate steps incurs substantial computational cost. We find that the entropy of the model's output distribution in early reasoning steps reliably distinguishes correct from incorrect reasoning. Motivated by this observation, we propose EntroCut, a training-free method that dynamically truncates reasoning by identifying high-confidence states where reasoning can be safely terminated. To comprehensively evaluate the trade-off between efficiency and accuracy, we introduce the Efficiency-Performance Ratio (EPR), a unified metric that quantifies relative token savings per unit accuracy loss. Experiments on four benchmarks show that EntroCut reduces token usage by up to 40% with minimal accuracy sacrifice, achieving superior efficiency-performance trade-offs compared with existing training-free methods. These results demonstrate that entropy-guided dynamic truncation provides a practical approach to mitigate the inefficiency of LRMs.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 16 of its 19 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
16 of 19 references.
Closest ancestors · 11
Same direction, newest first
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Efficient Reasoning Models: A Survey15 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
- 2025s1: Simple test-time scaling31 Jan
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Token-Budget-Aware LLM Reasoning24 Dec
Other references · 5
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2024Can Language Models Learn to Skip Steps?cited by 59
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026ENTRA: Entropy-Based Redundancy Avoidance in Large Language Model Reasoning
- 2025Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens
- 2026Demystifying Entropy-based Selection for Chain-of-Thought Compression in Large Reasoning Models
- 2025Think Just Enough: Sequence-Level Entropy as a Confidence Signal for LLM Reasoning
- 2026EntroCoT: Enhancing Chain-of-Thought via Adaptive Entropy-Guided Segmentation
- 2026Shorthand for Thought: Compressing LLM Reasoning via Entropy-Guided Supertokens
- 2025Entropy-Guided Loop: Achieving Reasoning through Uncertainty-Aware Generation
- 2025Efficient Inference for Large Reasoning Models: A Survey