When Can Large Reasoning Models Save Thinking? Mechanistic Analysis of Behavioral Divergence in Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large reasoning models (LRMs) have achieved remarkable success on complex tasks, yet their tendency to "overthink" leads to inefficiencies. Although "save-thinking" prompts are intended to mitigate this issue, we find that LRMs still frequently enter the "Still-thinking" mode instead of the expected "No-thinking" mode, especially on difficult queries. To analyze this behavioral divergence, we examine LRMs from three perspectives: confidence at the thinking-termination boundary, divergence in internal attention distributions, and attention allocation across prompt segments. We find that high perplexity is associated with later Still-thinking behavior, and that Still-thinking cases allocate more attention to the original question. Based on these observations, we propose an attention intervention method to regulate this behavior. While this intervention suppresses explicit thinking, it also causes a drop in accuracy, suggesting that the suppressed reasoning behavior is often useful for correctness. Our work provides confidence- and attention-level evidence for this behavior, highlighting the trade-off between instruction following, inference efficiency, and reasoning correctness.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 19 of its 33 references that are in the map. First posted on arXiv 21 May 2025.
Builds on
19 of 33 references.
Closest ancestors · 7
Same direction, newest first
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Reasoning Models Can Be Effective Without Thinking14 Apr
- 2025Thinking Out Loud: Do Reasoning Models Know When They're Right?9 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025s1: Simple test-time scaling31 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
Other references · 12
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023A Survey of Large Language Modelscited by 2,576
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
- 2024The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunitiescited by 64
- 2025Mitigating Lost-in-Retrieval Problems in Retrieval Augmented Multi-Hop Question Answeringcited by 22
- 2024Mathify: Evaluating Large Language Models on Mathematical Problem Solving Taskscited by 12
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
- 2026Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failurescited by 6
- 2025The Zero-Step Thinking: An Empirical Study of Mode Selection as Harder Early Exit in Reasoning Modelscited by 4
- 2025Answering the Unanswerable Is to Err Knowingly: Analyzing and Mitigating Abstention Failures in Large Reasoning Modelscited by 3
- 2026QA-Merging: Query-Adaptive Reasoning via Layer Selective Model Mergingcited by 1
- 2026</think> Doesn't Stop Reasoning: Analysis of Spurious CoT Terminationcited by 1
- 2026The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commercecited by 0
- 2026</think> Doesn't Stop Reasoning: Analysis of Spurious CoT Termination3 Sep 2026
- 2026The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce31 Aug 2026
- 2026Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures11 Jan 2026
- 2026QA-Merging: Query-Adaptive Reasoning via Layer Selective Model Merging7 Jan 2026
- 2025The Zero-Step Thinking: An Empirical Study of Mode Selection as Harder Early Exit in Reasoning Models22 Oct 2025
- 2025Answering the Unanswerable Is to Err Knowingly: Analyzing and Mitigating Abstention Failures in Large Reasoning Models26 Aug 2025
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Survey13 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
- 2025Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories
- 2025Measuring the Faithfulness of Thinking Drafts in Large Reasoning Models
- 2025Longer Context, Deeper Thinking: Uncovering the Role of Long-Context Ability in Reasoning
- 2025Reasoning Strategies in Large Language Models: Can They Follow, Prefer, and Optimize?
- 2025Think How to Think: Mitigating Overthinking with Autonomous Difficulty Cognition in Large Reasoning Models
- 2026Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models
- 2025What makes Reasoning Models Different? Follow the Reasoning Leader for Efficient Decoding