Does Your Reasoning Model Implicitly Know When to Stop Thinking?
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Recent advancements in large reasoning models (LRMs) have greatly improved their capabilities on complex reasoning tasks through Long Chains of Thought (CoTs). However, this approach often results in substantial redundancy, impairing computational efficiency and causing significant delays in real-time applications. Recent studies show that longer reasoning chains are frequently uncorrelated with correctness and can even be detrimental to accuracy. In a further in-depth analysis of this phenomenon, we surprisingly uncover and empirically verify that LRMs implicitly know the appropriate time to stop thinking, while this capability is obscured by current sampling paradigms. Motivated by this, we introduce SAGE (Self-Aware Guided Efficient Reasoning), a novel sampling paradigm that unleashes this efficient reasoning potential. Furthermore, integrating SAGE as mixed sampling into group-based reinforcement learning (SAGE-RL) enables SAGE-RL to effectively incorporate SAGE-discovered efficient reasoning patterns into standard pass@1 inference, markedly enhancing both the reasoning accuracy and efficiency of LRMs across multiple challenging mathematical benchmarks.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 70 of its 115 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
70 of 115 references.
Closest ancestors · 29
Same direction, newest first
- 2025SpecExit: Accelerating Large Reasoning Model via Speculative Exit29 Sep
- 2025Promoting Efficient Reasoning with Verifiable Stepwise Reward14 Aug
- 2025Optimizing Length Compression in Large Reasoning Models17 Jun
- 2025CyclicReflex: Improving Reasoning Models via Cyclical Reflection Token Scheduling4 Jun
- 2025AdaCtrl: Towards Adaptive and Controllable Reasoning via Difficulty-Aware Budgeting24 May
- 2025Don't Overthink it. Preferring Shorter Thinking Chains for Improved LLM Reasoning23 May
- 2025Optimizing Anytime Reasoning via Budget Relative Policy Optimization19 May
- 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
- 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning8 May
- 2025ShorterBetter: Guiding Reasoning Models to Find Optimal Inference Length for Efficient Reasoning30 Apr
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Models18 Apr
17 more
- 2025Reasoning Models Can Be Effective Without Thinking14 Apr
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
- 2025Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead31 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
- 2025Self-Training Elicits Concise Reasoning in Large Language Models27 Feb
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
- 2025Reward-Guided Speculative Decoding for Efficient LLM Reasoning31 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Token-Budget-Aware LLM Reasoning24 Dec
- 2024Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation3 Oct
- 2024Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoning19 Jan
- 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMs19 May
Other references · 41
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Let's Verify Step by Stepcited by 3,598
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
29 more
- 2025Group Sequence Policy Optimizationcited by 788
- 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 505
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 276
- 2025Training Language Models to Reason Efficientlycited by 242
- 2023ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Modelscited by 184
- 2025Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyondcited by 175
- 2024Distilling System 2 into System 1cited by 152
- 2025Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuningcited by 121
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 116
- 2025Act Only When It Pays: Efficient Reinforcement Learning for LLM Reasoning via Selective Rolloutscited by 108
- 2024On Designing Effective RL Reward at Training Time for LLM Reasoningcited by 87
- 2025S-GRPO: Early Exit via Reinforcement Learning in Reasoning Modelscited by 87
- 2025GRPO-LEAD: A Difficulty-Aware Reinforcement Learning Approach for Concise Mathematical Reasoning in Language Modelscited by 81
- 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoningcited by 75
- 2023HIPTrack: Visual Tracking with Historical Promptscited by 71
- 2024Can Language Models Learn to Skip Steps?cited by 59
- 2025Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Modelscited by 51
- 2025ARM: Adaptive Reasoning Modelcited by 38
- 2022SparseTT: Visual Tracking with Sparse Transformerscited by 36
- 2026Your Group-Relative Advantage Is Biasedcited by 32
- 2025FastCuRL: Curriculum Reinforcement Learning with Stage-wise Context Scaling for Efficient Training R1-like Reasoning Modelscited by 26
- 2025Adaptive Batch-Wise Sample Scheduling for Direct Preference Optimizationcited by 16
- 2025AdaMCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Multilingual Chain-of-Thoughtcited by 14
- 2025Interpretable Unsupervised Joint Denoising and Enhancement for Real-World low-light Scenarioscited by 11
- 2025LLMBoost: Make Large Language Models Stronger with Boostingcited by 8
- 2026PRPO: Aligning Process Reward with Outcome Reward in Policy Optimizationcited by 7
- 2025SeeDNorm: Self-Rescaled Dynamic Normalizationcited by 6
- 2026Anchored Policy Optimization: Mitigating Exploration Collapse Via Support-Constrained Rectificationcited by 5
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026Heterogeneous Agent Collaborative Reinforcement Learningcited by 13
- 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolutioncited by 12
- 2026Counterfactual Credit Policy Optimization for Multi-Agent Collaborationcited by 10
- 2026Adaptive Robust Estimator for Multi-Agent Reinforcement Learningcited by 2
- 2026Policy Improvement Reinforcement Learningcited by 2
- 2026Uni-MDTrack: Learning Decoupled Memory and Dynamic States for Parameter-Efficient Visual Tracking in All Modalitycited by 1
- 2026CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoningcited by 1
- 2026VistaHop: Benchmarking Long-Horizon Visual DeepSearchcited by 1
- 2026Dynamic Rollout Editing for Reducing Overthinking in RL-Trained Reasoning Modelscited by 1
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Themcited by 1
- 2026Placing Puzzle Pieces Where They Matter: A Question Augmentation Framework for Reinforcement Learningcited by 0
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesiscited by 0
5 more
- 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Trackingcited by 0
- 2026Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMscited by 0
- 2026Constraint-First Reasoning: A Training-Free Protocol for Exploiting Answer-Space Constraints in Mathematical Problem Solvingcited by 0
- 2026WDL-OPD: Weak-Driven On-Policy Distillation via Mixture-Constrained Co-Trainingcited by 0
- 2026Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiencycited by 0
- 2026Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency25 Sep 2026
- 2026WDL-OPD: Weak-Driven On-Policy Distillation via Mixture-Constrained Co-Training10 Aug 2026
- 2026Constraint-First Reasoning: A Training-Free Protocol for Exploiting Answer-Space Constraints in Mathematical Problem Solving5 Aug 2026
- 2026Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMs3 Aug 2026
- 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking1 Aug 2026
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them30 Jul 2026
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesis24 Jun 2026
- 2026Dynamic Rollout Editing for Reducing Overthinking in RL-Trained Reasoning Models16 Jun 2026
- 2026VistaHop: Benchmarking Long-Horizon Visual DeepSearch2 Jun 2026
- 2026CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoning19 May 2026
- 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution29 Apr 2026
- 2026Placing Puzzle Pieces Where They Matter: A Question Augmentation Framework for Reinforcement Learning17 Apr 2026
5 more
- 2026Policy Improvement Reinforcement Learning1 Apr 2026
- 2026Adaptive Robust Estimator for Multi-Agent Reinforcement Learning23 Mar 2026
- 2026Counterfactual Credit Policy Optimization for Multi-Agent Collaboration23 Mar 2026
- 2026Uni-MDTrack: Learning Decoupled Memory and Dynamic States for Parameter-Efficient Visual Tracking in All Modality15 Mar 2026
- 2026Heterogeneous Agent Collaborative Reinforcement Learning3 Mar 2026
- 2026Counterfactual Credit Policy Optimization for Multi-Agent Collaborationcited by 10
- 2026Adaptive Robust Estimator for Multi-Agent Reinforcement Learningcited by 2
- 2026CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoningcited by 1
- 2026Dynamic Rollout Editing for Reducing Overthinking in RL-Trained Reasoning Modelscited by 1
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Themcited by 1
- 2026Placing Puzzle Pieces Where They Matter: A Question Augmentation Framework for Reinforcement Learningcited by 0
- 2026Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMscited by 0
- 2026Constraint-First Reasoning: A Training-Free Protocol for Exploiting Answer-Space Constraints in Mathematical Problem Solvingcited by 0
- 2026Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiencycited by 0
- 2026Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency25 Sep 2026
- 2026Constraint-First Reasoning: A Training-Free Protocol for Exploiting Answer-Space Constraints in Mathematical Problem Solving5 Aug 2026
- 2026Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMs3 Aug 2026
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them30 Jul 2026
- 2026Dynamic Rollout Editing for Reducing Overthinking in RL-Trained Reasoning Models16 Jun 2026
- 2026CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoning19 May 2026
- 2026Placing Puzzle Pieces Where They Matter: A Question Augmentation Framework for Reinforcement Learning17 Apr 2026
- 2026Adaptive Robust Estimator for Multi-Agent Reinforcement Learning23 Mar 2026
- 2026Counterfactual Credit Policy Optimization for Multi-Agent Collaboration23 Mar 2026
- 2026VistaHop: Benchmarking Long-Horizon Visual DeepSearchcited by 1
- 2026VistaHop: Benchmarking Long-Horizon Visual DeepSearch2 Jun 2026
- 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolutioncited by 12
- 2026Policy Improvement Reinforcement Learningcited by 2
- 2026Uni-MDTrack: Learning Decoupled Memory and Dynamic States for Parameter-Efficient Visual Tracking in All Modalitycited by 1
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesiscited by 0
- 2026WDL-OPD: Weak-Driven On-Policy Distillation via Mixture-Constrained Co-Trainingcited by 0
- 2026WDL-OPD: Weak-Driven On-Policy Distillation via Mixture-Constrained Co-Training10 Aug 2026
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesis24 Jun 2026
- 2026MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution29 Apr 2026
- 2026Policy Improvement Reinforcement Learning1 Apr 2026
- 2026Uni-MDTrack: Learning Decoupled Memory and Dynamic States for Parameter-Efficient Visual Tracking in All Modality15 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories
- 2025How Far Are We from Optimal Reasoning Efficiency?
- 2025Lost at the Beginning of Reasoning
- 2026Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures
- 2025Don't Think Longer, Think Wisely: Optimizing Thinking Dynamics for Large Reasoning Models
- 2025OThink-R1: Intrinsic Fast/Slow Thinking Mode Switching for Over-Reasoning Mitigation
- 2025Not All Thoughts are Generated Equal: Efficient LLM Reasoning via Multi-Turn Reinforcement Learning
- 2025Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement