Nice Fold or Hero Call: Learning Budget-Efficient Thinking for Adaptive Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large reasoning models (LRMs) improve problem solving through extended reasoning, but often misallocate test-time compute. Existing efficiency methods reduce cost by compressing reasoning traces or conditioning budget on perceived difficulty, yet read the resulting pass rate as a difficulty score, leaving the zero-return regime unmodeled. As a result, they overspend on queries beyond the model's capability while compressing hard-but-solvable ones that need deeper reasoning. In this work, we formulate adaptive reasoning as a computational investment under uncertainty, where budget follows the expected return of reasoning rather than perceived difficulty. To instantiate this principle, we propose Budget-Efficient Thinking (BET), a two-stage framework that combines behavioral cold-start with GRPO under an investment-cost-aware reward. By aligning solve-or-fold decisions with rollout-derived solvability, BET learns three behaviors: (1) short solve, answering easy queries concisely; (2) nice fold, abstaining early when continued reasoning has near-zero expected return; and (3) hero call, preserving sufficient compute for hard-but-solvable queries. Across seven benchmarks and three base models, BET reduces reasoning tokens by 54% while improving up to 3.2% accuracy, and transfers zero-shot to scientific QA and logical reasoning with comparable efficiency gains. Code is available at https://github.com/houqiii/BET
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 44 of its 48 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
44 of 48 references.
Closest ancestors · 23
Same direction, newest first
- 2026CODA: Difficulty-Aware Compute Allocation for Adaptive Reasoning9 Mar
- 2025DiffAdapt: Difficulty-Adaptive Reasoning for Token-Efficient LLM Inference22 Oct
- 2025BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokens24 Aug
- 2025Aware First, Think Less: Dynamic Boundary Self-Awareness Drives Extreme Reasoning Efficiency in Large Language Models15 Aug
- 2025SABER: Switchable and Balanced Training for Efficient LLM Reasoning8 Aug
- 2025QFFT, Question-Free Fine-Tuning for Adaptive Reasoning15 Jun
- 2025Mitigating Overthinking in Large Reasoning Models via Manifold Steering28 May
- 2025Don't Think Longer, Think Wisely: Optimizing Thinking Dynamics for Large Reasoning Models27 May
- 2025AdaCtrl: Towards Adaptive and Controllable Reasoning via Difficulty-Aware Budgeting24 May
- 2025VeriThinker: Learning to Verify Makes Reasoning Model Efficient23 May
- 2025Let LRMs Break Free from Overthinking via Self-Braking Tuning20 May
- 2025ThinkSwitcher: When to Think Hard, When to Think Fast20 May
11 more
- 2025Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stage RL16 May
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Efficient Reasoning Models: A Survey15 Apr
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?31 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Token-Budget-Aware LLM Reasoning24 Dec
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
Other references · 21
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Let's Verify Step by Stepcited by 3,598
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Modelscited by 277
- 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 275
- 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 261
- 2025Training Language Models to Reason Efficientlycited by 242
9 more
- 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoningcited by 195
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2025Efficient Reinforcement Finetuning via Adaptive Curriculum Learningcited by 88
- 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 83
- 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHubcited by 53
- 2021From LSAT: The Progress and Challenges of Complex Reasoningcited by 43
- 2025The LLM Already Knows: Estimating LLM-Perceived Question Difficulty via Hidden Representationscited by 26
- 2026Knowing When to Quit: A Principled Framework for Dynamic Abstention in LLM Reasoningcited by 6
- 2026IoT-Brain: Grounding LLMs for Semantic-Spatial Sensor Schedulingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Hierarchical Budget Policy Optimization for Adaptive Reasoning
- 2025Think Smarter not Harder: Adaptive Reasoning with Inference Aware Optimization
- 2026CAT: Confidence-Adaptive Thinking for Efficient Reasoning of Large Reasoning Models
- 2026Thinking Economically: A Hierarchical Framework for Adaptive-Complexity Reasoning in LLMs
- 2026ROI-Reasoning: Rational Optimization for Inference via Pre-Computation Meta-Cognition
- 2025Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities
- 2026Stable Adaptive Thinking via Advantage Shaping and Length-Aware Gradient Regulation
- 2025When to Continue Thinking: Adaptive Thinking Mode Switching for Efficient Reasoning