mlsanityData to 14 Oct 2026

SABER: Switchable and Balanced Training for Efficient LLM Reasoning

arXiv 2508.10026 ↗First posted 8 Aug 2025cs.CL cs.AI cs.LGcited by 12

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large language models (LLMs) empowered by chain-of-thought reasoning have achieved impressive accuracy on complex tasks but suffer from excessive inference costs and latency when applied uniformly to all problems. We propose SABER (Switchable and Balanced Training for Efficient LLM Reasoning), a reinforcement learning framework that endows LLMs with user-controllable, token-budgeted reasoning. SABER first profiles each training example's base-model thinking token usage and assigns it to one of the predefined budget tiers. During fine-tuning, the model is guided by system prompts and length-aware rewards to respect its assigned budget. In parallel, we incorporate no-think examples to ensure the model remains reliable even when explicit reasoning is turned off. SABER further supports four discrete inference modes - NoThink, FastThink, CoreThink, and DeepThink, enabling flexible trade-offs between latency and reasoning depth. Extensive evaluations on math reasoning (MATH, GSM8K), code generation (MBPP), and logical reasoning (LiveBench-Reasoning) demonstrate that SABER achieves high accuracy under tight budgets, graceful degradation, and effective cross-scale and cross-domain generalization. In particular, SABER-FastThink cuts reasoning length by 65.4% and yields a 3.6% accuracy gain compared with the base model on the MATH benchmark.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 30 of its 34 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

30 of 34 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025Just Enough Thinking: Efficient Reasoning with Adaptive Length Penalties Reinforcement Learning5 Jun
  2. 2025The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models28 May
  3. 2025AdaCtrl: Towards Adaptive and Controllable Reasoning via Difficulty-Aware Budgeting24 May
  4. 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoning21 May
  5. 2025Think Only When You Need with Large Hybrid-Reasoning Models20 May
  6. 2025SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoning16 May
  7. 2025Adaptive GoGI-Skip: Coupling Goal-Gradient Importance with Dynamic Uncertainty for Efficient Reasoning13 May
  8. 2025Efficient Reasoning Models: A Survey15 Apr
  9. 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
  10. 2025Effectively Controlling Reasoning Models through Thinking Intervention31 Mar
  11. 2025Unlocking Efficient Long-to-Short LLM Reasoning with Model Merging26 Mar
  12. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
5 more
  1. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
  2. 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
  3. 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
  4. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  5. 2024Token-Budget-Aware LLM Reasoning24 Dec

Other references · 13

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2021Program Synthesis with Large Language Modelscited by 3,637
  6. 2023Qwen Technical Reportcited by 3,344
  7. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  8. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  9. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 262
  10. 2025Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questionscited by 97
  11. 2025Blending Supervised and Reinforcement Fine-Tuning with Prefix Samplingcited by 60
  12. 2025Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuningcited by 44
1 more
  1. 2024Length Desensitization in Direct Preference Optimizationcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 8.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokens
  2. 2025Token-Efficient RL for LLM Reasoning
  3. 2025Fast on the Easy, Deep on the Hard: Efficient Reasoning via Powered Length Penalty
  4. 2025In-Token Rationality Optimization: Towards Accurate and Concise LLM Reasoning via Self-Feedback
  5. 2025Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective
  6. 2026The Art of Efficient Reasoning: Data, Reward, and Optimization
  7. 2025Not All Tokens Matter: Towards Efficient LLM Reasoning via Token Significance in Reinforcement Learning
  8. 2026Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability