mlsanityData to 14 Oct 2026

Self-Route: Automatic Mode Switching via Capability Estimation for Efficient Reasoning

arXiv 2505.20664 ↗First posted 27 May 2025cs.CL cs.AIcited by 8

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

While reasoning-augmented large language models (RLLMs) significantly enhance complex task performance through extended reasoning chains, they inevitably introduce substantial unnecessary token consumption, particularly for simpler problems where Short Chain-of-Thought (Short CoT) suffices. This overthinking phenomenon leads to inefficient resource usage without proportional accuracy gains. To address this issue, we propose Self-Route, a dynamic reasoning framework that automatically selects between general and reasoning modes based on model capability estimation. Our approach introduces a lightweight pre-inference stage to extract capability-aware embeddings from hidden layer representations, enabling real-time evaluation of the model's ability to solve problems. We further construct Gradient-10K, a model difficulty estimation-based dataset with dense complexity sampling, to train the router for precise capability boundary detection. Extensive experiments demonstrate that Self-Route achieves comparable accuracy to reasoning models while reducing token consumption by 30-55% across diverse benchmarks. The proposed framework demonstrates consistent effectiveness across models with different parameter scales and reasoning paradigms, highlighting its general applicability and practical value.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 17 of its 25 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

17 of 25 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Language Models Can Predict Their Own Behavior18 Feb
  2. 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
  3. 2025s1: Simple test-time scaling31 Jan
  4. 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec

Other references · 13

  1. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  2. 2023Let's Verify Step by Stepcited by 3,789
  3. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  4. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  5. 2025Training Language Models to Reason Efficientlycited by 247
  6. 2023Fine-tuning Language Models for Factualitycited by 221
  7. 2024Can Language Models Learn to Skip Steps?cited by 59
  8. 2024Learning to Trust Your Feelings: Leveraging Self-awareness in LLMs for Hallucination Mitigationcited by 44
  9. 2024When to Trust LLMs: Aligning Confidence with Response Qualitycited by 43
  10. 2024Knowledge Boundary of Large Language Models: A Surveycited by 40
  11. 2024Teaching Large Language Models to Express Knowledge Boundary from Their Own Signalscited by 32
  12. 2025Evaluating o1-Like LLMs: Unlocking Reasoning for Translation through Comprehensive Analysiscited by 26
1 more
  1. 2024In Case You Missed It: ARC 'Challenge' Is Not That Challengingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 3.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection
  2. 2026Scaling of Capability and Efficiency at Inference Time in Large Reasoning Models
  3. 2026RouteWeaver: Weaving Mode Selection and Execution into Unified LLM Routing
  4. 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
  5. 2025Fast Thinking for Large Language Models
  6. 2025Confidence-Guided Stepwise Model Routing for Cost-Efficient Reasoning
  7. 2025Self-Training Elicits Concise Reasoning in Large Language Models
  8. 2025Aware First, Think Less: Dynamic Boundary Self-Awareness Drives Extreme Reasoning Efficiency in Large Language Models