mlsanityData to 14 Oct 2026

Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection

arXiv 2505.19435 ↗First posted 26 May 2025cs.CLcited by 23

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

The inherent capabilities of a language model (LM) and the reasoning strategies it employs jointly determine its performance in reasoning tasks. While test-time scaling is regarded as an effective approach to tackling complex reasoning tasks, it incurs substantial computational costs and often leads to "overthinking", where models become trapped in "thought pitfalls". To address this challenge, we propose Route-To-Reason (RTR), a novel unified routing framework that dynamically allocates both LMs and reasoning strategies according to task difficulty under budget constraints. RTR learns compressed representations of both expert models and reasoning strategies, enabling their joint and adaptive selection at inference time. This method is low-cost, highly flexible, and can be seamlessly extended to arbitrary black-box or white-box models and strategies, achieving true plug-and-play functionality. Extensive experiments across seven open source models and four reasoning strategies demonstrate that RTR achieves an optimal trade-off between accuracy and computational efficiency among all baselines, achieving higher accuracy than the best single model while reducing token usage by over 60%.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 48 of its 53 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

48 of 53 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Efficient Inference for Large Reasoning Models: A Survey29 Mar
  2. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  3. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning25 Feb
  4. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  5. 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
  6. 2024Learning How Hard to Think: Input-Adaptive Allocation of LM Computation7 Oct
  7. 2024Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation3 Oct
  8. 2024Make Every Penny Count: Difficulty-Adaptive Self-Consistency for Cost-Efficient Reasoning24 Aug
  9. 2024DynaThink: Fast or Slow? A Dynamic Decision-Making Framework for Large Language Models1 Jul
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May

Other references · 38

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  7. 2024Qwen2.5 Technical Reportcited by 4,942
  8. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  9. 2024GPT-4o System Cardcited by 4,588
  10. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  11. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  12. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
26 more
  1. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  2. 2017Crowdsourcing Multiple Choice Science Questionscited by 765
  3. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  4. 2022PAL: Program-aided Language Modelscited by 652
  5. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
  6. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  7. 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 372
  8. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  9. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
  10. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
  11. 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 263
  12. 2024RouterBench: A Benchmark for Multi-LLM Routing Systemcited by 238
  13. 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 165
  14. 2023Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Modelscited by 145
  15. 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
  16. 2024RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Modelscited by 88
  17. 2025Universal Model Routing for Efficient LLM Inferencecited by 86
  18. 2025Harnessing Multiple Large Language Models: A Survey on LLM Ensemblecited by 86
  19. 2025MixLLM: Dynamic Routing in Mixed Large Language Modelscited by 59
  20. 2024EmbedLLM: Learning Compact Representations of Large Language Modelscited by 48
  21. 2025Division-of-Thoughts: Harnessing Hybrid Language Model Synergy for Efficient On-Device Agentscited by 25
  22. 2024DOTS: Learning to Reason Dynamically in LLMs via Optimal Reasoning Trajectories Searchcited by 17
  23. 2020Multi-Interactive Attention Network for Fine-grained Feature Learning in CTR Predictioncited by 14
  24. 2025Unveiling the Magic of Code Reasoning through Hypothesis Decomposition and Amendmentcited by 6
  25. 2025Teaching LLMs According to Their Aptitude: Adaptive Reasoning for Mathematical Problem Solvingcited by 4
  26. 2024Dynamic Strategy Planning for Efficient Question Answering with Large Language Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 15.

23 papers.

Sort:

By area:

  1. 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
  2. 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
  3. 2026R2-Router: A New Paradigm for LLM Routing with Reasoningcited by 14
  4. 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Modelscited by 12
  5. 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoningcited by 11
  6. 2026SWE-Router: Routing in Multi-turn Agentic Software Engineering Taskscited by 11
  7. 2025Learning Compact Representations of LLM Abilities via Item Response Theorycited by 10
  8. 2026Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimizationcited by 9
  9. 2026DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Modelscited by 8
  10. 2025IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offscited by 5
  11. 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inferencecited by 5
  12. 2026LLM Router: Rethinking Routing with Prefill Activationscited by 5
11 more
  1. 2026Models Under SCOPE: Scalable and Controllable Routing via Pre-hoc Reasoningcited by 4
  2. 2025Learning to Route: A Rule-Driven Agent Framework for Hybrid-Source Retrieval-Augmented Generationcited by 3
  3. 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
  4. 2025WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agentcited by 2
  5. 2026SeqRoute: Global Budget-Aware Sequential LLM Routing via Offline Reinforcement Learningcited by 2
  6. 2025CONCUR: A Framework for Continual Constrained and Unconstrained Routingcited by 1
  7. 2026RelayGen: Intra-Generation Model Switching for Efficient Reasoningcited by 1
  8. 2026PExA: Parallel Exploration Agent for Complex Text-to-SQLcited by 1
  9. 2026Pre-Inference Routing for Cost-Efficient Document Field Extractioncited by 1
  10. 2026RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoningcited by 0
  11. 2026DLLG: Dynamic Logit-Level Gating of LLM Expertscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Route-and-Reason: Scaling Large Language Model Reasoning with Reinforced Model Router
  2. 2026Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge
  3. 2025Confidence-Guided Stepwise Model Routing for Cost-Efficient Reasoning
  4. 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoning
  5. 2025Self-Route: Automatic Mode Switching via Capability Estimation for Efficient Reasoning
  6. 2025Fast Thinking for Large Language Models
  7. 2025Optimizing Reasoning Efficiency through Prompt Difficulty Prediction
  8. 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs