Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
The inherent capabilities of a language model (LM) and the reasoning strategies it employs jointly determine its performance in reasoning tasks. While test-time scaling is regarded as an effective approach to tackling complex reasoning tasks, it incurs substantial computational costs and often leads to "overthinking", where models become trapped in "thought pitfalls". To address this challenge, we propose Route-To-Reason (RTR), a novel unified routing framework that dynamically allocates both LMs and reasoning strategies according to task difficulty under budget constraints. RTR learns compressed representations of both expert models and reasoning strategies, enabling their joint and adaptive selection at inference time. This method is low-cost, highly flexible, and can be seamlessly extended to arbitrary black-box or white-box models and strategies, achieving true plug-and-play functionality. Extensive experiments across seven open source models and four reasoning strategies demonstrate that RTR achieves an optimal trade-off between accuracy and computational efficiency among all baselines, achieving higher accuracy than the best single model while reducing token usage by over 60%.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 48 of its 53 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
48 of 53 references.
Closest ancestors · 10
Same direction, newest first
- 2025Efficient Inference for Large Reasoning Models: A Survey29 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning25 Feb
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
- 2024Learning How Hard to Think: Input-Adaptive Allocation of LM Computation7 Oct
- 2024Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation3 Oct
- 2024Make Every Penny Count: Difficulty-Adaptive Self-Consistency for Cost-Efficient Reasoning24 Aug
- 2024DynaThink: Fast or Slow? A Dynamic Decision-Making Framework for Large Language Models1 Jul
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
Other references · 38
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2024GPT-4o System Cardcited by 4,588
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
26 more
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2017Crowdsourcing Multiple Choice Science Questionscited by 765
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2022PAL: Program-aided Language Modelscited by 652
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 372
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
- 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 263
- 2024RouterBench: A Benchmark for Multi-LLM Routing Systemcited by 238
- 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 165
- 2023Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Modelscited by 145
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
- 2024RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Modelscited by 88
- 2025Universal Model Routing for Efficient LLM Inferencecited by 86
- 2025Harnessing Multiple Large Language Models: A Survey on LLM Ensemblecited by 86
- 2025MixLLM: Dynamic Routing in Mixed Large Language Modelscited by 59
- 2024EmbedLLM: Learning Compact Representations of Large Language Modelscited by 48
- 2025Division-of-Thoughts: Harnessing Hybrid Language Model Synergy for Efficient On-Device Agentscited by 25
- 2024DOTS: Learning to Reason Dynamically in LLMs via Optimal Reasoning Trajectories Searchcited by 17
- 2020Multi-Interactive Attention Network for Fine-grained Feature Learning in CTR Predictioncited by 14
- 2025Unveiling the Magic of Code Reasoning through Hypothesis Decomposition and Amendmentcited by 6
- 2025Teaching LLMs According to Their Aptitude: Adaptive Reasoning for Mathematical Problem Solvingcited by 4
- 2024Dynamic Strategy Planning for Efficient Question Answering with Large Language Modelscited by 3
Built on by
Citing papers per year: 2025: 8; 2026: 15.
23 papers.
Sort:
By area:
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
- 2026R2-Router: A New Paradigm for LLM Routing with Reasoningcited by 14
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Modelscited by 12
- 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoningcited by 11
- 2026SWE-Router: Routing in Multi-turn Agentic Software Engineering Taskscited by 11
- 2025Learning Compact Representations of LLM Abilities via Item Response Theorycited by 10
- 2026Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimizationcited by 9
- 2026DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Modelscited by 8
- 2025IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offscited by 5
- 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inferencecited by 5
- 2026LLM Router: Rethinking Routing with Prefill Activationscited by 5
11 more
- 2026Models Under SCOPE: Scalable and Controllable Routing via Pre-hoc Reasoningcited by 4
- 2025Learning to Route: A Rule-Driven Agent Framework for Hybrid-Source Retrieval-Augmented Generationcited by 3
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
- 2025WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agentcited by 2
- 2026SeqRoute: Global Budget-Aware Sequential LLM Routing via Offline Reinforcement Learningcited by 2
- 2025CONCUR: A Framework for Continual Constrained and Unconstrained Routingcited by 1
- 2026RelayGen: Intra-Generation Model Switching for Efficient Reasoningcited by 1
- 2026PExA: Parallel Exploration Agent for Complex Text-to-SQLcited by 1
- 2026Pre-Inference Routing for Cost-Efficient Document Field Extractioncited by 1
- 2026RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoningcited by 0
- 2026DLLG: Dynamic Logit-Level Gating of LLM Expertscited by 0
- 2026Pre-Inference Routing for Cost-Efficient Document Field Extraction6 Aug 2026
- 2026SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks30 Jun 2026
- 2026DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Models22 Jun 2026
- 2026DLLG: Dynamic Logit-Level Gating of LLM Experts3 Jun 2026
- 2026SeqRoute: Global Budget-Aware Sequential LLM Routing via Offline Reinforcement Learning25 May 2026
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows7 May 2026
- 2026PExA: Parallel Exploration Agent for Complex Text-to-SQL24 Apr 2026
- 2026Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimization16 Apr 2026
- 2026LLM Router: Rethinking Routing with Prefill Activations21 Mar 2026
- 2026RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoning6 Mar 2026
- 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference27 Feb 2026
- 2026RelayGen: Intra-Generation Model Switching for Efficient Reasoning6 Feb 2026
11 more
- 2026R2-Router: A New Paradigm for LLM Routing with Reasoning2 Feb 2026
- 2026Models Under SCOPE: Scalable and Controllable Routing via Pre-hoc Reasoning29 Jan 2026
- 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoning7 Jan 2026
- 2025CONCUR: A Framework for Continual Constrained and Unconstrained Routing10 Dec 2025
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models13 Nov 2025
- 2025WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agent13 Oct 2025
- 2025Learning Compact Representations of LLM Abilities via Item Response Theory1 Oct 2025
- 2025Learning to Route: A Rule-Driven Agent Framework for Hybrid-Source Retrieval-Augmented Generation30 Sep 2025
- 2025IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs8 Sep 2025
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Models4 Aug 2025
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Survey13 Jul 2025
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
- 2026R2-Router: A New Paradigm for LLM Routing with Reasoningcited by 14
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Modelscited by 12
- 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoningcited by 11
- 2026Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimizationcited by 9
- 2026DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Modelscited by 8
- 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inferencecited by 5
- 2026LLM Router: Rethinking Routing with Prefill Activationscited by 5
- 2026Models Under SCOPE: Scalable and Controllable Routing via Pre-hoc Reasoningcited by 4
- 2026RelayGen: Intra-Generation Model Switching for Efficient Reasoningcited by 1
- 2026RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoningcited by 0
- 2026DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Models22 Jun 2026
- 2026Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimization16 Apr 2026
- 2026LLM Router: Rethinking Routing with Prefill Activations21 Mar 2026
- 2026RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoning6 Mar 2026
- 2026ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference27 Feb 2026
- 2026RelayGen: Intra-Generation Model Switching for Efficient Reasoning6 Feb 2026
- 2026R2-Router: A New Paradigm for LLM Routing with Reasoning2 Feb 2026
- 2026Models Under SCOPE: Scalable and Controllable Routing via Pre-hoc Reasoning29 Jan 2026
- 2026Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoning7 Jan 2026
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models13 Nov 2025
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Models4 Aug 2025
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Survey13 Jul 2025
- 2026SWE-Router: Routing in Multi-turn Agentic Software Engineering Taskscited by 11
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
- 2025WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agentcited by 2
- 2026PExA: Parallel Exploration Agent for Complex Text-to-SQLcited by 1
- 2026SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks30 Jun 2026
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows7 May 2026
- 2026PExA: Parallel Exploration Agent for Complex Text-to-SQL24 Apr 2026
- 2025WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agent13 Oct 2025
- 2025IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offscited by 5
- 2025CONCUR: A Framework for Continual Constrained and Unconstrained Routingcited by 1
- 2026Pre-Inference Routing for Cost-Efficient Document Field Extractioncited by 1
- 2026DLLG: Dynamic Logit-Level Gating of LLM Expertscited by 0
- 2026Pre-Inference Routing for Cost-Efficient Document Field Extraction6 Aug 2026
- 2026DLLG: Dynamic Logit-Level Gating of LLM Experts3 Jun 2026
- 2025CONCUR: A Framework for Continual Constrained and Unconstrained Routing10 Dec 2025
- 2025IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs8 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Route-and-Reason: Scaling Large Language Model Reasoning with Reinforced Model Router
- 2026Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge
- 2025Confidence-Guided Stepwise Model Routing for Cost-Efficient Reasoning
- 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoning
- 2025Self-Route: Automatic Mode Switching via Capability Estimation for Efficient Reasoning
- 2025Fast Thinking for Large Language Models
- 2025Optimizing Reasoning Efficiency through Prompt Difficulty Prediction
- 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs