EntroRouter: Learning Efficient Model Routing via Entropy Regulation
Not on the map. Why?
Abstract (arXiv)
Model routing balances solution accuracy and computational cost by selecting among models of varying capabilities. While recent multi-round frameworks interleave reasoning and planning, we identify a structural failure mode termed Trust Region Collapse. We demonstrate that the deep coupling of reasoning and routing, exacerbated by the dominance of strong pre-training priors under sparse supervision, leads to degenerate local optima where capable experts are systematically suppressed. To decouple these processes, we propose EntroRouter, a single-round routing framework that treats entropy regulation as a core objective. We first initialize the policy via Soft Supervision, fitting a distribution of suitable models to establish a high-entropy prior for exploration. Subsequently, we stabilize Reinforcement Learning using a Soft Anchor, which utilizes offline capability estimates to orchestrate controlled entropy contraction within a safe trust region. Extensive experiments demonstrate that EntroRouter retains 98.3% of the strongest expert's accuracy while reducing computational costs by 48.25%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
15 of 25 references.
References · 15
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 297
- 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 280
- 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 174
3 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026T-Router: Learning Thalamic Routing for Reasoning with Parameter-Efficient Reinforcement Learning
- 2026ERPO: Token-Level Entropy-Regulated Policy Optimization for Large Reasoning Models
- 2026CounterRoute: Self-Routed Reasoning via Hierarchical Counterfactual Credit Assignment
- 2026Policy-Guided Stepwise Model Routing for Cost-Effective Reasoning
- 2026STARE: Surprisal-Guided Token-Level Advantage Reweighting for Policy Entropy Stability
- 2026Entropy-Adaptive Fine-Tuning: Resolving Confident Conflicts to Mitigate Forgetting
- 2026Tool-Aware Optimization with Entropy Guidance for Efficient Agentic Reinforcement Learning
- 2026Depth-Entropy Guided Sampling for Training-Free LLM Reasoning