mlsanityData to 14 Oct 2026

EntroRouter: Learning Efficient Model Routing via Entropy Regulation

arXiv 2606.29424 ↗First posted 28 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Model routing balances solution accuracy and computational cost by selecting among models of varying capabilities. While recent multi-round frameworks interleave reasoning and planning, we identify a structural failure mode termed Trust Region Collapse. We demonstrate that the deep coupling of reasoning and routing, exacerbated by the dominance of strong pre-training priors under sparse supervision, leads to degenerate local optima where capable experts are systematically suppressed. To decouple these processes, we propose EntroRouter, a single-round routing framework that treats entropy regulation as a core objective. We first initialize the policy via Soft Supervision, fitting a distribution of suitable models to establish a high-entropy prior for exploration. Subsequently, we stabilize Reinforcement Learning using a Soft Anchor, which utilizes offline capability estimates to orchestrate controlled entropy contraction within a safe trust region. Extensive experiments demonstrate that EntroRouter retains 98.3% of the strongest expert's accuracy while reducing computational costs by 48.25%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

15 of 25 references.

References · 15

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  6. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  7. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  8. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
  9. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  10. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 297
  11. 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 280
  12. 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 174
3 more
  1. 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 165
  2. 2023Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modelingcited by 95
  3. 2025BEST-Route: Adaptive LLM Routing with Test-Time Optimal Computecited by 67

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026T-Router: Learning Thalamic Routing for Reasoning with Parameter-Efficient Reinforcement Learning
  2. 2026ERPO: Token-Level Entropy-Regulated Policy Optimization for Large Reasoning Models
  3. 2026CounterRoute: Self-Routed Reasoning via Hierarchical Counterfactual Credit Assignment
  4. 2026Policy-Guided Stepwise Model Routing for Cost-Effective Reasoning
  5. 2026STARE: Surprisal-Guided Token-Level Advantage Reweighting for Policy Entropy Stability
  6. 2026Entropy-Adaptive Fine-Tuning: Resolving Confident Conflicts to Mitigate Forgetting
  7. 2026Tool-Aware Optimization with Entropy Guidance for Efficient Agentic Reinforcement Learning
  8. 2026Depth-Entropy Guided Sampling for Training-Free LLM Reasoning