mlsanityData to 14 Oct 2026

Rethinking Stepwise Model Routing: A Cost-Efficient Table Reasoning Perspective

arXiv 2605.29319 ↗First posted 28 May 2026cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Reasoning Models (LRMs) achieve strong performance on table reasoning tasks but incur substantial inference cost due to long reasoning traces. Stepwise model routing mitigates this issue by dynamically assigning reasoning steps to smaller or larger models. However, stepwise model routing for table reasoning remains underexplored. Through empirical analysis, we find that reasoning steps involving tables contain two types of tokens with distinct uncertainty distributions: table tokens grounded in table structure, such as cell values and headers, and text tokens representing surrounding natural-language reasoning. The uncertainty of both token types is correlated with the risk that the model makes an error in the next reasoning step. However, existing methods fail to model them separately, leading to suboptimal routing decisions. To address this, we propose EcoTab, a table-aware stepwise routing framework for efficient table reasoning. At each reasoning step, EcoTab separately estimates the uncertainties of table tokens and text tokens, maps them to next-step failure risks for the small model, and combines the two risks for routing. Experiments on multiple table reasoning benchmarks show that EcoTab consistently outperforms strong baselines and achieves a better balance between accuracy and efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 16 of its 48 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

16 of 48 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026GlimpRouter: Efficient Collaborative Inference by Glimpsing One Token of Thoughts8 Jan
  2. 2025Confidence-Guided Stepwise Model Routing for Cost-Efficient Reasoning9 Nov
  3. 2025Optimizing Reasoning Efficiency through Prompt Difficulty Prediction5 Nov

Other references · 13

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2023Let's Verify Step by Stepcited by 3,789
  4. 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 1,006
  5. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
  6. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
  7. 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 72
  8. 2025VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement Learningcited by 68
  9. 2025Table-R1: Region-based Reinforcement Learning for Table Understandingcited by 37
  10. 2025Understanding and Benchmarking Artificial Intelligence: OpenAI's o3 Is Not AGIcited by 19
  11. 2025When TableQA Meets Noise: A Dual Denoising Framework for Complex Questions and Large-scale Tablescited by 10
  12. 2025Table-r1: Self-supervised and Reinforcement Learning for Program-based Table Reasoning in Small Language Modelscited by 7
1 more
  1. 2025Table as a Modality for Large Language Modelscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge
  2. 2026RouteGoT: Node-Adaptive Routing for Cost-Efficient Graph of Thoughts Reasoning
  3. 2025Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection
  4. 2026Enhancing Table Reasoning with Deterministic Table-State Rewards
  5. 2025TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models
  6. 2026TRIM: Hybrid Inference via Targeted Stepwise Routing in Multi-Step Reasoning Tasks
  7. 2026ThinkRouter: Efficient Reasoning via Routing Thinking between Latent and Discrete Spaces
  8. 2026Policy-Guided Stepwise Model Routing for Cost-Effective Reasoning