mlsanityData to 7 Oct 2026

Explainable Model Routing for Agentic Workflows

arXiv 2604.03527 ↗First posted 4 Apr 2026cs.AI cs.HCcited by 3

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Modern agentic workflows decompose complex tasks into specialized subtasks and route them to diverse models to minimize cost without sacrificing quality. However, current routing architectures focus exclusively on performance optimization, leaving underlying trade-offs between model capability and cost unrecorded. Without clear rationale, developers cannot distinguish between intelligent efficiency -- using specialized models for appropriate tasks -- and latent failures caused by budget-driven model selection. We present Topaz, a framework that introduces formal auditability to agentic routing. Topaz replaces silent model assignments with an inherently interpretable router that incorporates three components: (i) skill-based profiling that synthesizes performance across diverse benchmarks into granular capability profiles (ii) fully traceable routing algorithms that utilize budget-based and multi-objective optimization to produce clear traces of how skill-match scores were weighed against costs, and (iii) developer-facing explanations that translate these traces into natural language, allowing users to audit system logic and iteratively tune the cost-quality tradeoff. By making routing decisions interpretable, Topaz enables users to understand, trust, and meaningfully steer routed agentic systems.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 21 of its 30 references that are in the map. First posted on arXiv 4 Apr 2026.

Builds on

21 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems16 Feb
  2. 2024A Unified Approach to Routing and Cascading for LLMs14 Oct

Other references · 19

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  5. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  6. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  7. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
  8. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  9. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
  10. 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
  11. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
  12. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
7 more
  1. 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 154
  2. 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
  3. 2023Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipelinecited by 86
  4. 2025Search Arena: Analyzing Search-Augmented LLMscited by 30
  5. 2025EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Treescited by 26
  6. 2024Unearthing Skill-Level Insights for Understanding Trade-Offs of Foundation Modelscited by 9
  7. 2026Trust by Design: Skill Profiles for Transparent, Cost-Aware LLM Routingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark
  2. 2026AgentRouter: Heterogeneous Model Routing for Cost-Optimal Multi-Step Agentic Workflows
  3. 2026MetaRoute-Bench: Evaluating Meta-Decision Policies for Agentic Workflow Routing
  4. 2026TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AI
  5. 2026CASTER: Breaking the Cost-Performance Barrier in Multi-Agent Orchestration via Context-Aware Strategy for Task Efficient Routing
  6. 2026Agent-as-a-Router: Agentic Model Routing for Coding Tasks
  7. 2025TRAIL: Trace Reasoning and Agentic Issue Localization
  8. 2025Understanding and Optimizing Agentic Workflows via Shapley value