SkillOrchestra: Learning to Route Agents via Skill Transfer
Not on the map. Why?
Abstract (arXiv)
Compound AI systems promise capabilities beyond those of individual models, yet their success depends critically on effective orchestration. Existing routing approaches face two limitations: (1) input-level routers make coarse query-level decisions that ignore evolving task requirements; (2) RL-trained orchestrators are expensive to adapt and often suffer from routing collapse, repeatedly invoking one strong but costly option in multi-turn scenarios. We introduce SkillOrchestra, a framework for skill-aware orchestration. Instead of directly learning a routing policy end-to-end, SkillOrchestra learns fine-grained skills from execution experience and models agent-specific competence and cost under those skills. At deployment, the orchestrator infers the skill demands of the current interaction and selects agents that best satisfy them under an explicit performance-cost trade-off. Extensive experiments across ten benchmarks demonstrate that SkillOrchestra outperforms SoTA RL-based orchestrators by up to 22.5% with 700x and 300x learning cost reduction compared to Router-R1 and ToolOrchestra, respectively. These results show that explicit skill modeling enables scalable, interpretable, and sample-efficient orchestration, offering a principled alternative to data-intensive RL-based approaches. The code is available at: https://github.com/jiayuww/SkillOrchestra.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 27 of its 53 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
27 of 53 references.
References · 27
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2024Mixtral of Expertscited by 1,785
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
15 more
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
- 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
- 2024RouterBench: A Benchmark for Multi-LLM Routing Systemcited by 222
- 2024Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generationcited by 158
- 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 154
- 2023Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Modelscited by 141
- 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systemscited by 108
- 2023Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modelingcited by 94
- 2024RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Modelscited by 84
- 2025Router-R1: Teaching LLMs Multi-Round Routing and Aggregation via Reinforcement Learningcited by 64
- 2024TensorOpera Router: A Multi-Model Router for Efficient LLM Inferencecited by 59
Built on by
Citing papers per year: 2026: 22.
22 papers.
Sort:
By area:
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
- 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agentscited by 69
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learningcited by 28
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
- 2026From Context to Skills: Can Language Models Learn from Context Skillfully?cited by 19
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026ABSTRAL: Automatic Design of Multi-Agent Systems Through Iterative Refinement and Topology Optimizationcited by 6
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026Task Decomposition-Guided Reranking for Adaptive Agent Skill Retrievalcited by 4
- 2026Procedural Memory Distillation: Online Reflection for Self-Improving Language Modelscited by 3
10 more
- 2026Uno-Orchestra: Parsimonious Agent Routing via Selective Delegationcited by 2
- 2026Hierarchical Experimentalist Agentscited by 2
- 2026Living-Harness Is an Interactive-Agent Evolvercited by 2
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensemblescited by 1
- 2026Multi-Agent Transactive Memorycited by 1
- 2026Beyond Rubrics: Exploration-Guided Evaluation Skills for Reward Modelingcited by 0
- 2026Skill-Augmented AI Agents for Medical Research Analysis: An Exploratory Multi-Model Human Evaluation in an NSCLC Transcriptomic Biomarker Taskcited by 0
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Securitycited by 0
- 2026RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agentscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agentscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents28 Sep 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026Living-Harness Is an Interactive-Agent Evolver29 Jul 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026Task Decomposition-Guided Reranking for Adaptive Agent Skill Retrieval7 Jul 2026
- 2026Procedural Memory Distillation: Online Reflection for Self-Improving Language Models1 Jul 2026
- 2026Hierarchical Experimentalist Agents28 Jun 2026
- 2026Multi-Agent Transactive Memory18 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Skill-Augmented AI Agents for Medical Research Analysis: An Exploratory Multi-Model Human Evaluation in an NSCLC Transcriptomic Biomarker Task10 Jun 2026
- 2026Beyond Rubrics: Exploration-Guided Evaluation Skills for Reward Modeling5 Jun 2026
10 more
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles21 May 2026
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applications8 May 2026
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learning7 May 2026
- 2026Uno-Orchestra: Parsimonious Agent Routing via Selective Delegation6 May 2026
- 2026From Context to Skills: Can Language Models Learn from Context Skillfully?30 Apr 2026
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolver9 Apr 2026
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering9 Apr 2026
- 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agents6 Apr 2026
- 2026ABSTRAL: Automatic Design of Multi-Agent Systems Through Iterative Refinement and Topology Optimization24 Mar 2026
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents23 Mar 2026
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
- 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agentscited by 69
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learningcited by 28
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026ABSTRAL: Automatic Design of Multi-Agent Systems Through Iterative Refinement and Topology Optimizationcited by 6
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026Task Decomposition-Guided Reranking for Adaptive Agent Skill Retrievalcited by 4
- 2026Uno-Orchestra: Parsimonious Agent Routing via Selective Delegationcited by 2
- 2026Hierarchical Experimentalist Agentscited by 2
12 most cited of 18 All 18 (JSON)
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents28 Sep 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026Living-Harness Is an Interactive-Agent Evolver29 Jul 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026Task Decomposition-Guided Reranking for Adaptive Agent Skill Retrieval7 Jul 2026
- 2026Hierarchical Experimentalist Agents28 Jun 2026
- 2026Multi-Agent Transactive Memory18 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Skill-Augmented AI Agents for Medical Research Analysis: An Exploratory Multi-Model Human Evaluation in an NSCLC Transcriptomic Biomarker Task10 Jun 2026
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applications8 May 2026
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learning7 May 2026
12 newest of 18 All 18 (JSON)