mlsanityData to 14 Oct 2026

The Router Within: Eliciting Native Skill Routing from a Frozen LLM

arXiv 2609.15982 ↗First posted 14 Sep 2026cs.LG cs.AI cs.CLcited by 1

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Skills extend an LLM agent beyond its parametric knowledge, and the gain they promise rests on picking the right one. Deployed harnesses route by preloading every skill's metadata into the context, which disperses the agent's attention and caps the library size. Retrieval pipelines move the selection out of the context, but also out of the agent's capability. We show that the frozen agent LLM already carries the routing signal in its own forward passes, and that two linear maps suffice to read it out with no skill text in the context. Our Gavel (Glance And Verdict from a frozen LLM) reads it in two steps. A glance scores the full library by matching the task's mid-layer states against a compact bank that one forward pass builds for each skill at installation, with the two maps as the only trained parameters. A verdict then resumes each shortlisted skill's forward pass, reads the model's own likelihood and yes/no judgment, and fuses both with the glance as a product of experts. Trained once, Gavel transfers zero-shot to three public benchmarks and SkillTraj, our new benchmark of 372 simulated agent trajectories. On Qwen3-32B it outperforms progressive disclosure and retrieve-and-rerank pipelines that add 1.2B to 16B external parameters, by up to 13.4 points on written tasks and up to 21.9 when the need for a skill arises mid-rollout. Routing accuracy improves as the backbone does, and in a bash-agent harness Gavel lets the 32B trigger the right skill on Skill-Use more often than models of up to 1.6T parameters in Codex.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 38 of its 46 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

38 of 46 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Optimal Skill Selection for LLM Agents with Provable Bicriteria Guarantees20 Aug
  2. 2026Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?5 Aug
  3. 2026Skill Is Not Document: Query-Conditioned Compatibility for LLM Agent Skill Routing2 Jun
  4. 2026The Scaling Laws of Skills in LLM Agent Systems15 May
  5. 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents7 May
  6. 2026Skill Retrieval Augmentation for Agentic AI27 Apr
  7. 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiency31 Mar
  8. 2026SkillRouter: Skill Routing for LLM Agents at Scale23 Mar
  9. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
  10. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward12 Feb
  11. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality8 Feb

Other references · 27

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  6. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  7. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  8. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  9. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  10. 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
  11. 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 376
  12. 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 360
15 more
  1. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
  2. 2023Large Language Models are Effective Text Rankers with Pairwise Ranking Promptingcited by 307
  3. 2023Improving Text Embeddings with Large Language Modelscited by 303
  4. 2026Gemma 4 Technical Reportcited by 259
  5. 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddingscited by 240
  6. 2024Generative Representational Instruction Tuningcited by 233
  7. 2022Improving Passage Retrieval with Zero-Shot Question Generationcited by 165
  8. 2025NoLiMa: Long-Context Evaluation Beyond Literal Matchingcited by 126
  9. 2024Repetition Improves Language Model Embeddingscited by 72
  10. 2025Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coincited by 52
  11. 2025Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Modelscited by 47
  12. 2023Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Rankingcited by 44
  13. 2025ScaleMCP: Dynamic and Auto-Synchronizing Model Context Protocol Tools for LLM Agentscited by 36
  14. 2025MCP-Zero: Active Tool Discovery for Autonomous LLM Agentscited by 33
  15. 2024Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retrievercited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Lost in Implicit Routing: How LLM Agents Fail to Load Relevant Skills at Scale
  2. 2026How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settings
  3. 2026Compositional Skill Routing for LLM Agents: Decompose, Retrieve, and Compose
  4. 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale
  5. 2026SkillDAG: Self-Evolving Typed Skill Graphs for LLM Skill Selection at Scale
  6. 2026Graph-of-Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills
  7. 2026LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents
  8. 2026Learning Agent Routing From Early Experience