mlsanityData to 14 Oct 2026

Lost in Implicit Routing: How LLM Agents Fail to Load Relevant Skills at Scale

arXiv 2610.18522 ↗First posted 13 Oct 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Reusable skills let LLM agents load task-specific instructions on demand, but they make execution depend on implicit routing over skill metadata. We test whether this design scales by holding SkillsBench tasks and their golden skills fixed while adding irrelevant skills. We find skill routing collapse: agents increasingly load fewer or no skills, even though the relevant skills remain available. With 1,000 irrelevant skills, loaded-skill recall falls from 73.6% to 27.4% and the zero-load rate rises from 9.3% to 51.6%, whereas explicit selection from the same library retains 73.9% recall. Loading other skills, including plausible alternatives to golden skills, is too rare to explain this decline. Masking only the descriptions of irrelevant skills largely restores skill loading, yet with the metadata intact, explicitly asking agents to plan skill use still yields lower recall than preselection. These findings point to semantic interference from descriptions and instruction interference when skill choice competes with task execution. We also evaluate explicit preselection as a practical mitigation, including its coverage and latency trade-offs. Our analysis informs skill protocols and evaluation for agents with growing skill libraries.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 22 of its 35 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

22 of 35 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
  2. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb
  3. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality8 Feb

Other references · 19

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  7. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  8. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  9. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  10. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
  11. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  12. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
7 more
  1. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  2. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
  3. 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 217
  4. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
  5. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
  6. 2025Context Length Alone Hurts LLM Performance Despite Perfect Retrievalcited by 127
  7. 2025ReUseIt: Synthesizing Reusable AI Agent Workflows for Web Automationcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillRouter: Skill Routing for LLM Agents at Scale
  2. 2026The Router Within: Eliciting Native Skill Routing from a Frozen LLM
  3. 2026More Skills, Worse Agents? Skill Shadowing Degrades Performance When Expanding Skill Libraries
  4. 2026How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settings
  5. 2026Demystifying Agent Skills: Why They Work-Until They Don't
  6. 2026SkillsInjector: Dynamic Skill Context Construction for LLM Agents
  7. 2026Skill Following: Evaluating Actual Skill Use in Retrieval-Enabled LLM Agents
  8. 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents