mlsanityData to 7 Oct 2026

The Scaling Laws of Skills in LLM Agent Systems

arXiv 2605.16508 ↗First posted 15 May 2026cs.CL cs.AIcited by 3

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

As agent systems scale, skills accumulate into large reusable libraries, yet their scaling laws remain poorly understood. Across 15 frontier LLMs, 1,141 real-world skills, and over 3M routing or execution decisions, we identify two coupled laws. Routing law: single-step routing accuracy decays logarithmically with library size (R2>0.97 for all models), with errors progressing from local skill competition to cross-family drift and capture by overly general "black-hole skills". Execution law: before state realization, joint routing is approximately multiplicative, whereas correct execution can improve difficult downstream decisions by about 4×. A single parameter, the routing logarithmic decay slope b, couples the two laws: routing-side fits predict execution-side rescue across models, showing that the same library property controls both pre-execution collapse and downstream recoverability. The laws are actionable: law-guided optimization raises held-out routing accuracy from 71.3% to 91.7%, reduces hijack from 22.4% to 4.1%, and transfers directionally to downstream ClawBench and ClawMark execution settings, improving mean pass rate from 49.3% to 61.6% on ClawBench and from 28.4% to 34.5% on ClawMark. These results show that agent performance depends not only on model capability, but also on the structure, granularity, and exposure policy of the skill library.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 47 of its 69 references that are in the map. First posted on arXiv 15 May 2026.

Builds on

47 of 69 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026SkillRouter: Skill Routing for LLM Agents at Scale23 Mar
  2. 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agents24 Feb
  3. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
  4. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward12 Feb

Other references · 43

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2020Scaling Laws for Neural Language Modelscited by 6,411
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  8. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  9. 2022Emergent Abilities of Large Language Modelscited by 2,483
  10. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  11. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  12. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
31 more
  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  2. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  3. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  4. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  5. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  6. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  7. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  8. 2022MTEB: Massive Text Embedding Benchmarkcited by 623
  9. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  10. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  11. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  12. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
  13. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
  14. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  15. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 293
  16. 2025Survey on Evaluation of LLM-based Agentscited by 190
  17. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  18. 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 138
  19. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 136
  20. 2024AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Callscited by 121
  21. 2023TaskWeaver: A Code-First Agent Frameworkcited by 85
  22. 2025AI4Research: A Survey of Artificial Intelligence for Scientific Researchcited by 54
  23. 2025ComplexFuncBench: Exploring Multi-Step and Constrained Function Calling under Long-Context Scenariocited by 53
  24. 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agentscited by 39
  25. 2025xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learningcited by 16
  26. 2026EvoRoute: Experience-Driven Self-Routing LLM Agent Systemscited by 13
  27. 2025Compute Optimal Scaling of Skills: Knowledge vs Reasoningcited by 11
  28. 2025AutoTool: Efficient Tool Selection for Large Language Model Agentscited by 9
  29. 2025BiasBusters: Uncovering and Mitigating Tool Selection Bias in Large Language Modelscited by 8
  30. 2026MetaToolAgent: Towards Generalizable Tool Usage in LLMs through Meta-Learningcited by 1
  31. 2026Scaling Laws for Educational AI Agentscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026More Skills, Worse Agents? Skill Shadowing Degrades Performance When Expanding Skill Libraries
  2. 2026GraSP: Graph-Structured Skill Compositions for LLM Agents
  3. 2026Demystifying Agent Skills: Why They Work-Until They Don't
  4. 2026Agent Skills Can Be Harmful: An Empirical Study of Skill-Induced Failures in LLM Agents
  5. 2026Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agents
  6. 2026How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settings
  7. 2026Scaling LLM-Driven Multi-Agent Systems: Design Principles and Architectural Scalability Analysis
  8. 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiency