mlsanityData to 14 Oct 2026

What Keeps Agent Skills from Being Reusable? Evidence from 138K SKILL.md Files

arXiv 2608.08453 ↗First posted 9 Aug 2026cs.AI cs.CRcited by 1

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Under the current standard, Agent Skills are SKILL.md files that combine instructions with supporting resources, enabling Large Language Model (LLM) agents to reuse procedures beyond a single conversation. Yet many public skills appear to originate from a single task, repository, or conversation, even when they are shared as reusable components. We analyze this gap across 138,133 public SKILL.md files from 20,556 repositories using a two-tier defect taxonomy grounded in the official specification and best-practice guidance. We find that 91.8% of skills contain at least one detected defect, with stable estimates across lenient and strict thresholds (88.8-94.6%). The dominant failures are ordinary packaging problems rather than exotic attacks: weak routing metadata, bloated or non-actionable bodies, and poor resource organization. A deterministic routing stress test over 20,000 skills shows the functional impact: skills with valid routing metadata are retrieved more reliably from startup descriptions than skills with routing defects. Defect rates vary by platform and provenance: specification-aware skills contain fewer defects, while AI-marked skills show more safety and portability problems. Lightweight enforcement and repair experiments support a quality-assured generation workflow combining spec-aware prompting, lightweight linting, automated repair, and safety gating.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 9 of its 19 references that are in the map. First posted on arXiv 9 Aug 2026.

Builds on

9 of 19 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settings6 Apr
  2. 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiency31 Mar
  3. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb

Other references · 6

  1. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  2. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
  3. 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attackscited by 90
  4. 2025Control Illusion: The Failure of Instruction Hierarchies in Large Language Modelscited by 33
  5. 2026ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspacescited by 33
  6. 2026IH-Challenge: A Training Dataset to Improve Instruction Hierarchy on Frontier LLMscited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agent Skill Security: Threat Models, Attacks, Defenses, and Evaluation
  2. 2026Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?
  3. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries
  4. 2026Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chains
  5. 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintained
  6. 2026From Anatomy to Smells: An Empirical Study of SKILL.md in Agent Skills
  7. 2026Who Maintains Agent Skills? A Longitudinal Study of Human-Governed, AI-Assisted Skill Maintenance
  8. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality