mlsanityData to 14 Oct 2026

From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintained

arXiv 2607.00911 ↗First posted 1 Jul 2026cs.SEcited by 2

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

AI coding agents increasingly rely on skills: structured context bundles, typically a SKILL.md file with a YAML header and Markdown body, loaded on demand for domain knowledge, workflows, and scripts. Public registries such as skills.sh now host tens of thousands of skills, making them an emerging unit of reuse in agent-based software engineering. Yet skills have largely been viewed as agent capabilities rather than software artefacts whose content and evolution shape agent behaviour. We present the first empirical study of AI agent skills as engineered artefacts that are authored, reused, customised and maintained, across public registries and personal-use repositories. We mined 18,463 skills from skills.sh and 23,199 personal-use skills from 5,876 GitHub repositories, identifying 3,709 reuse links. LLM-based classification into SWEBOK knowledge areas (KAs) shows Software Construction dominates alongside a long tail of specialised areas. A thematic analysis of 180 skills identifies six content categories. Qualitative coding of 444 modifications reveals six themes, of which reworking operational specifications and adapting knowledge and resources are the primary target of change. Our findings show that reuse is largely a one-time copy operation: most reused skills remain near-verbatim, 53% are never modified after adoption, and subsequent local maintenance is overwhelmingly additive. Customisation primarily adapts skills to local environments, whereas evolution accretes new inline domain knowledge. Across both, a stable behavioural contract - how a skill interacts with users, monitors runtime state, and recovers from failures - remains almost untouched. These results suggest maintenance effort should focus on project-specific bindings, and that registries and tool support should enable consolidating the domain knowledge skills re-author in isolation.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 57 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

33 of 57 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026On the Impact of AGENTS.md Files on the Efficiency of AI Coding Agents28 Jan
  2. 2025Agent READMEs: An Empirical Study of Context Files for Agentic Coding17 Nov
  3. 2025On the Use of Agentic Coding Manifests: An Empirical Study of Claude Code18 Sep
  4. 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  6. 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repair25 Mar

Other references · 27

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  6. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 399
  7. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 315
  8. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
  9. 2023An Empirical Evaluation of Using Large Language Models for Automated Unit Test Generationcited by 194
  10. 2024EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instructioncited by 154
  11. 2023An Empirical Study of the Non-determinism of ChatGPT in Code Generationcited by 137
  12. 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scalecited by 105
15 more
  1. 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 96
  2. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 72
  3. 2025Model Context Protocol (MCP) at First Glance: Studying the Security and Maintainability of MCP Serverscited by 65
  4. 2020Backstabber's Knife Collection: A Review of Open Source Software Supply Chain Attackscited by 61
  5. 2022Taxonomy of Attacks on Open-Source Software Supply Chainscited by 58
  6. 2023An Empirical Study of Pre-Trained Model Reuse in the Hugging Face Deep Learning Model Registrycited by 47
  7. 2024Can LLMs Replace Manual Annotation of Software Engineering Artifacts?cited by 42
  8. 2019Small World with High Risks: A Study of Security Threats in the npm Ecosystemcited by 37
  9. 2020Sampling in Software Engineering Research: A Critical Review and Guidelinescited by 23
  10. 2017An Empirical Comparison of Dependency Network Evolution in Seven Software Packaging Ecosystemscited by 20
  11. 2018Categorizing the Content of GitHub README Filescited by 18
  12. 2026SkillOps: Managing LLM Agent Skill Libraries as Self-Maintaining Software Ecosystemscited by 18
  13. 2020An Empirical Study of Usages, Updates and Risks of Third-Party Libraries in Java Projectscited by 12
  14. 2024PeaTMOSS: A Dataset and Initial Analysis of Pre-Trained Models in Open-Source Softwarecited by 9
  15. 2026Does My README File Need To Be Updated? Exploring LLM-Based README Maintenancecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agents
  2. 2026From Anatomy to Smells: An Empirical Study of SKILL.md in Agent Skills
  3. 2026Who Maintains Agent Skills? A Longitudinal Study of Human-Governed, AI-Assisted Skill Maintenance
  4. 2026Authoring Agent Skills: A Software-Engineering Approach
  5. 2026An Empirical Study of Downstream Adaptation for Agent Skills
  6. 2026Scanning the Harness: A Repository Study of Configuration Exposures in AI Coding Agents
  7. 2026SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?
  8. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries