mlsanityData to 7 Oct 2026

An Empirical Study of Downstream Adaptation for Agent Skills

arXiv 2607.03238 ↗First posted 3 Jul 2026cs.SEcited by 0

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

As Large Language Model (LLM) agents become integral to modern software systems, ``skills'' have emerged as a novel unit of software reuse, enabling developers to package workflows, decision procedures, and prompt-based policies. While skills are intended for reuse, downstream developers frequently modify published skills to fit local contexts, yet little is known about the nature of such adaptations. This paper presents the first empirical study of downstream skill adaptation in public forks, to understand how published skills are adapted, and to provide implications for researchers and engineers on improving skill design, evolution, and orchestration. Specifically, we analyze 1,126 skill-adaptation instances from six widely adopted skill repositories and develop a taxonomy comprising 46 adaptation patterns organized into 13 families. Our key findings reveal a reuse paradox: although skills are intended to be easily imported and reused, developers spend a lot of effort rewriting what the skills do, fixing skill discoverability, and translating them for different tools and languages, indicating a need for better abstractions, standardized interfaces, and automated support for skill adaptation. Furthermore, adaptations are highly interdependent, with changes in one component often requiring coordinated updates elsewhere, motivating automated support for detecting inconsistent modifications. We also find that nearly one-fifth of adaptations introduce security-sensitive content within the same instruction text that governs behavior.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 27 of its 38 references that are in the map. First posted on arXiv 3 Jul 2026.

Builds on

27 of 38 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks9 Jun
  2. 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation26 May
  3. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skills22 May
  4. 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applications8 May
  5. 2026SkillRouter: Skill Routing for LLM Agents at Scale23 Mar
  6. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systems3 Mar
  7. 2026Organizing, Orchestrating, and Benchmarking Agent Skills at Ecosystem Scale2 Mar
  8. 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agents24 Feb
  9. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
  10. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward12 Feb

Other references · 17

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  3. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  4. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  5. 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 105
  6. 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scalecited by 94
  7. 2026SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?cited by 72
  8. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
  9. 2023ChatGPT Prompt Patterns for Improving Code Quality, Refactoring, Requirements Elicitation, and Software Designcited by 66
  10. 2025Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineeringcited by 64
  11. 2024Can LLMs Replace Manual Annotation of Software Engineering Artifacts?cited by 40
  12. 2022What Makes a Good Commit Message?cited by 19
5 more
  1. 2024Prompting in the Wild: An Empirical Study of Prompt Evolution in Software Repositoriescited by 16
  2. 2026SkillMOO: Multi-Objective Optimization of Agent Skills for Software Engineeringcited by 14
  3. 2025Understanding Prompt Management in GitHub Repositories: A Call for Best Practicescited by 5
  4. 2026No Attack Required: Semantic Fuzzing for Specification Violations in Agent Skillscited by 5
  5. 2026Analyzing Message-Code Inconsistency in AI Coding Agent-Authored Pull Requestscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality
  2. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries
  3. 2026An Empirical Study of Agent Skills' Downstream Utility
  4. 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintained
  5. 2026SkillMAS: Skill Co-Evolution with LLM-based Multi-Agent System
  6. 2026Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chains
  7. 2026Learning Globally Reusable Skills for Coding Agents
  8. 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?