SkillOps: Managing LLM Agent Skill Libraries as Self-Maintaining Software Ecosystems
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Large language model agents increasingly rely on skill libraries for multi-step tasks, yet these libraries can accumulate persistent defects as skills are added, reused, patched, and linked to changing dependencies. We call this failure mode skill technical debt: library-level defects that may not break a single skill locally but can harm future retrieval, composition, and execution. Existing skill-based agents mainly focus on task-time retrieval, planning, and repair, while library-time maintenance remains underexplored. We propose SkillOps, a method-agnostic plug-in framework for maintaining skill libraries. SkillOps represents each skill as a typed Skill Contract (P, O, A, V, F), organizes skills with a Hierarchical Skill Ecosystem Graph, and diagnoses library health across utility, compatibility, risk, and validation dimensions. Given a raw skill library, SkillOps produces a maintained library that can be used by existing retrieval or planning agents without changing their internal code. On ALFWorld, SkillOps achieves 79.5 percent task success as a standalone agent, outperforming the strongest baseline by 8.8 percentage points with no additional task-time large language model calls. As a plug-in layer, it improves retrieval-heavy baselines by 0.68 to 2.90 percentage points. The current rule-based maintenance implementation uses nearly zero library-time large language model calls or tokens, showing that skill-library maintenance can be added as a low-overhead architectural layer.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 18 of its 26 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
18 of 26 references.
Closest ancestors · 3
Same direction, newest first
- 2026GraSP: Graph-Structured Skill Compositions for LLM Agents20 Apr
- 2026Graph-of-Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills7 Apr
- 2025Reinforcement Learning for Self-Improving Agent with Skill Library18 Dec
Other references · 15
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
- 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 184
- 2025VeriGuard: Enhancing LLM Agent Safety via Verified Code Generationcited by 49
- 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resourcescited by 41
- 2025LEGOMem: Modular Procedural Memory for Multi-agent LLM Systems for Workflow Automationcited by 40
3 more
- 2024Test-Driven Development for Code Generationcited by 34
- 2019Process Mining for Python (PM4Py): Bridging the Gap Between Process- and Data Sciencecited by 33
- 2026CUA-Skill: Develop Skills for Computer Using Agentcited by 33
Built on by
Citing papers per year: 2026: 18.
18 papers.
Sort:
By area:
- 2026SKILLC: Learning Autonomous Skill Internalization in LLM Agents via Contrastive Credit Assignmentcited by 9
- 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remembercited by 7
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agentscited by 5
- 2026Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agentscited by 4
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 4
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
- 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintainedcited by 2
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gapscited by 1
- 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Librariescited by 1
- 2026Repo2Skill-Evo: Repository Skills Go Stale in Silencecited by 0
6 more
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Securitycited by 0
- 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QAcited by 0
- 2026EnSIMem: Entity-Structured Indexing for Long-Term Agent Memorycited by 0
- 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoningcited by 0
- 2026Skill-V: Verifiable Self-Evolving Skill Library for Interactive Agentscited by 0
- 2026Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rulescited by 0
- 2026Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rules9 Oct 2026
- 2026Skill-V: Verifiable Self-Evolving Skill Library for Interactive Agents8 Oct 2026
- 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoning26 Sep 2026
- 2026EnSIMem: Entity-Structured Indexing for Long-Term Agent Memory23 Sep 2026
- 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QA17 Sep 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026Repo2Skill-Evo: Repository Skills Go Stale in Silence22 Aug 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scanners10 Aug 2026
- 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents6 Aug 2026
- 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries6 Aug 2026
- 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember31 Jul 2026
6 more
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps27 Jul 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintained1 Jul 2026
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective10 Jun 2026
- 2026Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agents27 May 2026
- 2026SKILLC: Learning Autonomous Skill Internalization in LLM Agents via Contrastive Credit Assignment27 May 2026
- 2026SKILLC: Learning Autonomous Skill Internalization in LLM Agents via Contrastive Credit Assignmentcited by 9
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agentscited by 5
- 2026Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agentscited by 4
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 4
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
- 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintainedcited by 2
- 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Librariescited by 1
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Securitycited by 0
- 2026Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rulescited by 0
- 2026Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rules9 Oct 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scanners10 Aug 2026
- 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents6 Aug 2026
- 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries6 Aug 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintained1 Jul 2026
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective10 Jun 2026
- 2026Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agents27 May 2026
- 2026SKILLC: Learning Autonomous Skill Internalization in LLM Agents via Contrastive Credit Assignment27 May 2026
- 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remembercited by 7
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gapscited by 1
- 2026Repo2Skill-Evo: Repository Skills Go Stale in Silencecited by 0
- 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QAcited by 0
- 2026EnSIMem: Entity-Structured Indexing for Long-Term Agent Memorycited by 0
- 2026Skill-V: Verifiable Self-Evolving Skill Library for Interactive Agentscited by 0
- 2026Skill-V: Verifiable Self-Evolving Skill Library for Interactive Agents8 Oct 2026
- 2026EnSIMem: Entity-Structured Indexing for Long-Term Agent Memory23 Sep 2026
- 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QA17 Sep 2026
- 2026Repo2Skill-Evo: Repository Skills Go Stale in Silence22 Aug 2026
- 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember31 Jul 2026
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps27 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents
- 2026SkillScriptBench: Benchmarking Self-Evolution of Executable Agent Skill Packages Beyond Markdown
- 2026SkillFusion: Towards Reliable Multi-Skill Composition for LLM Agents
- 2026Skilldex: A Package Manager and Registry for Agent Skill Packages with Hierarchical Scope-Based Distribution
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality
- 2026SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
- 2026SkVM: Revisiting Language VM for Skills across Heterogenous LLMs and Harnesses