mlsanityData to 14 Oct 2026

SkillOps: Managing LLM Agent Skill Libraries as Self-Maintaining Software Ecosystems

arXiv 2605.13716 ↗First posted 13 May 2026cs.SE cs.MAcited by 18

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Large language model agents increasingly rely on skill libraries for multi-step tasks, yet these libraries can accumulate persistent defects as skills are added, reused, patched, and linked to changing dependencies. We call this failure mode skill technical debt: library-level defects that may not break a single skill locally but can harm future retrieval, composition, and execution. Existing skill-based agents mainly focus on task-time retrieval, planning, and repair, while library-time maintenance remains underexplored. We propose SkillOps, a method-agnostic plug-in framework for maintaining skill libraries. SkillOps represents each skill as a typed Skill Contract (P, O, A, V, F), organizes skills with a Hierarchical Skill Ecosystem Graph, and diagnoses library health across utility, compatibility, risk, and validation dimensions. Given a raw skill library, SkillOps produces a maintained library that can be used by existing retrieval or planning agents without changing their internal code. On ALFWorld, SkillOps achieves 79.5 percent task success as a standalone agent, outperforming the strongest baseline by 8.8 percentage points with no additional task-time large language model calls. As a plug-in layer, it improves retrieval-heavy baselines by 0.68 to 2.90 percentage points. The current rule-based maintenance implementation uses nearly zero library-time large language model calls or tokens, showing that skill-library maintenance can be added as a low-overhead architectural layer.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 18 of its 26 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

18 of 26 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026GraSP: Graph-Structured Skill Compositions for LLM Agents20 Apr
  2. 2026Graph-of-Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills7 Apr
  3. 2025Reinforcement Learning for Self-Improving Agent with Skill Library18 Dec

Other references · 15

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  3. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  4. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  5. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  6. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  7. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  8. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
  9. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 184
  10. 2025VeriGuard: Enhancing LLM Agent Safety via Verified Code Generationcited by 49
  11. 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resourcescited by 41
  12. 2025LEGOMem: Modular Procedural Memory for Multi-agent LLM Systems for Workflow Automationcited by 40
3 more
  1. 2024Test-Driven Development for Code Generationcited by 34
  2. 2019Process Mining for Python (PM4Py): Bridging the Gap Between Process- and Data Sciencecited by 33
  3. 2026CUA-Skill: Develop Skills for Computer Using Agentcited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 18.

18 papers.

Sort:

By area:

  1. 2026SKILLC: Learning Autonomous Skill Internalization in LLM Agents via Contrastive Credit Assignmentcited by 9
  2. 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remembercited by 7
  3. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
  4. 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agentscited by 5
  5. 2026Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agentscited by 4
  6. 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 4
  7. 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4
  8. 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
  9. 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintainedcited by 2
  10. 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gapscited by 1
  11. 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Librariescited by 1
  12. 2026Repo2Skill-Evo: Repository Skills Go Stale in Silencecited by 0
6 more
  1. 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Securitycited by 0
  2. 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QAcited by 0
  3. 2026EnSIMem: Entity-Structured Indexing for Long-Term Agent Memorycited by 0
  4. 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoningcited by 0
  5. 2026Skill-V: Verifiable Self-Evolving Skill Library for Interactive Agentscited by 0
  6. 2026Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rulescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
  2. 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents
  3. 2026SkillScriptBench: Benchmarking Self-Evolution of Executable Agent Skill Packages Beyond Markdown
  4. 2026SkillFusion: Towards Reliable Multi-Skill Composition for LLM Agents
  5. 2026Skilldex: A Package Manager and Registry for Agent Skill Packages with Hierarchical Scope-Based Distribution
  6. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality
  7. 2026SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
  8. 2026SkVM: Revisiting Language VM for Skills across Heterogenous LLMs and Harnesses