SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolution
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Long-horizon LLM agents generate traces that could become reusable experience, but raw trajectories are noisy, local, and hard to govern. Agent Skills offer a structured artifact for combining procedural guidance, executable resources, and applicability boundaries. Yet open skill ecosystems contain redundant, uneven, environment-sensitive artifacts, and indiscriminate updates can pollute future context. We present SkillsVote, a lifecycle-governance framework for Agent Skills across collection, recommendation, attribution, and evolution. SkillsVote profiles a million-scale open source corpus for environment requirements, quality, and verifiability, and synthesizes tasks for verifiable skills. Before execution, it performs agentic library search over structured skill folders to expose instructional context. After execution, it decomposes trajectories into skill-linked subtasks, attributes outcomes to skill-guided execution, agent exploration, environment, and result signals, and admits only successful reusable discoveries to evidence-gated updates. Experiments on Terminal-Bench 2.0 and SWE-Bench Pro show that SkillsVote improves agent performance on challenging agentic coding benchmarks. The gains arise from two complementary pathways: online evolution over task streams at test time and offline transfer via frozen libraries built from either historical trajectories or curated open source skills.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 65 of its 87 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
65 of 87 references.
Closest ancestors · 22
Same direction, newest first
- 2026SkillOS: Learning Skill Curation for Self-Evolving Agents7 May
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learning7 May
- 2026SkCC: Portable and Secure Skill Compilation for Cross-Framework LLM Agents5 May
- 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Support9 Apr
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolver9 Apr
- 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agents6 Apr
- 2026How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settings6 Apr
- 2026SkVM: Revisiting Language VM for Skills across Heterogenous LLMs and Harnesses3 Apr
- 2026SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalization2 Apr
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification2 Apr
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills26 Mar
- 2026SkillRouter: Skill Routing for LLM Agents at Scale23 Mar
10 more
- 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wild17 Mar
- 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systems3 Mar
- 2026Organizing, Orchestrating, and Benchmarking Agent Skills at Ecosystem Scale2 Mar
- 2026SkillCraft: Can LLM Agents Learn to Use Tools Skillfully?28 Feb
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agents24 Feb
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality8 Feb
- 2026Skill-Pro: Learning Reusable Skills from Experience via Non-Parametric PPO for LLM Agents2 Feb
- 2025Reinforcement Learning for Self-Improving Agent with Skill Library18 Dec
Other references · 43
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2024Agent Workflow Memorycited by 342
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
31 more
- 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 180
- 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 119
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 105
- 2025Memp: Exploring Agent Procedural Memorycited by 88
- 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 83
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
- 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 65
- 2026Memento-Skills: Let Agents Design Agentscited by 56
- 2025Training-Free Group Relative Policy Optimizationcited by 53
- 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectoriescited by 53
- 2025FLEX: Continuous Agent Evolution via Forward Learning from Experiencecited by 51
- 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 48
- 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolutioncited by 33
- 2026Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interactioncited by 33
- 2025Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystemcited by 28
- 2026AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agentscited by 28
- 2026SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agentscited by 19
- 2026From Context to Skills: Can Language Models Learn from Context Skillfully?cited by 19
- 2026Trajectory-Informed Memory Generation for Self-Improving Agent Systemscited by 16
- 2026Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agentscited by 16
- 2026SkillMOO: Multi-Objective Optimization of Agent Skills for Software Engineeringcited by 14
- 2026Position: Agentic Evolution is the Path to Evolving LLMscited by 13
- 2026Beyond Static Tools: Test-Time Tool Evolution for Scientific Reasoningcited by 12
- 2026Autogenesis: A Self-Evolving Agent Protocolcited by 12
- 2026MemGovern: Enhancing Code Agents through Learning from Governed Human Experiencescited by 10
- 2026GenericAgent: A Token-Efficient Self-Evolving LLM Agent via Contextual Information Density Maximization (V1.0)cited by 10
- 2026From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolutioncited by 9
- 2026CodeScout: An Effective Recipe for Reinforcement Learning of Code Search Agentscited by 7
- 2026From Multi-Agent to Single-Agent: When Is Skill Distillation Beneficial?cited by 6
- 2025Unifying Dynamic Tool Creation and Cross-Task Experience Sharing through Cognitive Memory Architecturecited by 4
Built on by
Citing papers per year: 2026: 18.
18 papers.
Sort:
By area:
- 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectoriescited by 10
- 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarkscited by 6
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skillscited by 6
- 2026Ratchet: How Reliable Must an LLM Judge Be to Retire a Skill?cited by 3
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Roundscited by 3
- 2026Unsupervised Skill Discovery for Agentic Data Analysiscited by 2
- 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skillscited by 2
- 2026SKILL-KD: Contrastive Skill Distillation for LLM Agentscited by 2
- 2026Behavioral Skill Reconstruction: Reconstructing Hidden Functionality from LLM Agent Skillscited by 2
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 2
- 2026Harnessing Agent Skills: Architectural Patterns and a Reference Architecture for Skill-Mediated LLM Agentscited by 1
6 more
- 2026The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agentscited by 1
- 2026ESC-Skills: Discovering and Self-Evolving Skills for Emotional Support Conversationscited by 0
- 2026You Live More Than Once: Towards Hierarchical Skill Meta-Evolvingcited by 0
- 2026Workflow-to-Skill: Skill Creation via Routing-Workflow-Semantics-Attachments Decompositioncited by 0
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesiscited by 0
- 2026SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMscited by 0
- 2026SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs29 Sep 2026
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026Behavioral Skill Reconstruction: Reconstructing Hidden Functionality from LLM Agent Skills4 Aug 2026
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds31 Jul 2026
- 2026SKILL-KD: Contrastive Skill Distillation for LLM Agents30 Jul 2026
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesis27 Jul 2026
- 2026Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills24 Jul 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agents8 Jul 2026
- 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skills15 Jun 2026
- 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks9 Jun 2026
- 2026Workflow-to-Skill: Skill Creation via Routing-Workflow-Semantics-Attachments Decomposition5 Jun 2026
6 more
- 2026Unsupervised Skill Discovery for Agentic Data Analysis4 Jun 2026
- 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories31 May 2026
- 2026Harnessing Agent Skills: Architectural Patterns and a Reference Architecture for Skill-Mediated LLM Agents29 May 2026
- 2026You Live More Than Once: Towards Hierarchical Skill Meta-Evolving27 May 2026
- 2026ESC-Skills: Discovering and Self-Evolving Skills for Emotional Support Conversations27 May 2026
- 2026Ratchet: How Reliable Must an LLM Judge Be to Retire a Skill?21 May 2026
- 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectoriescited by 10
- 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarkscited by 6
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Roundscited by 3
- 2026Unsupervised Skill Discovery for Agentic Data Analysiscited by 2
- 2026SKILL-KD: Contrastive Skill Distillation for LLM Agentscited by 2
- 2026Behavioral Skill Reconstruction: Reconstructing Hidden Functionality from LLM Agent Skillscited by 2
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 2
- 2026Harnessing Agent Skills: Architectural Patterns and a Reference Architecture for Skill-Mediated LLM Agentscited by 1
- 2026The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agentscited by 1
- 2026You Live More Than Once: Towards Hierarchical Skill Meta-Evolvingcited by 0
- 2026Workflow-to-Skill: Skill Creation via Routing-Workflow-Semantics-Attachments Decompositioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs29 Sep 2026
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026Behavioral Skill Reconstruction: Reconstructing Hidden Functionality from LLM Agent Skills4 Aug 2026
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds31 Jul 2026
- 2026SKILL-KD: Contrastive Skill Distillation for LLM Agents30 Jul 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agents8 Jul 2026
- 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks9 Jun 2026
- 2026Workflow-to-Skill: Skill Creation via Routing-Workflow-Semantics-Attachments Decomposition5 Jun 2026
- 2026Unsupervised Skill Discovery for Agentic Data Analysis4 Jun 2026
- 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories31 May 2026
- 2026Harnessing Agent Skills: Architectural Patterns and a Reference Architecture for Skill-Mediated LLM Agents29 May 2026
12 newest of 13 All 13 (JSON)
- 2026Ratchet: How Reliable Must an LLM Judge Be to Retire a Skill?cited by 3
- 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skillscited by 2
- 2026ESC-Skills: Discovering and Self-Evolving Skills for Emotional Support Conversationscited by 0
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesiscited by 0
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesis27 Jul 2026
- 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skills15 Jun 2026
- 2026ESC-Skills: Discovering and Self-Evolving Skills for Emotional Support Conversations27 May 2026
- 2026Ratchet: How Reliable Must an LLM Judge Be to Retire a Skill?21 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
- 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resources
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents
- 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale
- 2026SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion
- 2026SkillHone: A Harness for Continual Agent Skill Evolution Through Persistent Decision History
- 2026A Framework for Evaluating Agentic Skills at Scale
- 2026SkillFocus: Evolving Agent Skills via Capability Decomposition