SkillEvolver: Skill Learning as a Meta-Skill
Not on the map. Why?
Abstract (arXiv)
Agent skills today are static artifact: authored once -- by human curation or one-shot generation from parametric knowledge -- and then consumed unchanged, with no mechanism to improve from real use. We propose SkillEvolver, a lightweight, plug-and-play solution for online skill learning, in which a single meta-skill iteratively authors, deploys, and refines domain-specific skills. The learning target of SkillEvolver is the skill's prose and code, not model weights, so that the resulting artifact drops into any agent without retraining; and the meta-skill itself is just another skill, loaded through the same interface by any protocol-compliant CLI-agent. Unlike trace-distillation, the meta-skill refines only after deploying the learnt skill, such that the learning signal comes from failures another agent encounters while using it -- not from exploratory traces alone. Refinement iterations are governed by a fresh-agent overfit audit that catches possible leakage as well as deployed-skill-specific failures, including the silent-bypass mode in which a skill appears valid in content but is never invoked at runtime. On 83 SkillsBench tasks spanning 15+ domains, SkillEvolver reaches 56.8% accuracy versus 43.6% for curated human skills and 29.9% for the no-skill baseline; on three GPU kernel optimization tasks from KernelBench, it also raises mean speedup from 1.16 to 1.51 on average.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
26 of 35 references.
References · 26
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
14 more
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2024Automated Design of Agentic Systemscited by 360
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 306
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 252
- 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 194
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
- 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 146
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 105
- 2026Organizing, Orchestrating, and Benchmarking Agent Skills at Ecosystem Scalecited by 65
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026SkillAudit: Ground-Truth-Free Skill Evolution via Paired Trajectory Auditingcited by 11
- 2026FederatedSkill: Federated Learning for Agentic Skill Evolutioncited by 6
- 2026Hypothesis-Driven Skill Optimization for LLM Agentscited by 6
- 2026Skill0.5: Joint Skill Internalization and Utilization for Out-of-Distribution Generalization in Agentic Reinforcement Learningcited by 5
- 2026Agent Skills Matter: Inferring Proprietary Skills from Execution Trajectoriescited by 4
- 2026Bidirectional Context Self-Distillation for Reinforcement Learning of Skill-Based LLM Agentscited by 1
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesiscited by 0
- 2026Don't Regenerate, Debug: A Domain-Specific Agent for Repairing Near-Miss Hardware Operatorscited by 0
- 2026SkillHEX: Improving Agent Skills via Hypothesis-Driven Autonomous Exploration and Exploitationcited by 0
- 2026SkillAlchemy: Open-World Agent Skill Creationcited by 0
- 2026CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolutioncited by 0
- 2026Trajectory-Guided Fault Localization for Agent Skill Evolutioncited by 0
- 2026Trajectory-Guided Fault Localization for Agent Skill Evolution8 Oct 2026
- 2026CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolution4 Sep 2026
- 2026SkillAlchemy: Open-World Agent Skill Creation24 Aug 2026
- 2026Bidirectional Context Self-Distillation for Reinforcement Learning of Skill-Based LLM Agents10 Aug 2026
- 2026SkillHEX: Improving Agent Skills via Hypothesis-Driven Autonomous Exploration and Exploitation6 Aug 2026
- 2026Don't Regenerate, Debug: A Domain-Specific Agent for Repairing Near-Miss Hardware Operators3 Aug 2026
- 2026Agent Skills Matter: Inferring Proprietary Skills from Execution Trajectories28 Jul 2026
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesis27 Jul 2026
- 2026Hypothesis-Driven Skill Optimization for LLM Agents21 Jun 2026
- 2026SkillAudit: Ground-Truth-Free Skill Evolution via Paired Trajectory Auditing12 Jun 2026
- 2026FederatedSkill: Federated Learning for Agentic Skill Evolution2 Jun 2026
- 2026Skill0.5: Joint Skill Internalization and Utilization for Out-of-Distribution Generalization in Agentic Reinforcement Learning27 May 2026