WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
Not on the map. Why?
Abstract (arXiv)
Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations. We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki). At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on. Across diverse benchmarks and models, WikiSkill consistently outperforms state-of-the-art skill-evolution methods and improves over no-skill baselines in most model-benchmark settings. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
36 of 46 references.
References · 36
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 315
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2026Gemma 4 Technical Reportcited by 259
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 187
- 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
24 more
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 130
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 128
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 113
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111
- 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 107
- 2026Self-Harness: Harnesses That Improve Themselvescited by 107
- 2026SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalizationcited by 94
- 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 76
- 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 75
- 2026How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settingscited by 65
- 2026Memento-Skills: Let Agents Design Agentscited by 62
- 2026SkillRouter: Skill Routing for LLM Agents at Scalecited by 61
- 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 53
- 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
- 2026SkillOS: Learning Skill Curation for Self-Evolving Agentscited by 49
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 47
- 2026Skill Retrieval Augmentation for Agentic AIcited by 44
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agentscited by 39
- 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 37
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learningcited by 35
- 2026SkillCraft: Can LLM Agents Learn to Use Tools Skillfully?cited by 30
- 2026SkillGrad: Optimizing Agent Skills Like Gradient Descentcited by 26
- 2025AA-Omniscience: Evaluating Cross-Domain Knowledge Reliability in Large Language Modelscited by 13
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026RLTL;DR: Self-improvement by Internalizing Self-generated Feedbackcited by 1
- 2026Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoringcited by 0
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolutioncited by 0
- 2026Retrieval-Augmented Skill Optimization via Cross-Harness Adaptationcited by 0
- 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agentscited by 0
- 2026Decoupling Memory from Context: Structured Memory for Token-Efficient Test-Time Continual Learningcited by 0
- 2026Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: Lessons for Continual Learningcited by 0
- 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolutioncited by 0
- 2026Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rulescited by 0
- 2026From Existing Methods to New Research Ideas: Two Perspectives on Recursive Self-Improvementcited by 0
- 2026VIEWCRAFT: Evolving What Multimodal Agents See and How They Read Itcited by 0
- 2026Learning What to Keep: Transfer-Aware Personal Skill Learning from User Feedbackcited by 0
- 2026Learning What to Keep: Transfer-Aware Personal Skill Learning from User Feedback14 Oct 2026
- 2026VIEWCRAFT: Evolving What Multimodal Agents See and How They Read It11 Oct 2026
- 2026From Existing Methods to New Research Ideas: Two Perspectives on Recursive Self-Improvement10 Oct 2026
- 2026Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rules9 Oct 2026
- 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution8 Oct 2026
- 2026Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: Lessons for Continual Learning8 Oct 2026
- 2026Decoupling Memory from Context: Structured Memory for Token-Efficient Test-Time Continual Learning2 Oct 2026
- 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents30 Sep 2026
- 2026Retrieval-Augmented Skill Optimization via Cross-Harness Adaptation29 Sep 2026
- 2026RLTL;DR: Self-improvement by Internalizing Self-generated Feedback29 Sep 2026
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution27 Sep 2026
- 2026Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoring27 Sep 2026