mlsanityData to 14 Oct 2026

SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems

arXiv 2606.01314 ↗First posted 31 May 2026cs.AIcited by 6

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

LLM agents increasingly store capabilities in external skill and tool libraries. Libraries can grow, but execution must fit a finite context window and improvement consumes a finite iteration budget. We formulate external-policy evolution under these two budgets and introduce SkillSmith. A skill ecosystem allocates context through replicator dynamics, using randomized masking and Bayesian estimation to learn skill effects and interactions. Four typed operations repair tools and move reusable logic across the skill-tool boundary, freeing context for the ecosystem. Conflict-driven learning distills failed proposals into version-scoped nogoods that guide repairs and veto repeated failing proposals. We prove utility ascent for fixed-model continuous dynamics, conditions under which lower context costs expand attainable utility, and the need for synchronized interface migration under persistent exact-match dependencies. Across five Qwen3.5 scales, SkillSmith improves over EvoSkill by up to 10.2 and 9.8 percentage points on OfficeQA and SealQA, respectively, and sustains improvement beyond SkillClaw on WildClawBench. Skills compete for context; tools are how the system makes room.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 25 of its 36 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

25 of 36 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Support9 Apr
  2. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification2 Apr

Other references · 23

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  7. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  8. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  9. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  10. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  11. 2023Large Language Models as Optimizerscited by 864
  12. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
11 more
  1. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
  2. 2024Understanding the planning of LLM agents: A surveycited by 421
  3. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
  4. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 187
  5. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
  6. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 107
  7. 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 81
  8. 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agentscited by 76
  9. 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 75
  10. 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 75
  11. 2026Dynamic Dual-Granularity Skill Bank for Agentic RLcited by 34

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks
  2. 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds
  3. 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
  4. 2026A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents
  5. 2026SkillVine: Agent Skill Evolution via Branching Exploration
  6. 2026SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents
  7. 2026Coalition-Aware Skill Reliability for Self-Evolving Agents
  8. 2026SkillFocus: Evolving Agent Skills via Capability Decomposition