SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems
On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents
Abstract (arXiv)
LLM agents increasingly store capabilities in external skill and tool libraries. Libraries can grow, but execution must fit a finite context window and improvement consumes a finite iteration budget. We formulate external-policy evolution under these two budgets and introduce SkillSmith. A skill ecosystem allocates context through replicator dynamics, using randomized masking and Bayesian estimation to learn skill effects and interactions. Four typed operations repair tools and move reusable logic across the skill-tool boundary, freeing context for the ecosystem. Conflict-driven learning distills failed proposals into version-scoped nogoods that guide repairs and veto repeated failing proposals. We prove utility ascent for fixed-model continuous dynamics, conditions under which lower context costs expand attainable utility, and the need for synchronized interface migration under persistent exact-match dependencies. Across five Qwen3.5 scales, SkillSmith improves over EvoSkill by up to 10.2 and 9.8 percentage points on OfficeQA and SealQA, respectively, and sustains improvement beyond SkillClaw on WildClawBench. Skills compete for context; tools are how the system makes room.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 25 of its 36 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
25 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Support9 Apr
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification2 Apr
Other references · 23
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2023Large Language Models as Optimizerscited by 864
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
11 more
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 187
- 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
- 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 107
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 81
- 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agentscited by 76
- 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 75
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 75
- 2026Dynamic Dual-Granularity Skill Bank for Agentic RLcited by 34
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
- 2026Competence, Not Accuracy: A Diagnostic for Reference-Free Judge Gates in Skill Optimizationcited by 0
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolutioncited by 0
- 2026CoEvoWhen: Policy-Tool Coevolution for Ultra-Long Video Temporal Groundingcited by 0
- 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolutioncited by 0
- 2026From Existing Methods to New Research Ideas: Two Perspectives on Recursive Self-Improvementcited by 0
- 2026From Existing Methods to New Research Ideas: Two Perspectives on Recursive Self-Improvement10 Oct 2026
- 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution8 Oct 2026
- 2026CoEvoWhen: Policy-Tool Coevolution for Ultra-Long Video Temporal Grounding30 Sep 2026
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution28 Sep 2026
- 2026Competence, Not Accuracy: A Diagnostic for Reference-Free Judge Gates in Skill Optimization19 Aug 2026
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops8 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds
- 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
- 2026A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents
- 2026SkillVine: Agent Skill Evolution via Branching Exploration
- 2026SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents
- 2026Coalition-Aware Skill Reliability for Self-Evolving Agents
- 2026SkillFocus: Evolving Agent Skills via Capability Decomposition