mlsanityData to 14 Oct 2026

MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution

arXiv 2607.05297 ↗First posted 6 Jul 2026cs.AIcited by 22

On the map: LLM agents and tool use → Agent skill learning and evolution

also in 1 more
Abstract (arXiv)

Recent LLM agents tackle increasingly long-horizon, open-ended tasks, and external skills, reusable procedural knowledge supplied to the agent, further extend this capability. However, a fixed, hand-authored skill is rarely optimal, and cannot adapt to the diversity of tasks an agent encounters. Self-improving agents address this by rewriting their own skill files from execution traces, yielding meaningful gains on challenging benchmarks. Yet such self-evolution remains non-recursive: it improves only the task skill (what the agent does) while the improvement procedure (how it improves) is authored once and held fixed. We introduce MetaSkill-Evolve, a two-timescale framework that makes agentic skill improvement recursive: every branch carries both a task skill s and a branch-local meta-skill m=(psi,σ,α,π,varepsilon) whose five components parameterise the Analyzer, Retriever, Allocator, Proposer, and Evolver agents of the improvement pipeline. Task skills evolve on a fast loop while the meta-skill evolves on a slower one under the same pipeline applied to itself, with no additional model or objective. With all five pipeline agents sharing a single frozen backbone, MetaSkill-Evolve outperforms no-skill, static-skill, and single-level evolution baselines on three agentic benchmarks (OfficeQA, SealQA, ALFWorld), improving held-out test accuracy over the raw backbone by +23.54, +16.09, and +1.92 points respectively.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 34 of its 52 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

34 of 52 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Support9 Apr
  2. 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolver9 Apr
  3. 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agents6 Apr
  4. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification2 Apr
  5. 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agents24 Feb
  6. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
  7. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb

Other references · 27

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  3. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  4. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  5. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
  6. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  7. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  8. 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 193
  9. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
  10. 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 174
  11. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
  12. 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 142
15 more
  1. 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 115
  2. 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 75
  3. 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agentscited by 69
  4. 2025PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selectioncited by 61
  5. 2024LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steeringcited by 51
  6. 2025CoT-Kinetics: A Theoretical Modeling Assessing LRM Reasoning Processcited by 51
  7. 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
  8. 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparisoncited by 44
  9. 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resourcescited by 41
  10. 2026OfficeQA Pro: An Enterprise Benchmark for End-to-End Grounded Reasoningcited by 39
  11. 2025EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systemscited by 37
  12. 2025Self-Evolving Multi-Agent Systems via Textual Backpropagationcited by 23
  13. 2026From Context to Skills: Can Language Models Learn from Context Skillfully?cited by 19
  14. 2025Loong: Synthesize Long Chain-of-Thoughts at Scale through Verifierscited by 14
  15. 2025Beyond Magic Words: Sharpness-Aware Prompt Evolving for Robust Large Language Models with TAREcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 22.

22 papers.

Sort:

By area:

  1. 2026Dream-RSI: Recursive Self-Improvement through Evolving Worldscited by 18
  2. 2026Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnessescited by 9
  3. 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environmentscited by 8
  4. 2026S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?cited by 5
  5. 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 4
  6. 2026A Survey on Self-Improving Test-Time Intelligence: Feedback-Driven Adapting, Learning, and Scaling at Inferencecited by 3
  7. 2026MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselvescited by 2
  8. 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnessescited by 1
  9. 2026SkillPoison: Progressive Skill Poisoning via Successful Experiencescited by 1
  10. 2026Self-Aware Recursively Self-Improving Agents for Personal Singularity: A Goal-, Scope-, Tool-, and Benchmark-Driven Multi-Agent Architecturecited by 0
  11. 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experiencecited by 0
  12. 2026CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolutioncited by 0
10 more
  1. 2026Scope Before You Persist: Preventing Cross-Family Interference in Agent Memorycited by 0
  2. 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Modelcited by 0
  3. 2026Learning Meta-Skills for Agent Harness Design in Test-Time AI4AIcited by 0
  4. 2026Causal Improvement Graph for Agentic Harness Optimizationcited by 0
  5. 2026Learning from Revision Consequences: Hindsight Meta-Experience Distillation for Self-Improving Agentscited by 0
  6. 2026Agent Plasticity: Measuring Self-Improvement Through Experiencecited by 0
  7. 2026Harness^2: Recursive Agent Harnessing for an Open Worldcited by 0
  8. 2026HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systemscited by 0
  9. 2026ECG-RSI: Recursive Self-Improvement through Targeted Electrocardiogram Waveform Evolutioncited by 0
  10. 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligencecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents
  2. 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?
  3. 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution
  4. 2026SkillFocus: Evolving Agent Skills via Capability Decomposition
  5. 2026A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents
  6. 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
  7. 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
  8. 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds