MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
On the map: LLM agents and tool use → Agent skill learning and evolution
also in 1 more
Abstract (arXiv)
Recent LLM agents tackle increasingly long-horizon, open-ended tasks, and external skills, reusable procedural knowledge supplied to the agent, further extend this capability. However, a fixed, hand-authored skill is rarely optimal, and cannot adapt to the diversity of tasks an agent encounters. Self-improving agents address this by rewriting their own skill files from execution traces, yielding meaningful gains on challenging benchmarks. Yet such self-evolution remains non-recursive: it improves only the task skill (what the agent does) while the improvement procedure (how it improves) is authored once and held fixed. We introduce MetaSkill-Evolve, a two-timescale framework that makes agentic skill improvement recursive: every branch carries both a task skill s and a branch-local meta-skill m=(psi,σ,α,π,varepsilon) whose five components parameterise the Analyzer, Retriever, Allocator, Proposer, and Evolver agents of the improvement pipeline. Task skills evolve on a fast loop while the meta-skill evolves on a slower one under the same pipeline applied to itself, with no additional model or objective. With all five pipeline agents sharing a single frozen backbone, MetaSkill-Evolve outperforms no-skill, static-skill, and single-level evolution baselines on three agentic benchmarks (OfficeQA, SealQA, ALFWorld), improving held-out test accuracy over the raw backbone by +23.54, +16.09, and +1.92 points respectively.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 34 of its 52 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
34 of 52 references.
Closest ancestors · 7
Same direction, newest first
- 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Support9 Apr
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolver9 Apr
- 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agents6 Apr
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification2 Apr
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agents24 Feb
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb
Other references · 27
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 193
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 174
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 142
15 more
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 115
- 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 75
- 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agentscited by 69
- 2025PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selectioncited by 61
- 2024LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steeringcited by 51
- 2025CoT-Kinetics: A Theoretical Modeling Assessing LRM Reasoning Processcited by 51
- 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
- 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparisoncited by 44
- 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resourcescited by 41
- 2026OfficeQA Pro: An Enterprise Benchmark for End-to-End Grounded Reasoningcited by 39
- 2025EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systemscited by 37
- 2025Self-Evolving Multi-Agent Systems via Textual Backpropagationcited by 23
- 2026From Context to Skills: Can Language Models Learn from Context Skillfully?cited by 19
- 2025Loong: Synthesize Long Chain-of-Thoughts at Scale through Verifierscited by 14
- 2025Beyond Magic Words: Sharpness-Aware Prompt Evolving for Robust Large Language Models with TAREcited by 9
Built on by
Citing papers per year: 2026: 22.
22 papers.
Sort:
By area:
- 2026Dream-RSI: Recursive Self-Improvement through Evolving Worldscited by 18
- 2026Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnessescited by 9
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environmentscited by 8
- 2026S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?cited by 5
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 4
- 2026A Survey on Self-Improving Test-Time Intelligence: Feedback-Driven Adapting, Learning, and Scaling at Inferencecited by 3
- 2026MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselvescited by 2
- 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnessescited by 1
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiencescited by 1
- 2026Self-Aware Recursively Self-Improving Agents for Personal Singularity: A Goal-, Scope-, Tool-, and Benchmark-Driven Multi-Agent Architecturecited by 0
- 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experiencecited by 0
- 2026CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolutioncited by 0
10 more
- 2026Scope Before You Persist: Preventing Cross-Family Interference in Agent Memorycited by 0
- 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Modelcited by 0
- 2026Learning Meta-Skills for Agent Harness Design in Test-Time AI4AIcited by 0
- 2026Causal Improvement Graph for Agentic Harness Optimizationcited by 0
- 2026Learning from Revision Consequences: Hindsight Meta-Experience Distillation for Self-Improving Agentscited by 0
- 2026Agent Plasticity: Measuring Self-Improvement Through Experiencecited by 0
- 2026Harness^2: Recursive Agent Harnessing for an Open Worldcited by 0
- 2026HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systemscited by 0
- 2026ECG-RSI: Recursive Self-Improvement through Targeted Electrocardiogram Waveform Evolutioncited by 0
- 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligencecited by 0
- 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligence14 Oct 2026
- 2026ECG-RSI: Recursive Self-Improvement through Targeted Electrocardiogram Waveform Evolution13 Oct 2026
- 2026HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systems10 Oct 2026
- 2026Harness^2: Recursive Agent Harnessing for an Open World9 Oct 2026
- 2026Agent Plasticity: Measuring Self-Improvement Through Experience6 Oct 2026
- 2026Learning from Revision Consequences: Hindsight Meta-Experience Distillation for Self-Improving Agents6 Oct 2026
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiences6 Oct 2026
- 2026Causal Improvement Graph for Agentic Harness Optimization4 Oct 2026
- 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnesses2 Oct 2026
- 2026Learning Meta-Skills for Agent Harness Design in Test-Time AI4AI29 Sep 2026
- 2026Scope Before You Persist: Preventing Cross-Family Interference in Agent Memory24 Sep 2026
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments14 Sep 2026
10 more
- 2026Dream-RSI: Recursive Self-Improvement through Evolving Worlds14 Sep 2026
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness8 Sep 2026
- 2026MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselves6 Sep 2026
- 2026CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolution4 Sep 2026
- 2026A Survey on Self-Improving Test-Time Intelligence: Feedback-Driven Adapting, Learning, and Scaling at Inference1 Sep 2026
- 2026S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?31 Aug 2026
- 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Model28 Aug 2026
- 2026Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnesses25 Aug 2026
- 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experience17 Aug 2026
- 2026Self-Aware Recursively Self-Improving Agents for Personal Singularity: A Goal-, Scope-, Tool-, and Benchmark-Driven Multi-Agent Architecture14 Jul 2026
- 2026Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnessescited by 9
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 4
- 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnessescited by 1
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiencescited by 1
- 2026Self-Aware Recursively Self-Improving Agents for Personal Singularity: A Goal-, Scope-, Tool-, and Benchmark-Driven Multi-Agent Architecturecited by 0
- 2026Scope Before You Persist: Preventing Cross-Family Interference in Agent Memorycited by 0
- 2026Causal Improvement Graph for Agentic Harness Optimizationcited by 0
- 2026Harness^2: Recursive Agent Harnessing for an Open Worldcited by 0
- 2026HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systemscited by 0
- 2026HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systems10 Oct 2026
- 2026Harness^2: Recursive Agent Harnessing for an Open World9 Oct 2026
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiences6 Oct 2026
- 2026Causal Improvement Graph for Agentic Harness Optimization4 Oct 2026
- 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnesses2 Oct 2026
- 2026Scope Before You Persist: Preventing Cross-Family Interference in Agent Memory24 Sep 2026
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness8 Sep 2026
- 2026Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnesses25 Aug 2026
- 2026Self-Aware Recursively Self-Improving Agents for Personal Singularity: A Goal-, Scope-, Tool-, and Benchmark-Driven Multi-Agent Architecture14 Jul 2026
- 2026CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolutioncited by 0
- 2026Learning Meta-Skills for Agent Harness Design in Test-Time AI4AIcited by 0
- 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligencecited by 0
- 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligence14 Oct 2026
- 2026Learning Meta-Skills for Agent Harness Design in Test-Time AI4AI29 Sep 2026
- 2026CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolution4 Sep 2026
- 2026Learning from Revision Consequences: Hindsight Meta-Experience Distillation for Self-Improving Agents6 Oct 2026
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments14 Sep 2026
- 2026S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?31 Aug 2026
- 2026Dream-RSI: Recursive Self-Improvement through Evolving Worldscited by 18
- 2026A Survey on Self-Improving Test-Time Intelligence: Feedback-Driven Adapting, Learning, and Scaling at Inferencecited by 3
- 2026MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselvescited by 2
- 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experiencecited by 0
- 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Modelcited by 0
- 2026Agent Plasticity: Measuring Self-Improvement Through Experiencecited by 0
- 2026ECG-RSI: Recursive Self-Improvement through Targeted Electrocardiogram Waveform Evolutioncited by 0
- 2026ECG-RSI: Recursive Self-Improvement through Targeted Electrocardiogram Waveform Evolution13 Oct 2026
- 2026Agent Plasticity: Measuring Self-Improvement Through Experience6 Oct 2026
- 2026Dream-RSI: Recursive Self-Improvement through Evolving Worlds14 Sep 2026
- 2026MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselves6 Sep 2026
- 2026A Survey on Self-Improving Test-Time Intelligence: Feedback-Driven Adapting, Learning, and Scaling at Inference1 Sep 2026
- 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Model28 Aug 2026
- 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experience17 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents
- 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution
- 2026SkillFocus: Evolving Agent Skills via Capability Decomposition
- 2026A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents
- 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
- 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds