MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
On the map: LLM agents and tool use → Agent skill learning and evolution
also in 1 more
Abstract (arXiv)
Large language model (LLM) agents rely on reusable skills to solve complex tasks, but existing skill creation approaches often treat skills as isolated, static artifacts, limiting reusability, reliability, and long-term improvement. We propose MUSE-Autoskill Agent (Memory-Utilizing Skill Evolution), a skill-centric agent framework that creates, reuses, and refines skills under a unified lifecycle: creation, memory, management, evaluation, and refinement. MUSE creates skills on demand, stores them across tasks, retrieves them through a skill catalog, and accumulates per-skill experience for later reuse and adaptation. Across the main reported settings on SkillsBench and SkillLearnBench, MUSE-Autoskill outperforms Hermes, Codex, and Claude Code. On SkillsBench, its self-created skills surpass human-authored skills on the successfully covered subset (85.24% vs. 81.17%), showing that lifecycle-managed skills can distill agent experience into highly effective reusable assets; MUSE-created skills also transfer to Hermes more effectively than Codex- or Claude-created skills, reaching 51.90% accuracy under transfer. These results highlight the importance of treating skills as long-lived, experience-aware, and testable assets.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 38 of its 42 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
38 of 42 references.
Closest ancestors · 9
Same direction, newest first
- 2026SkillGen: Verified Inference-Time Agent Skill Synthesis9 May
- 2026SkillMaster: Toward Autonomous Skill Mastery in LLM Agents9 May
- 2026SkillOS: Learning Skill Curation for Self-Evolving Agents7 May
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learning7 May
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents7 May
- 2026SkillLearnBench: Benchmarking Continual Learning Methods for Agent Skill Generation on Real-World Tasks22 Apr
- 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systems3 Mar
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward12 Feb
Other references · 29
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
17 more
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 443
- 2024Understanding the planning of LLM agents: A surveycited by 414
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 278
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 105
- 2025LifelongAgentBench: Evaluating LLM Agents as Lifelong Learnerscited by 65
- 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
- 2025FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Datacited by 13
- 2025Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anythingcited by 9
- 2025Youtu-Agent: Scaling Agent Productivity with Automated Generation and Hybrid Policy Optimizationcited by 4
Built on by
Citing papers per year: 2026: 23.
23 papers.
Sort:
By area:
- 2026SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Usecited by 7
- 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remembercited by 7
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026PAST-Bench: Benchmarking the Foundations of Recursive Self-Improvement in Personal Agentscited by 5
- 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skillscited by 2
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 2
- 2026Rethinking Self-Evolution: A Constrained Exploration-Exploitation Process for Mitigating Skill Overfittingcited by 1
- 2026When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systemscited by 1
- 2026SkillAligner: Treating Retrieved Skills as Adaptable Drafts at Execution Timecited by 1
- 2026SkillGLoW: Procedural-Family Skill Consolidation for Self-Improving Agents on Long-Horizon Task Streamscited by 1
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agentscited by 1
- 2026MUSE: A Unified Agentic Harness for MLLMscited by 0
11 more
- 2026An Empirical Study of Downstream Adaptation for Agent Skillscited by 0
- 2026SkillAlchemy: Open-World Agent Skill Creationcited by 0
- 2026Who Maintains Agent Skills? A Longitudinal Study of Human-Governed, AI-Assisted Skill Maintenancecited by 0
- 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agentscited by 0
- 2026Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skillscited by 0
- 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QAcited by 0
- 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoningcited by 0
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolutioncited by 0
- 2026Learn Now, Use Next, Trust Later: Prequential Test-Time Learning for LLM Agentscited by 0
- 2026SkillCome: Group Contrast Skill Optimization with Dual Memorycited by 0
- 2026ViSkill: Reinforcing VLM Agents with Evolving Visual-Native Skillscited by 0
- 2026ViSkill: Reinforcing VLM Agents with Evolving Visual-Native Skills8 Oct 2026
- 2026SkillCome: Group Contrast Skill Optimization with Dual Memory29 Sep 2026
- 2026Learn Now, Use Next, Trust Later: Prequential Test-Time Learning for LLM Agents28 Sep 2026
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution27 Sep 2026
- 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoning26 Sep 2026
- 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QA17 Sep 2026
- 2026Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skills10 Sep 2026
- 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents8 Sep 2026
- 2026Who Maintains Agent Skills? A Longitudinal Study of Human-Governed, AI-Assisted Skill Maintenance4 Sep 2026
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents4 Sep 2026
- 2026SkillGLoW: Procedural-Family Skill Consolidation for Self-Improving Agents on Long-Horizon Task Streams2 Sep 2026
- 2026SkillAlchemy: Open-World Agent Skill Creation24 Aug 2026
11 more
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026SkillAligner: Treating Retrieved Skills as Adaptable Drafts at Execution Time7 Aug 2026
- 2026When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systems6 Aug 2026
- 2026PAST-Bench: Benchmarking the Foundations of Recursive Self-Improvement in Personal Agents4 Aug 2026
- 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember31 Jul 2026
- 2026Rethinking Self-Evolution: A Constrained Exploration-Exploitation Process for Mitigating Skill Overfitting29 Jul 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026An Empirical Study of Downstream Adaptation for Agent Skills3 Jul 2026
- 2026SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Use2 Jul 2026
- 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skills15 Jun 2026
- 2026MUSE: A Unified Agentic Harness for MLLMs2 Jun 2026
- 2026SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Usecited by 7
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 2
- 2026When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systemscited by 1
- 2026SkillGLoW: Procedural-Family Skill Consolidation for Self-Improving Agents on Long-Horizon Task Streamscited by 1
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agentscited by 1
- 2026An Empirical Study of Downstream Adaptation for Agent Skillscited by 0
- 2026Who Maintains Agent Skills? A Longitudinal Study of Human-Governed, AI-Assisted Skill Maintenancecited by 0
- 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agentscited by 0
- 2026Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skillscited by 0
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolutioncited by 0
- 2026Learn Now, Use Next, Trust Later: Prequential Test-Time Learning for LLM Agentscited by 0
- 2026Learn Now, Use Next, Trust Later: Prequential Test-Time Learning for LLM Agents28 Sep 2026
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution27 Sep 2026
- 2026Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skills10 Sep 2026
- 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents8 Sep 2026
- 2026Who Maintains Agent Skills? A Longitudinal Study of Human-Governed, AI-Assisted Skill Maintenance4 Sep 2026
- 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents4 Sep 2026
- 2026SkillGLoW: Procedural-Family Skill Consolidation for Self-Improving Agents on Long-Horizon Task Streams2 Sep 2026
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systems6 Aug 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026An Empirical Study of Downstream Adaptation for Agent Skills3 Jul 2026
- 2026SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Use2 Jul 2026
- 2026MUSE: A Unified Agentic Harness for MLLMscited by 0
- 2026MUSE: A Unified Agentic Harness for MLLMs2 Jun 2026
- 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remembercited by 7
- 2026PAST-Bench: Benchmarking the Foundations of Recursive Self-Improvement in Personal Agentscited by 5
- 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skillscited by 2
- 2026SkillAligner: Treating Retrieved Skills as Adaptable Drafts at Execution Timecited by 1
- 2026SkillAlchemy: Open-World Agent Skill Creationcited by 0
- 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QAcited by 0
- 2026SkillCome: Group Contrast Skill Optimization with Dual Memorycited by 0
- 2026ViSkill: Reinforcing VLM Agents with Evolving Visual-Native Skillscited by 0
- 2026ViSkill: Reinforcing VLM Agents with Evolving Visual-Native Skills8 Oct 2026
- 2026SkillCome: Group Contrast Skill Optimization with Dual Memory29 Sep 2026
- 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QA17 Sep 2026
- 2026SkillAlchemy: Open-World Agent Skill Creation24 Aug 2026
- 2026SkillAligner: Treating Retrieved Skills as Adaptable Drafts at Execution Time7 Aug 2026
- 2026PAST-Bench: Benchmarking the Foundations of Recursive Self-Improvement in Personal Agents4 Aug 2026
- 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember31 Jul 2026
- 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skills15 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?
- 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
- 2026Skills-Coach: A Self-Evolving Skill Optimizer via Training-Free GRPO
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolver
- 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents
- 2026SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion
- 2026SkillCraft: Can LLM Agents Learn to Use Tools Skillfully?
- 2026SkillFocus: Evolving Agent Skills via Capability Decomposition