mlsanityData to 7 Oct 2026

MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation

arXiv 2605.27366 ↗First posted 26 May 2026cs.AI cs.CL cs.LGcited by 23

On the map: LLM agents and tool use → Agent skill learning and evolution

also in 1 more
Abstract (arXiv)

Large language model (LLM) agents rely on reusable skills to solve complex tasks, but existing skill creation approaches often treat skills as isolated, static artifacts, limiting reusability, reliability, and long-term improvement. We propose MUSE-Autoskill Agent (Memory-Utilizing Skill Evolution), a skill-centric agent framework that creates, reuses, and refines skills under a unified lifecycle: creation, memory, management, evaluation, and refinement. MUSE creates skills on demand, stores them across tasks, retrieves them through a skill catalog, and accumulates per-skill experience for later reuse and adaptation. Across the main reported settings on SkillsBench and SkillLearnBench, MUSE-Autoskill outperforms Hermes, Codex, and Claude Code. On SkillsBench, its self-created skills surpass human-authored skills on the successfully covered subset (85.24% vs. 81.17%), showing that lifecycle-managed skills can distill agent experience into highly effective reusable assets; MUSE-created skills also transfer to Hermes more effectively than Codex- or Claude-created skills, reaching 51.90% accuracy under transfer. These results highlight the importance of treating skills as long-lived, experience-aware, and testable assets.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 38 of its 42 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

38 of 42 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026SkillGen: Verified Inference-Time Agent Skill Synthesis9 May
  2. 2026SkillMaster: Toward Autonomous Skill Mastery in LLM Agents9 May
  3. 2026SkillOS: Learning Skill Curation for Self-Evolving Agents7 May
  4. 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learning7 May
  5. 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents7 May
  6. 2026SkillLearnBench: Benchmarking Continual Learning Methods for Agent Skill Generation on Real-World Tasks22 Apr
  7. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systems3 Mar
  8. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
  9. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward12 Feb

Other references · 29

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  7. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  8. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  9. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  10. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  11. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  12. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
17 more
  1. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  2. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  3. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  4. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  5. 2023Teaching Large Language Models to Self-Debugcited by 963
  6. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  7. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  8. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 443
  9. 2024Understanding the planning of LLM agents: A surveycited by 414
  10. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  11. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 278
  12. 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 105
  13. 2025LifelongAgentBench: Evaluating LLM Agents as Lifelong Learnerscited by 65
  14. 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
  15. 2025FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Datacited by 13
  16. 2025Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anythingcited by 9
  17. 2025Youtu-Agent: Scaling Agent Productivity with Automated Generation and Hybrid Policy Optimizationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 23.

23 papers.

Sort:

By area:

  1. 2026SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Usecited by 7
  2. 2026Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remembercited by 7
  3. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
  4. 2026PAST-Bench: Benchmarking the Foundations of Recursive Self-Improvement in Personal Agentscited by 5
  5. 2026SkillWiki: A Living Knowledge Infrastructure for Agent Skillscited by 2
  6. 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 2
  7. 2026Rethinking Self-Evolution: A Constrained Exploration-Exploitation Process for Mitigating Skill Overfittingcited by 1
  8. 2026When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systemscited by 1
  9. 2026SkillAligner: Treating Retrieved Skills as Adaptable Drafts at Execution Timecited by 1
  10. 2026SkillGLoW: Procedural-Family Skill Consolidation for Self-Improving Agents on Long-Horizon Task Streamscited by 1
  11. 2026From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agentscited by 1
  12. 2026MUSE: A Unified Agentic Harness for MLLMscited by 0
11 more
  1. 2026An Empirical Study of Downstream Adaptation for Agent Skillscited by 0
  2. 2026SkillAlchemy: Open-World Agent Skill Creationcited by 0
  3. 2026Who Maintains Agent Skills? A Longitudinal Study of Human-Governed, AI-Assisted Skill Maintenancecited by 0
  4. 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agentscited by 0
  5. 2026Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skillscited by 0
  6. 2026FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QAcited by 0
  7. 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoningcited by 0
  8. 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolutioncited by 0
  9. 2026Learn Now, Use Next, Trust Later: Prequential Test-Time Learning for LLM Agentscited by 0
  10. 2026SkillCome: Group Contrast Skill Optimization with Dual Memorycited by 0
  11. 2026ViSkill: Reinforcing VLM Agents with Evolving Visual-Native Skillscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?
  2. 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
  3. 2026Skills-Coach: A Self-Evolving Skill Optimizer via Training-Free GRPO
  4. 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolver
  5. 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents
  6. 2026SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion
  7. 2026SkillCraft: Can LLM Agents Learn to Use Tools Skillfully?
  8. 2026SkillFocus: Evolving Agent Skills via Capability Decomposition