mlsanityData to 7 Oct 2026

EASE: Behavior-Adaptive Skill Curation for Self-Evolving Agents

arXiv 2609.36746 ↗First posted 29 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Agent skills provide a lightweight mechanism for self-evolving agents to accumulate reusable procedural knowledge without updating model parameters. However, existing learned skill curators typically optimize curation without explicitly modeling downstream executor behavior. We show that this can cause systematic cross-executor degradation: curators trained with different executors perform best when paired with their own training executor, indicating that effective skill curation is executor-dependent. We formulate behavior-adaptive skill curation and introduce EASE, a framework that learns a single curator that adapts its decisions to different executor behaviors. EASE maintains an online behavioral profile of recent execution patterns and conditions the curator on this profile, the current trajectory, and retrieved skills to add, modify, or remove skills from an evolving repository. We train the shared curator jointly across multiple frozen executors with reinforcement learning, using retrieval-aware and behavior-aware temporal attribution to focus optimization on curation actions with observable downstream influence. Across ALFWorld, ScienceWorld, and WebShop, with executors ranging from Qwen3-8B/32B and GPT-OSS-120B to unseen Kimi K2.6, DeepSeek V4 Flash, and Gemini 3.5 Flash, EASE outperforms strong skill- and memory-based baselines without per-executor finetuning. EASE also maintains 34.5--41.0% fewer skills, improves skill retrieval by 36.3--38.7% and measured edit utility by 51.8--60.0%, and reduces deployment-time inference tokens by 9.1--14.5%. These results establish behavior-adaptive skill curation as an effective principle for building self-evolving agents.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 27 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

22 of 27 references.

References · 22

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  7. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  8. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  9. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  10. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  11. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  12. 2024Agent Workflow Memorycited by 342
10 more
  1. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
  2. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  3. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 252
  4. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
  5. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
  6. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 96
  7. 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 91
  8. 2025Memp: Exploring Agent Procedural Memorycited by 88
  9. 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agentscited by 69
  10. 2026SkillOS: Learning Skill Curation for Self-Evolving Agentscited by 45

Built on by

Not cited yet.