Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agents
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
LLM agents increasingly retrieve externally curated skills-procedural instructions retrieved at decision time-to improve performance on long-horizon interactive tasks. Existing skill libraries are typically treated as model-agnostic, reusing the same skill formulations across backbones with substantially different capacities and behaviors. However, our controlled experiments across multiple model scales show that skill effectiveness is strongly model-dependent: a skill that benefits one backbone can harm another. Motivated by this observation, we propose MASA Model-Aware Skill Alignment, a framework that adapts skills to each target backbone without modifying agent weights. MASA operates in two stages: (1) a hierarchical skill evolution pipeline that iteratively rewrites general and task-specific skills using hill climbing and UCB-driven tree search, guided by environment feedback and model capability profiles; and (2) a lightweight model-conditioned skill rewriter trained on evolution trajectories to reproduce the adaptation in a single forward pass. Experiments across three interactive environments and four backbones show that MASA consistently achieves the best overall performance, with gains of up to 25.8 points over the strongest baseline. The learned rewriter further generalizes to unseen tasks and environments without additional search, consistently outperforming a much larger teacher LLM at a fraction of the inference cost.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 24 of its 47 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
24 of 47 references.
Closest ancestors · 5
Same direction, newest first
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolver9 Apr
- 2026SkVM: Revisiting Language VM for Skills across Heterogenous LLMs and Harnesses3 Apr
- 2026SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalization2 Apr
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agents24 Feb
- 2025Reinforcement Learning for Self-Improving Agent with Skill Library18 Dec
Other references · 19
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
- 2023Large Language Models as Optimizerscited by 830
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
7 more
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 778
- 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 325
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 155
- 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 123
- 2024A Review on Edge Large Language Models: Design, Execution, and Applicationscited by 98
- 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 52
- 2024MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimizationcited by 20
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026SkillLens: Adaptive Multi-Granularity Skill Reuse for Cost-Efficient LLM Agents
- 2026SkillsInjector: Dynamic Skill Context Construction for LLM Agents
- 2026SkillMaster: Toward Autonomous Skill Mastery in LLM Agents
- 2026SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion
- 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?
- 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents
- 2026SkillFocus: Evolving Agent Skills via Capability Decomposition
- 2026How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settings