Skill-to-LoRA: From Using Skills to Learning Behaviors for Token-Efficient LLM Agents
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Agent skills are commonly distributed as SKILL.md files: human-readable procedural documents that describe workflows, tools, resources, and domain conventions. While convenient for inspection and reuse, this design requires the same reusable procedure to be repeatedly injected into the runtime context. We propose Skill-to-LoRA(S2L), a behavior-centric skill representation that replaces runtime skill text with skill-specific LoRA adapters. Rather than compressing the skill document itself, S2L models the behavioral change induced by the skill text: offline, the complete SKILL.md is used to synthesize skill-guided demonstrations; online, the full document is omitted and the corresponding LoRA adapter is dynamically loaded to activate the learned skill behavior. We evaluate S2L with Qwen3.6-27B on a 21-skill subset of SWE-Skills-Bench. Compared with the no-skill and Full Skill Text baselines, S2L improves pass rate by 2.9 and 5.2 percentage points, respectively, while reducing per-step token cost by 6.6% relative to Full Skill Text prompting. S2L matches or improves Full Skill Text on 18/21 skills and the no-skill baseline on 15/21 skills. Control experiments further show that the gains depend on skill-specific adapter alignment: Wrong-LoRA and Shared-LoRA both reduce performance. These results suggest that many procedural agent skills can be converted from runtime instructions into trainable, dynamically loadable behavioral modules. Code will be released upon acceptance.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 12 of its 25 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
12 of 25 references.
Closest ancestors · 3
Same direction, newest first
- 2026SkillLearnBench: Benchmarking Continual Learning Methods for Agent Skill Generation on Real-World Tasks22 Apr
- 2026SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalization2 Apr
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb
Other references · 9
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2026SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?cited by 72
- 2025Text-to-LoRA: Instant Transformer Adaptioncited by 50
- 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 36
- 2024Skill Set Optimization: Reinforcing Language Model Behavior via Transferable Skillscited by 24
- 2025Training Plug-n-Play Knowledge Modules with Deep Context Distillationcited by 22
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026SkillZip: Evaluation-Free Skill Compression for Self-Evolving Agents by Discovering Reusable Structurecited by 3
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 1
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesiscited by 0
- 2026AUSO: Action-Level Unified Skill Optimization from Internalization to Utilizationcited by 0
- 2026SkillZip Pro: Execution-Aware Dynamic Compression of Progressively Loaded Skills for Self-Evolving Agentscited by 0
- 2026Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skillscited by 0
- 2026SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generationcited by 0
- 2026SkillFM: Generating Skills for LLM Agents via Latent Flow Matchingcited by 0
- 2026SkillFM: Generating Skills for LLM Agents via Latent Flow Matching30 Sep 2026
- 2026SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generation29 Sep 2026
- 2026Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skills10 Sep 2026
- 2026SkillZip Pro: Execution-Aware Dynamic Compression of Progressively Loaded Skills for Self-Evolving Agents31 Aug 2026
- 2026AUSO: Action-Level Unified Skill Optimization from Internalization to Utilization21 Aug 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026SkillZip: Evaluation-Free Skill Compression for Self-Evolving Agents by Discovering Reusable Structure11 Aug 2026
- 2026From Execution to Capability: Scientific Experience Consolidation via Procedural Knowledge Synthesis27 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents
- 2026SkillLens: Adaptive Multi-Granularity Skill Reuse for Cost-Efficient LLM Agents
- 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
- 2026SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
- 2026Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agents
- 2026A Framework for Evaluating Agentic Skills at Scale
- 2026SkillRouter: Skill Routing for LLM Agents at Scale
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents