mlsanityData to 14 Oct 2026

Parametric Skills

arXiv 2606.30015 ↗First posted 29 Jun 2026cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Since intelligence fundamentally relies on efficient skill acquisition (Chollet, 2019), the ability to leverage skills is critical. For LLMs, skills, manually authored or extracted from task trajectories, are textual recipes encoding mature problem-solving experience and are critical to agentic capabilities. Despite widespread deployment, their utility is limited by the model's ability to comprehend and follow skill instructions, especially under complex and long-context scenarios, where key instructions are difficult to locate and adhere to. To address this limitation, we propose ParametricSkills, a framework that can convert free-form textual skills into parameters at test time, enabling context-free skill exploitation. Specifically, we first construct a large-scale, high-quality skill library, and synthesize single-turn and multi-turn skill exploitation trajectories built around these skills with OpenCode. Using these data, we then train a hypernetwork that parameterizes both the skill content and the test-time exploitation methodology by receiving textual skills and converting them into LoRA adapters. Experimental results on six complex software engineering (SWE) subtasks demonstrate that, the proposed ParametricSkills averagely outperforms in-context learning by 6.44 points as judged by DeepSeek-V4-Flash, while also achieving significantly higher BERT Score and F1 score, confirming its effectiveness. Beyond performance, we further find that parametric skills, being inherently accumulative, offer a preliminary yet promising avenue toward test-time continual learning.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 40 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

32 of 40 references.

References · 32

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  6. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  7. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  8. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  9. 2016HyperNetworkscited by 1,027
  10. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  11. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  12. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
20 more
  1. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
  2. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 128
  3. 2025A Comprehensive Survey on Long Context Language Modelingcited by 117
  4. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 107
  5. 2023A Brief Review of Hypernetworks in Deep Learningcited by 102
  6. 2026SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalizationcited by 94
  7. 2026Skill-SD: Skill-Conditioned Self-Distillation for Multi-turn LLM Agentscited by 90
  8. 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 82
  9. 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agentscited by 69
  10. 2025Text-to-LoRA: Instant Transformer Adaptioncited by 58
  11. 2026FrontierScience: Evaluating AI's Ability to Perform Expert-Level Scientific Taskscited by 47
  12. 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 43
  13. 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learningcited by 35
  14. 2026SHINE: A Scalable In-Context Hypernetwork for Mapping Context to LoRA in a Single Passcited by 25
  15. 2025HiPhO: How Far Are (M)LLMs from Humans in the Latest High School Physics Olympiad Benchmark?cited by 19
  16. 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 18
  17. 2026ARIS: Autonomous Research via Adversarial Multi-Agent Collaborationcited by 16
  18. 2026LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agentscited by 10
  19. 2026Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scalingcited by 8
  20. 2025LoRA-Gen: Specializing Large Language Model via Online LoRA Generationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillSmith: Learning to Compose Parametric Skills and Textual Knowledge
  2. 2026Prompt2Skill: Unsupervised Skill Optimization From Natural Language Instructions
  3. 2026Skills-Coach: A Self-Evolving Skill Optimizer via Training-Free GRPO
  4. 2026Toward Skill-Native LLMs: Skill Entropy for Benchmarking and Training Long-Horizon Reasoning
  5. 2026Generative Skill Composition for LLM Agents
  6. 2026Skill-to-LoRA: From Using Skills to Learning Behaviors for Token-Efficient LLM Agents
  7. 2026SkillRouter: Skill Routing for LLM Agents at Scale
  8. 2026SKILL-KD: Contrastive Skill Distillation for LLM Agents