Search2Skill: Skill Distillation Beyond Knowledge Boundaries Via Rubric-Based Reinforcement Learning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Reusable skills, which encapsulate the procedural knowledge required to solve real-world professional tasks, offer LLM-based agents a path toward self-evolution in expert domains. Existing self-evolving skill methods construct skills internally from the model's parametric knowledge or trajectories, and are therefore bounded by what the model already knows. However, the domain conventions and standard procedures underlying professional skills often lie beyond this boundary and are hard to elicit from the agent alone. To address this issue, we therefore propose a novel framework, Search2Skill, that automatically identifies the agent's capability gaps, searches external sources to address them, and distills the retrieved evidence into structured, reusable skills. Specifically, Search2Skill is optimized by a rubric-based reinforcement learning scheme that jointly improves when to search, how to search, and how to generate skills. Experiments on eight expert-level domains from three benchmarks show that Search2Skill consistently outperforms both search-augmented and trajectory-based skill-learning baselines under both streaming and held-out evaluation protocols. Further analyses show that the gains arise from skill abstraction rather than raw retrieved evidence, and that the acquired skills transfer across model scales.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 31 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
20 of 31 references.
Closest ancestors · 3
Same direction, newest first
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb
- 2025DeepAgent: A General Reasoning Agent with Scalable Toolsets24 Oct
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory29 Sep
Other references · 17
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
- 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 187
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 137
- 2025General-Reasoner: Advancing LLM Reasoning Across All Domainscited by 135
- 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 114
- 2026SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalizationcited by 94
5 more
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 92
- 2026Dynamic Dual-Granularity Skill Bank for Agentic RLcited by 34
- 2026Marco DeepResearch: Unlocking Efficient Deep Research Agents via Verification-Centric Designcited by 16
- 2026EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfercited by 11
- 2026Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skillscited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
- 2026SkillForge: Co-Evolving Skills and Agents via Dynamic Skill Lifecycles
- 2026ContinualSkillBench: Can LLM Agents Truly Evolve Their Capabilities?
- 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents
- 2025Reinforcement Learning for Self-Improving Agent with Skill Library
- 2026SkillVine: Agent Skill Evolution via Branching Exploration
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learning
- 2026MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?