Anything2Skill: Compiling External Knowledge into Reusable Skills for Agents
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
Abstract (arXiv)
Retrieval-augmented generation (RAG) enables agents to access external knowledge at inference time, but it primarily retrieves fragmented declarative evidence, leaving agents to repeatedly infer task procedures from passages, manuals, examples, logs, or trajectories. This raises a fundamental question: can skills extracted from external knowledge bases be installed into an agent, enabling it to rapidly approximate domain expertise? In this paper, we propose Anything2Skill, a taxonomy-guided framework that compiles heterogeneous external knowledge into reusable, retrievable, and executable skills for agents. Given a corpus of knowledge records, textscAnything2Skill first decomposes each record into evidence windows and performs plan-and-expand skill extraction under a skill-tree prior. The extracted candidates are then converted into structured skill contracts that specify invocation conditions, contraindications, action moves, workflow steps, constraints, output specifications, supporting evidence, and confidence scores. To construct a deployable procedural memory, Anything2Skill manages the extracted skills in a persistent SkillBank through taxonomy-aware compilation, registry-level reconciliation, lifecycle tracking, versioned updates, and visible skill-tree projection. At inference time, agents retrieve both task-specific passages from the original knowledge base and relevant procedural skills from the SkillBank, allowing RAG to provide declarative evidence while compiled skills provide reusable procedural guidance. Experiments on qsv and GitHub-CLI show that Anything2Skill combined with RAG achieves 98.85% and 94.10% success rates, respectively, substantially outperforming RAG-only agents. These results suggest that compiling latent procedural knowledge into explicit skills is an effective way to extend retrieval-augmented agents from knowledge access toward capability reuse.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 45 of its 51 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
45 of 51 references.
References · 45
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
33 more
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 752
- 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2023Active Retrieval Augmented Generationcited by 516
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
- 2020Accelerating Reinforcement Learning with Learned Skill Priorscited by 223
- 2016Modular Multitask Reinforcement Learning with Policy Sketchescited by 203
- 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
- 2021Skill Induction and Planning with Latent Languagecited by 99
- 2019Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Indexcited by 64
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026SkillJack: Persistent Skill Backdoors in Self-Evolving Agentscited by 6
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agentscited by 3
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
- 2026FeatureHospital: A Skill-Driven Multi-Agent Framework for Automated Algorithm Customization in Multi-View Multi-Label Feature Selectioncited by 0
- 2026SkillVine: Agent Skill Evolution via Branching Explorationcited by 0
- 2026Retrieval-Augmented Skill Optimization via Cross-Harness Adaptationcited by 0
- 2026Retrieval-Augmented Skill Optimization via Cross-Harness Adaptation29 Sep 2026
- 2026SkillVine: Agent Skill Evolution via Branching Exploration26 Sep 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026FeatureHospital: A Skill-Driven Multi-Agent Framework for Automated Algorithm Customization in Multi-View Multi-Label Feature Selection17 Aug 2026
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents13 Aug 2026
- 2026SkillJack: Persistent Skill Backdoors in Self-Evolving Agents4 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Skill2Query: Exploiting Skill Structure to Generate Pseudo-Queries for Agent Skill Retrieval
- 2026SkillRAE: Agent Skill-Based Context Compilation for Retrieval-Augmented Execution
- 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resources
- 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale
- 2026Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks
- 2025SkillFlow: Scalable and Efficient Agent Skill Retrieval System
- 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents
- 2026Evidence-Calibrated Runtime Reconstruction for Agent Skills Across Heterogeneous Coding Agents