mlsanityData to 14 Oct 2026

Anything2Skill: Compiling External Knowledge into Reusable Skills for Agents

arXiv 2606.09316 ↗First posted 8 Jun 2026cs.AIcited by 6

On the map: Retrieval-augmented generation → Agentic RAG, agents and memory

Abstract (arXiv)

Retrieval-augmented generation (RAG) enables agents to access external knowledge at inference time, but it primarily retrieves fragmented declarative evidence, leaving agents to repeatedly infer task procedures from passages, manuals, examples, logs, or trajectories. This raises a fundamental question: can skills extracted from external knowledge bases be installed into an agent, enabling it to rapidly approximate domain expertise? In this paper, we propose Anything2Skill, a taxonomy-guided framework that compiles heterogeneous external knowledge into reusable, retrievable, and executable skills for agents. Given a corpus of knowledge records, textscAnything2Skill first decomposes each record into evidence windows and performs plan-and-expand skill extraction under a skill-tree prior. The extracted candidates are then converted into structured skill contracts that specify invocation conditions, contraindications, action moves, workflow steps, constraints, output specifications, supporting evidence, and confidence scores. To construct a deployable procedural memory, Anything2Skill manages the extracted skills in a persistent SkillBank through taxonomy-aware compilation, registry-level reconciliation, lifecycle tracking, versioned updates, and visible skill-tree projection. At inference time, agents retrieve both task-specific passages from the original knowledge base and relevant procedural skills from the SkillBank, allowing RAG to provide declarative evidence while compiled skills provide reusable procedural guidance. Experiments on qsv and GitHub-CLI show that Anything2Skill combined with RAG achieves 98.85% and 94.10% success rates, respectively, substantially outperforming RAG-only agents. These results suggest that compiling latent procedural knowledge into explicit skills is an effective way to extend retrieval-augmented agents from knowledge access toward capability reuse.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 45 of its 51 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

45 of 51 references.

References · 45

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  9. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  11. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  12. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
33 more
  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  2. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  3. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  4. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  5. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  6. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  7. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  8. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  9. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  10. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  11. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  12. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  13. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  14. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  15. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  16. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
  17. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  18. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  19. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  20. 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 752
  21. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
  22. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  23. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  24. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
  25. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
  26. 2023Active Retrieval Augmented Generationcited by 516
  27. 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
  28. 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
  29. 2020Accelerating Reinforcement Learning with Learned Skill Priorscited by 223
  30. 2016Modular Multitask Reinforcement Learning with Policy Sketchescited by 203
  31. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
  32. 2021Skill Induction and Planning with Latent Languagecited by 99
  33. 2019Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Indexcited by 64

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Skill2Query: Exploiting Skill Structure to Generate Pseudo-Queries for Agent Skill Retrieval
  2. 2026SkillRAE: Agent Skill-Based Context Compilation for Retrieval-Augmented Execution
  3. 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resources
  4. 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale
  5. 2026Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks
  6. 2025SkillFlow: Scalable and Efficient Agent Skill Retrieval System
  7. 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents
  8. 2026Evidence-Calibrated Runtime Reconstruction for Agent Skills Across Heterogeneous Coding Agents