mlsanityData to 7 Oct 2026

Grounded Skill Synthesis from Code at Scale for Agentic Intelligence

arXiv 2609.05571 ↗First posted 4 Sep 2026cs.SE cs.CLcited by 0

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Reusable skills give agents transferable procedural knowledge, making scalable acquisition essential for extending agents beyond prior experience. Existing methods face two limitations: trajectory-based synthesis requires interactions with specific environments, while document-derived skills may lack executable evidence and verification. Source code offers a complementary path: it requires no prior agent experience yet provides executable evidence for grounding abstractions. We present Code2Skill, a fully automated pipeline that transforms selected code units into implementation-anchored records of atomic operations, composite workflows, and recurring patterns, then verifies each record through source-body-blind reconstruction and source-aware comparison. Applied to 19,769 popular, actively maintained GitHub repositories, Code2Skill produces CodeSkillBank, a grounded bank of 1,006,822 accepted records with workflow, boundary, provenance, and source-evidence metadata. Across 72 protocol-matched evaluations covering nine model settings and eight benchmarks, models augmented with retrieved CodeSkillBank skills improve by 11.7% on average over matched baselines and outperform them in 57 cases. Under a unified downstream interface, Code2Skill also outperforms trajectory-derived skill banks on all seven shared benchmarks, showing that repository-derived skills can provide useful procedural knowledge before agents accumulate sufficient interaction experience. Skills synthesized from tested AI-generated code achieve a 93.50% pass rate, compared with 93.00% for human-written code, providing initial evidence that the pipeline can expand with the growing volume of AI-generated software. Overall, Code2Skill transforms procedural knowledge embedded in repositories into grounded, verifiable, and transferable agent skills.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 59 of its 78 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

59 of 78 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skills22 May
  2. 2026SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agents18 May
  3. 2026SkillOS: Learning Skill Curation for Self-Evolving Agents7 May
  4. 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents7 May
  5. 2026From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skills27 Apr
  6. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills26 Mar
  7. 2026Automating Skill Acquisition through Large-Scale Mining of Open-Source Agentic Repositories: A Framework for Multi-Agent Procedural Knowledge Extraction12 Mar
  8. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb

Other references · 51

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  7. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  8. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  9. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  10. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  11. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  12. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
38 more
  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  3. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  4. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  5. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  6. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  7. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  8. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  9. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  10. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  11. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
  12. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
  13. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  14. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  15. 2024Automated Design of Agentic Systemscited by 360
  16. 2024Agent Workflow Memorycited by 342
  17. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
  18. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
  19. 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
  20. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 80
  21. 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
  22. 2024Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoningcited by 69
  23. 2024Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender Systemcited by 50
  24. 2022Pynguin: Automated Unit Test Generation for Pythoncited by 49
  25. 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolutioncited by 33
  26. 2026LongCLI-Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfacescited by 29
  27. 2024TnT-LLM: Text Mining at Scale with Large Language Modelscited by 26
  28. 2025Advancing Tool-Augmented Large Language Models via Meta-Verification and Reflection Learningcited by 22
  29. 2026SWE-World: Building Software Engineering Agents in Docker-Free Environmentscited by 21
  30. 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)cited by 20
  31. 2023Eliminating Reasoning via Inferring with Planning: A New Framework to Guide LLMs' Non-linear Thinkingcited by 19
  32. 2024Large Language Model-driven Meta-structure Discovery in Heterogeneous Information Networkcited by 16
  33. 2024Optimizing Language Model's Reasoning Abilities with Weak Supervisioncited by 15
  34. 2026Group of Skills: Group-Structured Skill Retrieval for Agent Skill Librariescited by 9
  35. 2023Tram: A Token-level Retrieval-augmented Mechanism for Source Code Summarizationcited by 6
  36. 2025JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptationcited by 5
  37. 2025Dingtalk DeepResearch: A Unified Multi Agent Framework for Adaptive Intelligence in Enterprise Environmentscited by 5
  38. 2026Experience Makes Skillful: Enabling Generalizable Medical Agent Reasoning via Self-Evolving Skill Memorycited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation
  2. 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resources
  3. 2026Evidence-Calibrated Runtime Reconstruction for Agent Skills Across Heterogeneous Coding Agents
  4. 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents
  5. 2026SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolution
  6. 2026Demystifying Agent Skills: Why They Work-Until They Don't
  7. 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
  8. 2026CODESKILL: Learning Self-Evolving Skills for Coding Agents