mlsanityData to 7 Oct 2026

SoK: Agentic Skills -- Beyond Tool Use in LLM Agents

arXiv 2602.20867 ↗First posted 24 Feb 2026cs.CR cs.AI cs.CEcited by 120

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Agentic systems increasingly rely on reusable procedural capabilities, textita.k.a., agentic skills, to execute long-horizon workflows reliably. These capabilities are callable modules that package procedural knowledge with explicit applicability conditions, execution policies, termination criteria, and reusable interfaces. Unlike one-off plans or atomic tool calls, skills operate (and often do well) across tasks. This paper maps the skill layer across the full lifecycle (discovery, practice, distillation, storage, composition, evaluation, and update) and introduces two complementary taxonomies. The first is a system-level set of seven design patterns capturing how skills are packaged and executed in practice, from metadata-driven progressive disclosure and executable code skills to self-evolving libraries and marketplace distribution. The second is an orthogonal representation × scope taxonomy describing what skills are (natural language, code, policy, hybrid) and what environments they operate over (web, OS, software engineering, robotics). We analyze the security and governance implications of skill-based agents, covering supply-chain risks, prompt injection via skill payloads, and trust-tiered execution, grounded by a case study of the ClawHavoc campaign in which nearly 1,200 malicious skills infiltrated a major agent marketplace, exfiltrating API keys, cryptocurrency wallets, and browser credentials at scale. We further survey deterministic evaluation approaches, anchored by recent benchmark evidence that curated skills can substantially improve agent success rates while self-generated skills may degrade them. We conclude with open challenges toward robust, verifiable, and certifiable skills for real-world autonomous agents.

Key facts. Cited by 120 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 55 of its 74 references that are in the map. First posted on arXiv 24 Feb 2026.

Builds on

55 of 74 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb

Other references · 54

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  6. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  7. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  9. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  10. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  11. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  12. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
38 more
  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  3. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  5. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  6. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  7. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  8. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  9. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  10. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  11. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  12. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  13. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  14. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  15. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
  16. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
  17. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  18. 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 478
  19. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
  20. 2024Understanding the planning of LLM agents: A surveycited by 414
  21. 2023AppAgent: Multimodal Agents as Smartphone Userscited by 407
  22. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  23. 2025ToolRL: Reward is All Tool Learning Needscited by 342
  24. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 319
  25. 2023Tool Learning with Foundation Modelscited by 302
  26. 2023FireAct: Toward Language Agent Fine-tuningcited by 247
  27. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
  28. 2025Survey on Evaluation of LLM-based Agentscited by 190
  29. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  30. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  31. 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 120
  32. 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 114
  33. 2023ProAgent: Building Proactive Cooperative Agents with Large Language Modelscited by 97
  34. 2023CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Modelscited by 90
  35. 2023Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modellingcited by 88
  36. 2023TaskWeaver: A Code-First Agent Frameworkcited by 85
  37. 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
  38. 2022Taxonomy of Attacks on Open-Source Software Supply Chainscited by 57

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 120.

120 papers.

Sort:

By area:

  1. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
  2. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
  3. 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
  4. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
  5. 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agentscited by 37
  6. 2026SkillGen: Verified Inference-Time Agent Skill Synthesiscited by 29
  7. 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learningcited by 28
  8. 2026Formal Analysis and Supply Chain Security for Agentic AI Skillscited by 21
  9. 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
  10. 2026SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolutioncited by 18
  11. 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
  12. 2026SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agentscited by 17
38 more
  1. 2026Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agentscited by 16
  2. 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfacescited by 15
  3. 2026MalSkillBench: A Runtime-Verified Benchmark of Malicious Agent Skillscited by 14
  4. 2026Co-Evolving LLM Decision and Skill Bank Agents for Long-Horizon Taskscited by 13
  5. 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolutioncited by 12
  6. 2026More Skills, Worse Agents? Skill Shadowing Degrades Performance When Expanding Skill Librariescited by 11
  7. 2026SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinementcited by 11
  8. 2026Group of Skills: Group-Structured Skill Retrieval for Agent Skill Librariescited by 9
  9. 2026Benign in Isolation, Harmful in Composition: Security Risks in Agent Skill Ecosystemscited by 9
  10. 2026SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topologycited by 8
  11. 2026SkillMaster: Toward Autonomous Skill Mastery in LLM Agentscited by 8
  12. 2026VIGIL: Runtime Enforcement of Behavioral Specifications in AI Agent Skillscited by 8
  13. 2026WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolutioncited by 7
  14. 2026Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAGcited by 6
  15. 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 6
  16. 2026SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestrationcited by 6
  17. 2026Skill Is Not Document: Query-Conditioned Compatibility for LLM Agent Skill Routingcited by 6
  18. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
  19. 2026Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skillscited by 6
  20. 2026SkillsInjector: Dynamic Skill Context Construction for LLM Agentscited by 5
  21. 2026Co-Evolving Skill Generation and Policy Optimizationcited by 5
  22. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
  23. 2026SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agentscited by 5
  24. 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skillscited by 5
  25. 2026Generative Skill Composition for LLM Agentscited by 5
  26. 2026When Skills Don't Help: A Negative Result on Procedural Knowledge for Tool-Grounded Agents in Offensive Cybersecuritycited by 4
  27. 2026SkillGuard: A Permission-Centric Framework for Agent Skill Securitycited by 4
  28. 2026Task Decomposition-Guided Reranking for Adaptive Agent Skill Retrievalcited by 4
  29. 2026Agent Skills Matter: Inferring Proprietary Skills from Execution Trajectoriescited by 4
  30. 2026Clawed and Dangerous: Can We Trust Open Agentic Systems?cited by 3
  31. 2026Skill Drift Is Contract Violation: Proactive Maintenance for LLM Agent Skill Librariescited by 3
  32. 2026The Scaling Laws of Skills in LLM Agent Systemscited by 3
  33. 2026Responsible Agentic AI Requires Explicit Provenancecited by 3
  34. 2026Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agentscited by 3
  35. 2026Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skillcited by 3
  36. 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agentscited by 3
  37. 2026OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skillscited by 3
  38. 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 3

50 most cited of 120 All 120 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security
  2. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality
  3. 2026SkillCraft: Can LLM Agents Learn to Use Tools Skillfully?
  4. 2026Authoring Agent Skills: A Software-Engineering Approach
  5. 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintained
  6. 2026A Framework for Evaluating Agentic Skills at Scale
  7. 2026Harnessing Agent Skills: Architectural Patterns and a Reference Architecture for Skill-Mediated LLM Agents
  8. 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysis