SoK: Agentic Skills -- Beyond Tool Use in LLM Agents
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Agentic systems increasingly rely on reusable procedural capabilities, textita.k.a., agentic skills, to execute long-horizon workflows reliably. These capabilities are callable modules that package procedural knowledge with explicit applicability conditions, execution policies, termination criteria, and reusable interfaces. Unlike one-off plans or atomic tool calls, skills operate (and often do well) across tasks. This paper maps the skill layer across the full lifecycle (discovery, practice, distillation, storage, composition, evaluation, and update) and introduces two complementary taxonomies. The first is a system-level set of seven design patterns capturing how skills are packaged and executed in practice, from metadata-driven progressive disclosure and executable code skills to self-evolving libraries and marketplace distribution. The second is an orthogonal representation × scope taxonomy describing what skills are (natural language, code, policy, hybrid) and what environments they operate over (web, OS, software engineering, robotics). We analyze the security and governance implications of skill-based agents, covering supply-chain risks, prompt injection via skill payloads, and trust-tiered execution, grounded by a case study of the ClawHavoc campaign in which nearly 1,200 malicious skills infiltrated a major agent marketplace, exfiltrating API keys, cryptocurrency wallets, and browser credentials at scale. We further survey deterministic evaluation approaches, anchored by recent benchmark evidence that curated skills can substantially improve agent success rates while self-generated skills may degrade them. We conclude with open challenges toward robust, verifiable, and certifiable skills for real-world autonomous agents.
Key facts. Cited by 120 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 55 of its 74 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
55 of 74 references.
Closest ancestors · 1
Same direction, newest first
Other references · 54
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
38 more
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 478
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2024Understanding the planning of LLM agents: A surveycited by 414
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 407
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2025ToolRL: Reward is All Tool Learning Needscited by 342
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 319
- 2023Tool Learning with Foundation Modelscited by 302
- 2023FireAct: Toward Language Agent Fine-tuningcited by 247
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
- 2025Survey on Evaluation of LLM-based Agentscited by 190
- 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 120
- 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 114
- 2023ProAgent: Building Proactive Cooperative Agents with Large Language Modelscited by 97
- 2023CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Modelscited by 90
- 2023Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modellingcited by 88
- 2023TaskWeaver: A Code-First Agent Frameworkcited by 85
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
- 2022Taxonomy of Attacks on Open-Source Software Supply Chainscited by 57
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 120.
120 papers.
Sort:
By area:
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agentscited by 37
- 2026SkillGen: Verified Inference-Time Agent Skill Synthesiscited by 29
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learningcited by 28
- 2026Formal Analysis and Supply Chain Security for Agentic AI Skillscited by 21
- 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
- 2026SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolutioncited by 18
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
- 2026SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agentscited by 17
38 more
- 2026Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agentscited by 16
- 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfacescited by 15
- 2026MalSkillBench: A Runtime-Verified Benchmark of Malicious Agent Skillscited by 14
- 2026Co-Evolving LLM Decision and Skill Bank Agents for Long-Horizon Taskscited by 13
- 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolutioncited by 12
- 2026More Skills, Worse Agents? Skill Shadowing Degrades Performance When Expanding Skill Librariescited by 11
- 2026SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinementcited by 11
- 2026Group of Skills: Group-Structured Skill Retrieval for Agent Skill Librariescited by 9
- 2026Benign in Isolation, Harmful in Composition: Security Risks in Agent Skill Ecosystemscited by 9
- 2026SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topologycited by 8
- 2026SkillMaster: Toward Autonomous Skill Mastery in LLM Agentscited by 8
- 2026VIGIL: Runtime Enforcement of Behavioral Specifications in AI Agent Skillscited by 8
- 2026WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolutioncited by 7
- 2026Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAGcited by 6
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 6
- 2026SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestrationcited by 6
- 2026Skill Is Not Document: Query-Conditioned Compatibility for LLM Agent Skill Routingcited by 6
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skillscited by 6
- 2026SkillsInjector: Dynamic Skill Context Construction for LLM Agentscited by 5
- 2026Co-Evolving Skill Generation and Policy Optimizationcited by 5
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
- 2026SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agentscited by 5
- 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skillscited by 5
- 2026Generative Skill Composition for LLM Agentscited by 5
- 2026When Skills Don't Help: A Negative Result on Procedural Knowledge for Tool-Grounded Agents in Offensive Cybersecuritycited by 4
- 2026SkillGuard: A Permission-Centric Framework for Agent Skill Securitycited by 4
- 2026Task Decomposition-Guided Reranking for Adaptive Agent Skill Retrievalcited by 4
- 2026Agent Skills Matter: Inferring Proprietary Skills from Execution Trajectoriescited by 4
- 2026Clawed and Dangerous: Can We Trust Open Agentic Systems?cited by 3
- 2026Skill Drift Is Contract Violation: Proactive Maintenance for LLM Agent Skill Librariescited by 3
- 2026The Scaling Laws of Skills in LLM Agent Systemscited by 3
- 2026Responsible Agentic AI Requires Explicit Provenancecited by 3
- 2026Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agentscited by 3
- 2026Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skillcited by 3
- 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agentscited by 3
- 2026OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skillscited by 3
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 3
50 most cited of 120 All 120 (JSON)
- 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale30 Sep 2026
- 2026SkillCome: Group Contrast Skill Optimization with Dual Memory29 Sep 2026
- 2026SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs29 Sep 2026
- 2026PrivacySkills: How Privacy Guidance Shapes Source Selection in LLM Agents28 Sep 2026
- 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimization26 Sep 2026
- 2026GraphSkillEvo: Evolutionary Optimization of Graph-Structured Agent Skills18 Sep 2026
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding17 Sep 2026
- 2026Skill-based Agentic Evaluation for Real-time Data Science Tasks15 Sep 2026
- 2026MOSCOPT: Mixture-of-Skills Collective Optimization for LLM Agents13 Sep 2026
- 2026Auto-RecSys: Harnessing Autonomous Research Agents for Industry-Scale Recommender System10 Sep 2026
- 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents7 Sep 2026
- 2026AgentLeak: Cloning Stronger LLM Agent Capabilities onto Weaker Agents Beyond Skill Stealing7 Sep 2026
38 more
- 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctness5 Sep 2026
- 2026DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendation2 Sep 2026
- 2026EvoSkill Injection: Red-Teaming Autonomous Skill Generation and Evolution in Self-Evolving Agents31 Aug 2026
- 2026Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agents31 Aug 2026
- 2026Scientific Agent Skills: A Library of Procedural Knowledge for Research Agents30 Aug 2026
- 2026WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution27 Aug 2026
- 2026Grounded Checklist Partial Credit for Agent Skill Trajectories26 Aug 2026
- 2026SkillAlchemy: Open-World Agent Skill Creation24 Aug 2026
- 2026MEMORY Wins All: Indirect Bias Injection Attacks via Social Media Feeds22 Aug 2026
- 2026Repo2Skill-Evo: Repository Skills Go Stale in Silence22 Aug 2026
- 2026ReCache: Efficient KV Cache Reuse and Compression for Tool-Augmented LLM Agents20 Aug 2026
- 2026Write, Execute, Refine: From Skill Followers to Skill Optimizers via Reinforcement Learning from Execution Feedback18 Aug 2026
- 2026When Tool-Backed Skill Retrieval Fails: Source-Style Collapse in Executable Capability Retrieval17 Aug 2026
- 2026FeatureHospital: A Skill-Driven Multi-Agent Framework for Automated Algorithm Customization in Multi-View Multi-Label Feature Selection17 Aug 2026
- 2026SkillEvo: Self-Renewing Evolution Gradients from Multi-Turn Interaction Feedback13 Aug 2026
- 2026Self-Evolving Skills via Surrogate-Guided Solve-and-Reproduce10 Aug 2026
- 2026Do Personalized Skills Help Coding Agents? An Empirical Study of Developer Interaction Histories10 Aug 2026
- 2026Distill Skills into Weights, Not Prompts: Abstract Skills as Privileged Signals for On-Policy Self-Distillation10 Aug 2026
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scanners10 Aug 2026
- 2026Bidirectional Context Self-Distillation for Reinforcement Learning of Skill-Based LLM Agents10 Aug 2026
- 2026Muscle Memory for Agents: Compile not Merely Retrieve10 Aug 2026
- 2026SkillSmith: Enhancing Locally Deployed Agents via Automatic Skill Construction and Evolution8 Aug 2026
- 2026SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent7 Aug 2026
- 2026SkillEval: Decomposing Agent Skill Quality into Interpretable Signals7 Aug 2026
- 2026SynChain: Inducing Computer-Use Agent Systems to Construct Their Own Attack Chains7 Aug 2026
- 2026SkillTFM: Gated Skill Evolution for Training-Free Adaptation of Tabular Foundation Models6 Aug 2026
- 2026SkillTrace: Multi-Trace Provenance Auditing for LLM-Agent Skill Reuse5 Aug 2026
- 2026You Don't Need To Stay in The Loop: An Agentic Robotics Loop for Robot-Policy Improvement2 Aug 2026
- 2026Self-Supervised Skill Optimization30 Jul 2026
- 2026Rethinking Self-Evolution: A Constrained Exploration-Exploitation Process for Mitigating Skill Overfitting29 Jul 2026
- 2026Living-Harness Is an Interactive-Agent Evolver29 Jul 2026
- 2026OmniDelta: Skill-Driven Budget Allocation for Token Compression in OmniLLMs28 Jul 2026
- 2026Agent Skills Matter: Inferring Proprietary Skills from Execution Trajectories28 Jul 2026
- 2026Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills24 Jul 2026
- 2026Workflow-Localized Mechanism Learning: Attribution-Guided Repair and Knowledge Reuse for Structured Agent Skills23 Jul 2026
- 2026OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills22 Jul 2026
- 2026Toward User-Conditioned Evaluation of Personal LLM Agents under Temporal Interventions20 Jul 2026
- 2026StructureClaw: Traceable LLM Agents and an Executable Benchmark for Structural Engineering Workflows16 Jul 2026
50 newest of 120 All 120 (JSON)
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agentscited by 37
- 2026SkillGen: Verified Inference-Time Agent Skill Synthesiscited by 29
- 2026Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learningcited by 28
- 2026Formal Analysis and Supply Chain Security for Agentic AI Skillscited by 21
- 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
- 2026SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolutioncited by 18
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
- 2026SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agentscited by 17
12 most cited of 87 All 87 (JSON)
- 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale30 Sep 2026
- 2026SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs29 Sep 2026
- 2026PrivacySkills: How Privacy Guidance Shapes Source Selection in LLM Agents28 Sep 2026
- 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimization26 Sep 2026
- 2026GraphSkillEvo: Evolutionary Optimization of Graph-Structured Agent Skills18 Sep 2026
- 2026Skill-based Agentic Evaluation for Real-time Data Science Tasks15 Sep 2026
- 2026MOSCOPT: Mixture-of-Skills Collective Optimization for LLM Agents13 Sep 2026
- 2026Auto-RecSys: Harnessing Autonomous Research Agents for Industry-Scale Recommender System10 Sep 2026
- 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents7 Sep 2026
- 2026AgentLeak: Cloning Stronger LLM Agent Capabilities onto Weaker Agents Beyond Skill Stealing7 Sep 2026
- 2026EvoSkill Injection: Red-Teaming Autonomous Skill Generation and Evolution in Self-Evolving Agents31 Aug 2026
- 2026Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agents31 Aug 2026
12 newest of 87 All 87 (JSON)
- 2026Group of Skills: Group-Structured Skill Retrieval for Agent Skill Librariescited by 9
- 2026WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolutioncited by 7
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 6
- 2026Co-Evolving Skill Generation and Policy Optimizationcited by 5
- 2026Agent Skills Matter: Inferring Proprietary Skills from Execution Trajectoriescited by 4
- 2026Ace-Skill: Bootstrapping Multimodal Agents with Prioritized and Clustered Evolutioncited by 2
- 2026SoftSkill: Behavioral Compression for Contextual Adaptationcited by 2
- 2026Can Trustless Agents Be Trusted? An Empirical Study of the ERC-8004 Decentralized AI Agent Ecosystemcited by 2
- 2026When Tool-Backed Skill Retrieval Fails: Source-Style Collapse in Executable Capability Retrievalcited by 2
- 2026StatefulDiscovery: Evidence-Calibrated Claim Formation in Open-Ended Scientific Discoverycited by 1
- 2026SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplacescited by 1
- 2026Inside the Skill Market: From Software Engineering Activities to Reusable Agent Skillscited by 1
12 most cited of 26 All 26 (JSON)
- 2026SkillCome: Group Contrast Skill Optimization with Dual Memory29 Sep 2026
- 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding17 Sep 2026
- 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctness5 Sep 2026
- 2026DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendation2 Sep 2026
- 2026WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution27 Aug 2026
- 2026SkillAlchemy: Open-World Agent Skill Creation24 Aug 2026
- 2026Repo2Skill-Evo: Repository Skills Go Stale in Silence22 Aug 2026
- 2026Write, Execute, Refine: From Skill Followers to Skill Optimizers via Reinforcement Learning from Execution Feedback18 Aug 2026
- 2026When Tool-Backed Skill Retrieval Fails: Source-Style Collapse in Executable Capability Retrieval17 Aug 2026
- 2026FeatureHospital: A Skill-Driven Multi-Agent Framework for Automated Algorithm Customization in Multi-View Multi-Label Feature Selection17 Aug 2026
- 2026SkillEvo: Self-Renewing Evolution Gradients from Multi-Turn Interaction Feedback13 Aug 2026
- 2026Distill Skills into Weights, Not Prompts: Abstract Skills as Privileged Signals for On-Policy Self-Distillation10 Aug 2026
12 newest of 26 All 26 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality
- 2026SkillCraft: Can LLM Agents Learn to Use Tools Skillfully?
- 2026Authoring Agent Skills: A Software-Engineering Approach
- 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintained
- 2026A Framework for Evaluating Agentic Skills at Scale
- 2026Harnessing Agent Skills: Architectural Patterns and a Reference Architecture for Skill-Mediated LLM Agents
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysis