Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
The rise of AI agent frameworks has introduced agent skills, modular packages containing instructions and executable code that dynamically extend agent capabilities. While this architecture enables powerful customization, skills execute with implicit trust and minimal vetting, creating a significant yet uncharacterized attack surface. We conduct the first large-scale empirical security analysis of this emerging ecosystem, collecting 42,447 skills from two major marketplaces and systematically analyzing 31,132 using SkillScan, a multi-stage detection framework integrating static analysis with LLM-based semantic classification. Our findings reveal pervasive security risks: 26.1% of skills contain at least one vulnerability, spanning 14 distinct patterns across four categories: prompt injection, data exfiltration, privilege escalation, and supply chain risks. Data exfiltration (13.3%) and privilege escalation (11.8%) are most prevalent, while 5.2% of skills exhibit high-severity patterns strongly suggesting malicious intent. We find that skills bundling executable scripts are 2.12x more likely to contain vulnerabilities than instruction-only skills (OR=2.12, p<0.001). Our contributions include: (1) a grounded vulnerability taxonomy derived from 8,126 vulnerable skills, (2) a validated detection methodology achieving 86.7% precision and 82.5% recall, and (3) an open dataset and detection toolkit to support future research. These results demonstrate an urgent need for capability-based permission systems and mandatory security vetting before this attack vector is further exploited.
Key facts. Cited by 105 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 6 of its 34 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
6 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 5
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
- 2020Backstabber's Knife Collection: A Review of Open Source Software Supply Chain Attackscited by 61
- 2023Killing Two Birds with One Stone: Malicious Package Detection in NPM and PyPI using a Single Model of Malicious Behavior Sequencecited by 9
- 2024Developers Are Victims Too : A Comprehensive Analysis of The VS Code Extension Ecosystemcited by 4
- 2025A Study on Malicious Browser Extensions in 2025cited by 3
Built on by
Citing papers per year: 2026: 105.
105 papers.
Sort:
By area:
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 113
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 72
- 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 53
- 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wildcited by 50
- 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystemscited by 45
- 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiencycited by 33
- 2026ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspacescited by 33
- 2026SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinementcited by 30
- 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threatscited by 29
- 2026SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agentscited by 25
- 2026Formal Analysis and Supply Chain Security for Agentic AI Skillscited by 25
38 more
- 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
- 2026Your Agent, Their Asset: A Real-World Safety Analysis of OpenClawcited by 20
- 2026SkillSieve: A Hierarchical Triage Framework for Detecting Malicious AI Agent Skillscited by 20
- 2026How Your Credentials Are Leaked by LLM Agent Skills: An Empirical Studycited by 19
- 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfacescited by 19
- 2026MalSkillBench: A Runtime-Verified Benchmark of Malicious Agent Skillscited by 19
- 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystemscited by 17
- 2026From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skillscited by 16
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysiscited by 13
- 2026Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chaincited by 13
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registrycited by 12
- 2026AgentTrap: Measuring Runtime Trust Failures in Third-Party Agent Skillscited by 12
- 2026Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystemcited by 11
- 2026Cloak and Detonate: Scanner Evasion and Dynamic Detection of Agent Skill Malwarecited by 10
- 2026VIGIL: Runtime Enforcement of Behavioral Specifications in AI Agent Skillscited by 9
- 2026Trojan's Whisper: Stealthy Manipulation of OpenClaw through Injected Bootstrapped Guidancecited by 8
- 2026RouteGuard: Internal-Signal Detection of Skill Poisoning in LLM Agentscited by 7
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skillscited by 7
- 2026Safety in Embodied AI: A Survey of Risks, Attacks, and Defensescited by 7
- 2026Exploiting LLM Agent Supply Chains via Payload-less Skillscited by 6
- 2026SkillHarm: Lifecycle-Aware Skill-Based Attacks via Automated Constructioncited by 6
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026Generative Skill Composition for LLM Agentscited by 6
- 2026From Anatomy to Smells: An Empirical Study of SKILL.md in Agent Skillscited by 6
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026MalSkills: Detecting Malicious Skills in the Agentic Supply Chain via Neuro-symbolic Reasoningcited by 5
- 2026SkillScope: Toward Fine-Grained Least-Privilege Enforcement for Agent Skillscited by 5
- 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system securitycited by 5
- 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skillscited by 5
- 2026Seeing Is Not Screening: Multimodal Hidden Instruction Attacks on Agent Skill Scannerscited by 5
- 2026Agent Skill Security: Threat Models, Attacks, Defenses, and Evaluationcited by 5
- 2026Bilevel Optimization of Agent Skills via Monte Carlo Tree Searchcited by 4
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 4
- 2026Agent Skill Framework: Perspectives on the Potential of Small to Medium Language Models in Industrial Environmentscited by 3
- 2026Defenses & Enablers For Skill Injection Attacks on Terminal Based Agentscited by 3
- 2026Runtime Skill Audit: Targeted Runtime Probing for Agent Skill Securitycited by 3
- 2026Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chainscited by 3
- 2026OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skillscited by 3
50 most cited of 105 All 105 (JSON)
- 2026CoRedSkill: Stealthy Skill Composition Attacks via AST-Guided Injection14 Oct 2026
- 2026Beyond Maliciousness: Static and Runtime Attack-Surface Profiling of Agent Skills13 Oct 2026
- 2026Encrypted Skills Can Become New Security Exploits If AI Agents Know How to Decipher13 Oct 2026
- 2026One Skill Too Many: How Co-Installed Skills Conflict in Coding Agents8 Oct 2026
- 2026An Empirical Study of Agent Skills' Downstream Utility6 Oct 2026
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiences6 Oct 2026
- 2026AgentSpy: Making AI Agent Behavior Observable5 Oct 2026
- 2026Runaway Reaction: When Benign Skills Compose into Malicious Behavior5 Oct 2026
- 2026Learning to Decide, Not to Reason: Parameter-Efficient Decision Operators via Low-Rank Activation Steering3 Oct 2026
- 2026ActionGuard: Tool Call Authorization under Poisoned Skills30 Sep 2026
- 2026MMSkillRisk: Can Agents Stay Safe When Multimodal Skills Become Traps?28 Sep 2026
- 2026Stealth Apart, Harm Together: Skill Cascading Attacks on Skill-Based Agent Systems24 Sep 2026
38 more
- 2026Demystifying Agent Skills for Smart Contract Auditing: Design, Effectiveness, Behavioral Impact24 Sep 2026
- 2026After the Party: Growth, Governance, and Security Scanning in the OpenClaw Agent Skill Ecosystem15 Sep 2026
- 2026SkillSecurer: Detecting and Patching Prompt-Injection Vulnerabilities in AI Agent Skills12 Sep 2026
- 2026SkillAtlas: An Attack Trace Library for Agent Skills11 Sep 2026
- 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctness5 Sep 2026
- 2026Versioned Transitive Dependency-Closure Binding and Operation-Time Effect Governance for Agent Skills: ClosureBound5 Sep 2026
- 2026Defense-as-Skill: Evolving Runtime Guard Skill for Skill-Augmented Agents1 Sep 2026
- 2026Scientific Agent Skills: A Library of Procedural Knowledge for Research Agents30 Aug 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026EVOMAL: Self-Poisoning in Self-Evolving Coding Agents26 Aug 2026
- 2026Safe Skill Retirement for Physical Agents25 Aug 2026
- 2026SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents22 Aug 2026
- 2026MaliciousSkillBench: A Comprehensive Benchmark for Malicious Agent Skill Detection20 Aug 2026
- 2026TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generation18 Aug 2026
- 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experience17 Aug 2026
- 2026CompoSkill: Compositional Skill Chain Attacks from Individually Scanner-Passing LLM Agent Skills17 Aug 2026
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scanners10 Aug 2026
- 2026ElasticBack: Stealthy Conditional Backdoor in LLM-Agent Skills via Coupled Trigger-Rule Optimization10 Aug 2026
- 2026Query-Only Backdoor Attacks on Self-Evolving Skills via Trajectory Poisoning8 Aug 2026
- 2026SkillConsist: Detecting Inconsistencies in Agent Skills via Bidirectional Graph Alignment7 Aug 2026
- 2026SkillTrace: Multi-Trace Provenance Auditing for LLM-Agent Skill Reuse5 Aug 2026
- 2026Behavioral Skill Reconstruction: Reconstructing Hidden Functionality from LLM Agent Skills4 Aug 2026
- 2026S3: Improving Agent Safety through Multi-Stage Defense3 Aug 2026
- 2026Skillsets on the Chain: A Blockchain-based Zero-Trust Framework for Agentic AI Networking31 Jul 2026
- 2026Distributing Security Controls Through Harness Engineering28 Jul 2026
- 2026Protocol-Level Attacks on Agentic Commerce Platforms: A Cross-Platform Taxonomy, AIP-Bench, and Unified Defense23 Jul 2026
- 2026OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills22 Jul 2026
- 2026Agent Skill Security: Threat Models, Attacks, Defenses, and Evaluation15 Jul 2026
- 2026Skills That Don't Exist: A Large-Scale Study of Hallucinated Skill Recommendation in LLM Agents14 Jul 2026
- 2026Cross-Layer Misalignment Detection in Agent Skills: A Progressive Loading-Aware Contrastive Learning Approach12 Jul 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026Inside the Skill Market: From Software Engineering Activities to Reusable Agent Skills10 Jul 2026
- 2026An Empirical Study of Downstream Adaptation for Agent Skills3 Jul 2026
- 2026CONTRA: Red-Teaming Configurations of Personalizable Agents3 Jul 2026
- 2026Cloak and Detonate: Scanner Evasion and Dynamic Detection of Agent Skill Malware2 Jul 2026
- 2026SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces2 Jul 2026
- 2026From Anatomy to Smells: An Empirical Study of SKILL.md in Agent Skills1 Jul 2026
- 2026Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chains1 Jul 2026
50 newest of 105 All 105 (JSON)
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 113
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 72
- 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wildcited by 50
- 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystemscited by 45
- 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiencycited by 33
- 2026ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspacescited by 33
- 2026SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinementcited by 30
- 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threatscited by 29
- 2026SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agentscited by 25
- 2026Formal Analysis and Supply Chain Security for Agentic AI Skillscited by 25
- 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
12 most cited of 81 All 81 (JSON)
- 2026Encrypted Skills Can Become New Security Exploits If AI Agents Know How to Decipher13 Oct 2026
- 2026One Skill Too Many: How Co-Installed Skills Conflict in Coding Agents8 Oct 2026
- 2026An Empirical Study of Agent Skills' Downstream Utility6 Oct 2026
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiences6 Oct 2026
- 2026AgentSpy: Making AI Agent Behavior Observable5 Oct 2026
- 2026ActionGuard: Tool Call Authorization under Poisoned Skills30 Sep 2026
- 2026MMSkillRisk: Can Agents Stay Safe When Multimodal Skills Become Traps?28 Sep 2026
- 2026Stealth Apart, Harm Together: Skill Cascading Attacks on Skill-Based Agent Systems24 Sep 2026
- 2026Demystifying Agent Skills for Smart Contract Auditing: Design, Effectiveness, Behavioral Impact24 Sep 2026
- 2026SkillSecurer: Detecting and Patching Prompt-Injection Vulnerabilities in AI Agent Skills12 Sep 2026
- 2026SkillAtlas: An Attack Trace Library for Agent Skills11 Sep 2026
- 2026Scientific Agent Skills: A Library of Procedural Knowledge for Research Agents30 Aug 2026
12 newest of 81 All 81 (JSON)
- 2026MalSkills: Detecting Malicious Skills in the Agentic Supply Chain via Neuro-symbolic Reasoningcited by 5
- 2026Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMscited by 0
- 2026Learning to Decide, Not to Reason: Parameter-Efficient Decision Operators via Low-Rank Activation Steeringcited by 0
- 2026Learning to Decide, Not to Reason: Parameter-Efficient Decision Operators via Low-Rank Activation Steering3 Oct 2026
- 2026Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs17 Apr 2026
- 2026MalSkills: Detecting Malicious Skills in the Agentic Supply Chain via Neuro-symbolic Reasoning28 Mar 2026
- 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 53
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registrycited by 12
- 2026Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystemcited by 11
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skillscited by 7
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplacescited by 2
- 2026Constitutional Spec-Driven Development: Enforcing Security by Construction in AI-Assisted Code Generationcited by 1
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Networkcited by 1
- 2026Inside the Skill Market: From Software Engineering Activities to Reusable Agent Skillscited by 1
- 2026Versioned Transitive Dependency-Closure Binding and Operation-Time Effect Governance for Agent Skills: ClosureBoundcited by 1
- 2026Safe Skill Retirement for Physical Agentscited by 1
- 2026SearchSkill: Teaching LLMs to Use Search Tools with Evolving Skill Bankscited by 0
12 most cited of 20 All 20 (JSON)
- 2026CoRedSkill: Stealthy Skill Composition Attacks via AST-Guided Injection14 Oct 2026
- 2026Beyond Maliciousness: Static and Runtime Attack-Surface Profiling of Agent Skills13 Oct 2026
- 2026Runaway Reaction: When Benign Skills Compose into Malicious Behavior5 Oct 2026
- 2026After the Party: Growth, Governance, and Security Scanning in the OpenClaw Agent Skill Ecosystem15 Sep 2026
- 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctness5 Sep 2026
- 2026Versioned Transitive Dependency-Closure Binding and Operation-Time Effect Governance for Agent Skills: ClosureBound5 Sep 2026
- 2026Defense-as-Skill: Evolving Runtime Guard Skill for Skill-Augmented Agents1 Sep 2026
- 2026Safe Skill Retirement for Physical Agents25 Aug 2026
- 2026TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generation18 Aug 2026
- 2026VCE-Skill: Enhancing Skill Self-Evolution with Version-Change Experience17 Aug 2026
- 2026Inside the Skill Market: From Software Engineering Activities to Reusable Agent Skills10 Jul 2026
- 2026SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces2 Jul 2026
12 newest of 20 All 20 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Towards a Risk Assessment of Malicious Skill Files in Coding Agents
- 2026SkillsMetric: Mapping the Detection Boundary of Static Analysis for Malicious Agent Skills
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks
- 2026Behavioral Integrity Verification for AI Agent Skills
- 2026Technical Report: Exploring the Emerging Threats of the Agent Skill Ecosystem
- 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systems
- 2026Benchmarking Security Risk Detection and Verification in Open Agentic Skill Ecosystems
- 2026Can Agents Trust Their Skills? Uncovering Unsafe Chains of Trust in Skill-Based LLM Agents