"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
LLM-based coding agents increasingly rely on third-party extensions called skills, which bundle natural language instructions and helper scripts that execute with full user privileges. Community registries have emerged to distribute these skills, but the security implications remain unstudied due to the absence of labeled threat data. This paper presents a systematic security analysis of 98,380 skills collected from two major registries. Through a combination of static pattern matching and dynamic behavioral verification, we identify 157 skills exhibiting confirmed malicious behavior, encompassing 632 distinct vulnerabilities across 13 attack techniques. Our analysis reveals that these threats are deliberate rather than accidental: each malicious skill contains an average of 4.03 vulnerabilities spanning multiple attack phases. We identify two dominant attack strategies with statistically significant negative correlation -- credential theft via remote code execution, and agent manipulation through adversarial instructions embedded in documentation. Over half of all confirmed cases originate from a single threat actor employing templated brand impersonation at scale. We further observe that attack sophistication correlates with concealment investment, with advanced skills universally employing undocumented capabilities while also exploiting platform-native trust mechanisms. Following responsible disclosure, registry maintainers removed all 157 (100%) of the reported skills. Our dataset and detection pipeline are publicly available to facilitate future research on securing LLM agent ecosystems.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 11 of its 36 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
11 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale15 Jan
- 2025Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections30 Oct
Other references · 9
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 457
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
- 2019Small World with High Risks: A Study of Security Threats in the npm Ecosystemcited by 36
- 2023An Empirical Study of Malicious Code In PyPI Ecosystemcited by 18
- 2025A Study on Malicious Browser Extensions in 2025cited by 3
Built on by
Citing papers per year: 2026: 46.
46 papers.
Sort:
By area:
- 2026Organizing, Orchestrating, and Benchmarking Agent Skills at Ecosystem Scalecited by 65
- 2026SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinementcited by 24
- 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
- 2026MalTool: Malicious Tool Attacks on LLM Agentscited by 17
- 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystemscited by 14
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysiscited by 11
- 2026Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystemcited by 10
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registrycited by 10
- 2026HarmfulSkillBench: How Do Harmful Skills Weaponize Your Agents?cited by 9
- 2026A Systematic Survey of Security Threats and Defenses in LLM-Based AI Agents: A Layered Attack Surface Frameworkcited by 9
- 2026AgentTrap: Measuring Runtime Trust Failures in Third-Party Agent Skillscited by 9
- 2026Benign in Isolation, Harmful in Composition: Security Risks in Agent Skill Ecosystemscited by 9
34 more
- 2026Poise: Position-Aware One-Instruction Skill Injection for Silent Execution on LLM Agentscited by 7
- 2026RouteGuard: Internal-Signal Detection of Skill Poisoning in LLM Agentscited by 6
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skillscited by 6
- 2026Behavioral Integrity Verification for AI Agent Skillscited by 6
- 2026Cloak and Detonate: Scanner Evasion and Dynamic Detection of Agent Skill Malwarecited by 6
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026MalSkills: Detecting Malicious Skills in the Agentic Supply Chain via Neuro-symbolic Reasoningcited by 5
- 2026SafeClaw-R: Towards Safe and Secure Multi-Agent Personal Assistantscited by 5
- 2026No Attack Required: Semantic Fuzzing for Specification Violations in Agent Skillscited by 5
- 2026Exploiting LLM Agent Supply Chains via Payload-less Skillscited by 5
- 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMscited by 4
- 2026Trust Me, Import This: Dependency Steering Attacks via Malicious Agent Skillscited by 4
- 2026SkillGuard: A Permission-Centric Framework for Agent Skill Securitycited by 4
- 2026Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chainscited by 3
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Webcited by 2
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystemscited by 2
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Networkcited by 1
- 2026EVOMAL: Self-Poisoning in Self-Evolving Coding Agentscited by 1
- 2026Pomona: Continuous Code Quality Improvement via Small, Agentic Pull Requests at Bloombergcited by 0
- 2026The Decomposition Is the Fingerprint: Per-Component Identity for Agent Skillscited by 0
- 2026ALIBI: Adaptive Agentic Attacks on LLM-Based Vulnerability Detectors via Adversarial Code Commentscited by 0
- 2026Skillsets on the Chain: A Blockchain-based Zero-Trust Framework for Agentic AI Networkingcited by 0
- 2026SkillSentry: Adaptive Honey Worlds for Dynamic Safety Testing of Agent Skillscited by 0
- 2026SkillTrace: Multi-Trace Provenance Auditing for LLM-Agent Skill Reusecited by 0
- 2026Compositional Threat Analysis of Latent Compromise in LLM Agent Systems: The Order 66 Scenariocited by 0
- 2026TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generationcited by 0
- 2026SkillSecurer: Detecting and Patching Prompt-Injection Vulnerabilities in AI Agent Skillscited by 0
- 2026Progressive Skill Discovery as Access Control for Tool-Using LLM Agents: Structural Governance through Role-Scoped Capability Deliverycited by 0
- 2026SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMscited by 0
- 2026Can Agents Trust Their Skills? Uncovering Unsafe Chains of Trust in Skill-Based LLM Agentscited by 0
- 2026ActionGuard: Tool Call Authorization under Poisoned Skillscited by 0
- 2026Pretext: Defeating Malicious Skill Detection Frameworks for AI Agentscited by 0
- 2026K-Dense BYOK: An Open-Source AI Research Assistant That Runs Locally and Keeps a Hash-Chained Lab Notebookcited by 0
- 2026Chaining Skills to Hijack LLM Agentscited by 0
- 2026Chaining Skills to Hijack LLM Agents1 Oct 2026
- 2026Pretext: Defeating Malicious Skill Detection Frameworks for AI Agents30 Sep 2026
- 2026ActionGuard: Tool Call Authorization under Poisoned Skills30 Sep 2026
- 2026Can Agents Trust Their Skills? Uncovering Unsafe Chains of Trust in Skill-Based LLM Agents30 Sep 2026
- 2026SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs29 Sep 2026
- 2026Progressive Skill Discovery as Access Control for Tool-Using LLM Agents: Structural Governance through Role-Scoped Capability Delivery23 Sep 2026
- 2026SkillSecurer: Detecting and Patching Prompt-Injection Vulnerabilities in AI Agent Skills12 Sep 2026
- 2026K-Dense BYOK: An Open-Source AI Research Assistant That Runs Locally and Keeps a Hash-Chained Lab Notebook4 Sep 2026
- 2026EVOMAL: Self-Poisoning in Self-Evolving Coding Agents26 Aug 2026
- 2026TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generation18 Aug 2026
- 2026Compositional Threat Analysis of Latent Compromise in LLM Agent Systems: The Order 66 Scenario8 Aug 2026
- 2026SkillTrace: Multi-Trace Provenance Auditing for LLM-Agent Skill Reuse5 Aug 2026
34 more
- 2026SkillSentry: Adaptive Honey Worlds for Dynamic Safety Testing of Agent Skills4 Aug 2026
- 2026Skillsets on the Chain: A Blockchain-based Zero-Trust Framework for Agentic AI Networking31 Jul 2026
- 2026ALIBI: Adaptive Agentic Attacks on LLM-Based Vulnerability Detectors via Adversarial Code Comments27 Jul 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026Cloak and Detonate: Scanner Evasion and Dynamic Detection of Agent Skill Malware2 Jul 2026
- 2026Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chains1 Jul 2026
- 2026The Decomposition Is the Fingerprint: Per-Component Identity for Agent Skills30 Jun 2026
- 2026Benign in Isolation, Harmful in Composition: Security Risks in Agent Skill Ecosystems13 Jun 2026
- 2026Poise: Position-Aware One-Instruction Skill Injection for Silent Execution on LLM Agents6 Jun 2026
- 2026Pomona: Continuous Code Quality Improvement via Small, Agentic Pull Requests at Bloomberg4 Jun 2026
- 2026SkillGuard: A Permission-Centric Framework for Agent Skill Security2 Jun 2026
- 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystems30 May 2026
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Network25 May 2026
- 2026Exploiting LLM Agent Supply Chains via Payload-less Skills14 May 2026
- 2026AgentTrap: Measuring Runtime Trust Failures in Third-Party Agent Skills13 May 2026
- 2026No Attack Required: Semantic Fuzzing for Specification Violations in Agent Skills13 May 2026
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems12 May 2026
- 2026Behavioral Integrity Verification for AI Agent Skills12 May 2026
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registry12 May 2026
- 2026Trust Me, Import This: Dependency Steering Attacks via Malicious Agent Skills10 May 2026
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skills28 Apr 2026
- 2026A Systematic Survey of Security Threats and Defenses in LLM-Based AI Agents: A Layered Attack Surface Framework25 Apr 2026
- 2026RouteGuard: Internal-Signal Detection of Skill Poisoning in LLM Agents24 Apr 2026
- 2026HarmfulSkillBench: How Do Harmful Skills Weaponize Your Agents?16 Apr 2026
- 2026SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinement5 Apr 2026
- 2026Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMs4 Apr 2026
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysis3 Apr 2026
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Web30 Mar 2026
- 2026SafeClaw-R: Towards Safe and Secure Multi-Agent Personal Assistants28 Mar 2026
- 2026MalSkills: Detecting Malicious Skills in the Agentic Supply Chain via Neuro-symbolic Reasoning28 Mar 2026
- 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaboration22 Mar 2026
- 2026Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystem17 Mar 2026
- 2026Organizing, Orchestrating, and Benchmarking Agent Skills at Ecosystem Scale2 Mar 2026
- 2026MalTool: Malicious Tool Attacks on LLM Agents12 Feb 2026
- 2026Organizing, Orchestrating, and Benchmarking Agent Skills at Ecosystem Scalecited by 65
- 2026SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinementcited by 24
- 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
- 2026MalTool: Malicious Tool Attacks on LLM Agentscited by 17
- 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystemscited by 14
- 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysiscited by 11
- 2026HarmfulSkillBench: How Do Harmful Skills Weaponize Your Agents?cited by 9
- 2026A Systematic Survey of Security Threats and Defenses in LLM-Based AI Agents: A Layered Attack Surface Frameworkcited by 9
- 2026AgentTrap: Measuring Runtime Trust Failures in Third-Party Agent Skillscited by 9
- 2026Benign in Isolation, Harmful in Composition: Security Risks in Agent Skill Ecosystemscited by 9
- 2026Poise: Position-Aware One-Instruction Skill Injection for Silent Execution on LLM Agentscited by 7
- 2026RouteGuard: Internal-Signal Detection of Skill Poisoning in LLM Agentscited by 6
12 most cited of 38 All 38 (JSON)
- 2026Chaining Skills to Hijack LLM Agents1 Oct 2026
- 2026Pretext: Defeating Malicious Skill Detection Frameworks for AI Agents30 Sep 2026
- 2026ActionGuard: Tool Call Authorization under Poisoned Skills30 Sep 2026
- 2026Can Agents Trust Their Skills? Uncovering Unsafe Chains of Trust in Skill-Based LLM Agents30 Sep 2026
- 2026SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs29 Sep 2026
- 2026Progressive Skill Discovery as Access Control for Tool-Using LLM Agents: Structural Governance through Role-Scoped Capability Delivery23 Sep 2026
- 2026SkillSecurer: Detecting and Patching Prompt-Injection Vulnerabilities in AI Agent Skills12 Sep 2026
- 2026EVOMAL: Self-Poisoning in Self-Evolving Coding Agents26 Aug 2026
- 2026Compositional Threat Analysis of Latent Compromise in LLM Agent Systems: The Order 66 Scenario8 Aug 2026
- 2026SkillTrace: Multi-Trace Provenance Auditing for LLM-Agent Skill Reuse5 Aug 2026
- 2026SkillSentry: Adaptive Honey Worlds for Dynamic Safety Testing of Agent Skills4 Aug 2026
- 2026Skillsets on the Chain: A Blockchain-based Zero-Trust Framework for Agentic AI Networking31 Jul 2026
12 newest of 38 All 38 (JSON)
- 2026Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystemcited by 10
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registrycited by 10
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skillscited by 6
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Networkcited by 1
- 2026The Decomposition Is the Fingerprint: Per-Component Identity for Agent Skillscited by 0
- 2026TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generationcited by 0
- 2026K-Dense BYOK: An Open-Source AI Research Assistant That Runs Locally and Keeps a Hash-Chained Lab Notebookcited by 0
- 2026K-Dense BYOK: An Open-Source AI Research Assistant That Runs Locally and Keeps a Hash-Chained Lab Notebook4 Sep 2026
- 2026TRUSS: Towards Task-Reliable and User-Safe Automated Agent Skill Generation18 Aug 2026
- 2026The Decomposition Is the Fingerprint: Per-Component Identity for Agent Skills30 Jun 2026
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Network25 May 2026
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registry12 May 2026
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skills28 Apr 2026
- 2026Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystem17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Towards a Risk Assessment of Malicious Skill Files in Coding Agents
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks
- 2026SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents
- 2026SkillsMetric: Mapping the Detection Boundary of Static Analysis for Malicious Agent Skills
- 2026Black-Box Skill Stealing Attack from Proprietary LLM Agents: An Empirical Study
- 2026PhantomSkill: Malicious Code Injection in Agent Skill Ecosystems
- 2026MaliciousSkillBench: A Comprehensive Benchmark for Malicious Agent Skill Detection
- 2026MalSkillBench: A Runtime-Verified Benchmark of Malicious Agent Skills