Cloak and Detonate: Scanner Evasion and Dynamic Detection of Agent Skill Malware
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
LLM coding agents increasingly rely on third-party agent skills from public marketplaces, which execute with the agent's privileges and create a software supply-chain attack surface: a malicious skill can steal credentials, exfiltrate source code, or install backdoors. Existing defenses use static skill scanners based on pattern matching or LLM-as-judge analysis, but it remains unclear whether they withstand adaptive evasions that preserve malicious behavior while changing payload appearance. This paper first presents an adversarial study of existing skill scanners through SkillCloak, a payload-preserving evasion framework that keeps the attack semantics intact while transforming their visible form. SkillCloak uses two complementary strategies: Structural Obfuscation, which rewrites visible payload indicators into semantically equivalent forms, and Self-Extracting Skill (SFS) Packing, which hides malicious components from the install-time view and restores them during agent execution. Across eight scanners and 1,613 in-the-wild malicious skills, SFS Packing bypasses every scanner at over 90%, while Structural Obfuscation bypasses over 80% on most static scanners and reaches 96% on a hybrid scanner, showing that appearance-based auditing is insufficient. Motivated by this finding, we propose SkillDetonate, a behavior-centric runtime auditor that executes skills in a sandbox and detects malicious effects through OS-boundary information-flow evidence rather than install-time appearance. SkillDetonate combines on-demand closure lift, which observes instructions materialized during execution, with marker-based taint analysis, which tracks sensitive-data flows across the agent context, files, processes, and network operations. The results show that SkillDetonate detects 97% of attacks at a 2% false-positive rate and sustains 87% detection on real-world malicious skills.
Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 33 of its 65 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
33 of 65 references.
Closest ancestors · 19
Same direction, newest first
- 2026PhantomSkill: Malicious Code Injection in Agent Skill Ecosystems17 Jun
- 2026MalSkillBench: A Runtime-Verified Benchmark of Malicious Agent Skills5 Jun
- 2026CASCADE: A Component Ablation and Corpus Audit of a Layered Local Defense for MCP-Based Systems18 Apr
- 2026SkillSieve: A Hierarchical Triage Framework for Detecting Malicious AI Agent Skills8 Apr
- 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystems3 Apr
- 2026How Your Credentials Are Leaked by LLM Agent Skills: An Empirical Study3 Apr
- 2026MalSkills: Detecting Malicious Skills in the Agentic Supply Chain via Neuro-symbolic Reasoning28 Mar
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks23 Feb
- 2026SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agents15 Feb
- 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild6 Feb
- 2026Taming Various Privilege Escalation in LLM-Based Agent Systems: A Mandatory Access Control Framework17 Jan
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale15 Jan
7 more
- 2025Taxonomy, Evaluation and Exploitation of IPI-Centric LLM Agent Defense Frameworks19 Nov
- 2025Progent: Securing AI Agents with Privilege Control16 Apr
- 2025Defeating Prompt Injections by Design24 Mar
- 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
- 2025RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage13 Feb
- 2024IsolateGPT: An Execution Isolation Architecture for LLM-Based Agentic Systems8 Mar
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
Other references · 14
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,274
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,417
- 2023GPT-Driver: Learning to Drive with GPTcited by 346
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 302
- 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 161
- 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judgecited by 142
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 123
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 120
- 2025Securing AI Agents with Information-Flow Controlcited by 115
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 69
- 2018Learning to Evade Static PE Machine Learning Malware Models via Reinforcement Learningcited by 61
- 2020Backstabber's Knife Collection: A Review of Open Source Software Supply Chain Attackscited by 60
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 4
- 2026Beware of Agentic Botnets: Scalable Untargeted Promptware Attacks via Universal and Transferable Adversarial HalluSquattingcited by 0
- 2026MaliciousSkillBench: A Comprehensive Benchmark for Malicious Agent Skill Detectioncited by 0
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Securitycited by 0
- 2026Versioned Transitive Dependency-Closure Binding and Operation-Time Effect Governance for Agent Skills: ClosureBoundcited by 0
- 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctnesscited by 0
- 2026Runaway Reaction: When Benign Skills Compose into Malicious Behaviorcited by 0
- 2026AgentSpy: Making AI Agent Behavior Observablecited by 0
- 2026AgentSpy: Making AI Agent Behavior Observable5 Oct 2026
- 2026Runaway Reaction: When Benign Skills Compose into Malicious Behavior5 Oct 2026
- 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctness5 Sep 2026
- 2026Versioned Transitive Dependency-Closure Binding and Operation-Time Effect Governance for Agent Skills: ClosureBound5 Sep 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026MaliciousSkillBench: A Comprehensive Benchmark for Malicious Agent Skill Detection20 Aug 2026
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scanners10 Aug 2026
- 2026Beware of Agentic Botnets: Scalable Untargeted Promptware Attacks via Universal and Transferable Adversarial HalluSquatting8 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Pretext: Defeating Malicious Skill Detection Frameworks for AI Agents
- 2026Seeing Is Not Screening: Multimodal Hidden Instruction Attacks on Agent Skill Scanners
- 2026SkillsMetric: Mapping the Detection Boundary of Static Analysis for Malicious Agent Skills
- 2026Detecting Malicious Agent Skills in the Wild using Attention
- 2026SkillGate: Cost Efficient Runtime Malicious Skill File Detection in Coding Agents
- 2026SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents
- 2026SkillShield: Prompt-Space Security Skills for LLM Coding Agents
- 2026Behavioral Skill Reconstruction: Reconstructing Hidden Functionality from LLM Agent Skills