mlsanityData to 7 Oct 2026

When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystems

arXiv 2606.00448 ↗First posted 30 May 2026cs.SE cs.AI cs.CRcited by 14

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

LLM agents increasingly rely on community-contributed skills that expand an agent's operational capability set. We study a core safety problem in agentic AI systems: whether individually safe skills can compose into unsafe installed skill sets. We present SkillReact, a compositional security measurement framework with three components: a deterministic static-composition benchmark, a two-rater LLM-assisted human-adjudication pipeline, and an action-based exploitability harness. On 1,520 ClawHub skills, 651 pass individual inspection and form 211,575 pairs; the benchmark flags 22.25% of these as structural candidates. We treat this raw rate as a recall-oriented scanner ceiling and calibrate it against human judgment: in a pattern-stratified audit, roughly one in five flagged pair-pattern hits survives as a real compositional risk (population-weighted validity 18.2%, our headline result), implying about 14K genuine risk memberships in a single registry that per-skill scanning misses by construction, since every pair is individually safe. An action-based harness then probes when these candidates become model-issued tool calls, and finds realization gated by host-model disposition: on an anchor-conditioned dropper subset, Haiku-4-5 issues the dropper-stage tool call on all 39 direct-prompt trials (36 of them the full download-then-execute chain, 3 download-only), Opus-4-7 stops at the download, and Sonnet-4-6 refuses outright. A control that holds the request fixed and varies only the installed skills finds compliance highest with no skills installed: a composition fixes which capabilities are reachable, while the host model decides whether to use them. Together these motivate install-time compositional checks and capability isolation as complements to per-skill scanning.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 36 of its 55 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

36 of 55 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026SkillSieve: A Hierarchical Triage Framework for Detecting Malicious AI Agent Skills8 Apr
  2. 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystems3 Apr
  3. 2026How Your Credentials Are Leaked by LLM Agent Skills: An Empirical Study3 Apr
  4. 2026A Security Analysis of the OpenClaw AI Agent Framework29 Mar
  5. 2026Formal Analysis and Supply Chain Security for Agentic AI Skills27 Feb
  6. 2026SOK: A Taxonomy of Attack Vectors and Defense Strategies for Agentic Supply Chain Runtime23 Feb
  7. 2026SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agents15 Feb
  8. 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild6 Feb
  9. 2026Prompt Injection Attacks on Agentic Coding Assistants: A Systematic Analysis of Vulnerabilities in Skills, Tools, and Protocol Ecosystems24 Jan
  10. 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale15 Jan
  11. 2025Agent Tools Orchestration Leaks More: Dataset, Benchmark, and Mitigation18 Dec
  12. 2025MindGuard: Intrinsic Decision Inspection for Securing LLM Agents Against Metadata Poisoning28 Aug
7 more
  1. 2025LlamaFirewall: An open source guardrail system for building secure AI agents6 May
  2. 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
  3. 2025Progent: Securing AI Agents with Privilege Control16 Apr
  4. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
  5. 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection17 Feb
  6. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  7. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar

Other references · 17

  1. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  2. 2025DRP: Distilled Reasoning Pruning with Skill-aware Step Decomposition for Efficient Large Reasoning Modelscited by 29
  3. 2026BadSkill: Backdoor Attacks on Agent Skills via Model-in-Skill Poisoningcited by 25
  4. 2025Does Tone Change the Answer? Evaluating Prompt Politeness Effects on Modern LLMs: GPT, Gemini, and LLaMAcited by 23
  5. 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Modelscited by 20
  6. 2026Enhancing Financial Report Question-Answering: A Retrieval-Augmented Generation System with Reranking Analysiscited by 20
  7. 2025Learning How to Use Tools, Not Just When: Pattern-Aware Tool-Integrated Reasoningcited by 15
  8. 2026Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Modelscited by 15
  9. 2026Sustainable Hybrid Document-Routed Retrieval for Financial RAG: Resolving the Robustness-Precision Trade-offcited by 13
  10. 2026Reflect-Guard: Enhancing LLM Safeguards against Adversarial Prompts via Logical Self-Reflectioncited by 12
  11. 2026Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillationcited by 11
  12. 2026AI for Auto-Research: Roadmap & User Guidecited by 11
5 more
  1. 2026ChainCaps: Composition-Safe Tool-Using Agents via Monotonic Capability Attenuationcited by 11
  2. 2025Reward Auditor: Inference on Reward Modeling Suitability in Real-World Perturbed Scenarioscited by 7
  3. 2025Alleviating Attention Hacking in Discriminative Reward Modeling through Interaction Distillationcited by 5
  4. 2026Safety is Non-Compositional: A Formal Framework for Capability-Based AI Systemscited by 4
  5. 2026From Component Manipulation to System Compromise: Understanding and Detecting Malicious MCP Serverscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfaces
  2. 2026OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills
  3. 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents
  4. 2026SkillHarm: Lifecycle-Aware Skill-Based Attacks via Automated Construction
  5. 2026Benign in Isolation, Harmful in Composition: Security Risks in Agent Skill Ecosystems
  6. 2026Can Agents Trust Their Skills? Uncovering Unsafe Chains of Trust in Skill-Based LLM Agents
  7. 2026SkillVetBench: LLM-as-Judge for Multi-Dimensional Security Risk Evaluation in Open-Source LLM Agent Skills
  8. 2026STARS: Skill-Triggered Audit for Request-Conditioned Invocation Safety in Agent Systems