Red Skills or Blue Skills? A Dive Into Skills Published on ClawHub
Not on the map. Why?
Abstract (arXiv)
Skill ecosystems have emerged as an increasingly important layer in Large Language Model (LLM) agent systems, enabling reusable task packaging, public distribution, and community-driven capability sharing. However, despite their rapid growth, the functionality, ecosystem structure, and security risks of public skill registries remain underexplored. In this paper, we present an empirical study of ClawHub, a large public registry of agent skills. We build and normalize a dataset of 26,502 skills, and conduct a systematic analysis of their language distribution, functional organization, popularity, and security signals. Our clustering results show clear cross-lingual differences: English skills are more infrastructure-oriented and centered on technical capabilities such as APIs, automation, and memory, whereas Chinese skills are more application-oriented, with clearer scenario-driven clusters such as media generation, social content production, and finance-related services. We further find that more than 30% of all crawled skills are labeled as suspicious or malicious by available platform signals, while a substantial fraction of skills still lack complete safety observability. To study early risk assessment, we formulate submission-time skill risk prediction using only information available at publication time, and construct a balanced benchmark of 11,010 skills. Across 12 classifiers, the best Logistic Regression achieves a accuracy of 72.62% and an AUROC of 78.95%, with primary documentation emerging as the most informative submission-time signal. Our findings position public skill registries as both a key enabler of agent capability reuse and a new surface for ecosystem-scale security risk.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
29 of 42 references.
References · 29
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2023Tool Learning with Foundation Modelscited by 302
17 more
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
- 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 276
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
- 2024Tool Learning with Large Language Models: A Surveycited by 221
- 2024ToolACE: Winning the Points of LLM Function Callingcited by 204
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
- 2025Survey on Evaluation of LLM-based Agentscited by 190
- 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learningcited by 107
- 2025MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Serverscited by 101
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 66
- 2024LLM With Tools: A Surveycited by 60
- 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
- 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 48
- 2025Survey of LLM Agent Communication with MCP: A Software Design Pattern Centric Reviewcited by 14
- 2023Evaluating ChatGPT as a Question Answering System: A Comprehensive Analysis and Comparison with Existing Modelscited by 11
- 2025MCP Bridge: A Lightweight, LLM-Agnostic RESTful Proxy for Model Context Protocol Serverscited by 8
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Skill Is Not Document: Query-Conditioned Compatibility for LLM Agent Skill Routingcited by 6
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Networkcited by 1
- 2026Adaptive Multi-Resolution Procedural Knowledge Compression for Large Language Modelscited by 1
- 2026CONTRA: Red-Teaming Configurations of Personalizable Agentscited by 0
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Securitycited by 0
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026CONTRA: Red-Teaming Configurations of Personalizable Agents3 Jul 2026
- 2026Adaptive Multi-Resolution Procedural Knowledge Compression for Large Language Models10 Jun 2026
- 2026Skill Is Not Document: Query-Conditioned Compatibility for LLM Agent Skill Routing2 Jun 2026
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Network25 May 2026