mlsanityData to 7 Oct 2026

Red Skills or Blue Skills? A Dive Into Skills Published on ClawHub

arXiv 2604.13064 ↗First posted 19 Mar 2026cs.CL cs.CYcited by 5

Not on the map. Why?

Abstract (arXiv)

Skill ecosystems have emerged as an increasingly important layer in Large Language Model (LLM) agent systems, enabling reusable task packaging, public distribution, and community-driven capability sharing. However, despite their rapid growth, the functionality, ecosystem structure, and security risks of public skill registries remain underexplored. In this paper, we present an empirical study of ClawHub, a large public registry of agent skills. We build and normalize a dataset of 26,502 skills, and conduct a systematic analysis of their language distribution, functional organization, popularity, and security signals. Our clustering results show clear cross-lingual differences: English skills are more infrastructure-oriented and centered on technical capabilities such as APIs, automation, and memory, whereas Chinese skills are more application-oriented, with clearer scenario-driven clusters such as media generation, social content production, and finance-related services. We further find that more than 30% of all crawled skills are labeled as suspicious or malicious by available platform signals, while a substantial fraction of skills still lack complete safety observability. To study early risk assessment, we formulate submission-time skill risk prediction using only information available at publication time, and construct a balanced benchmark of 11,010 skills. Across 12 classifiers, the best Logistic Regression achieves a accuracy of 72.62% and an AUROC of 78.95%, with primary documentation emerging as the most informative submission-time signal. Our findings position public skill registries as both a key enabler of agent capability reuse and a new surface for ecosystem-scale security risk.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

29 of 42 references.

References · 29

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  4. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  7. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  8. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  9. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  10. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  11. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  12. 2023Tool Learning with Foundation Modelscited by 302
17 more
  1. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
  2. 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 276
  3. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
  4. 2024Tool Learning with Large Language Models: A Surveycited by 221
  5. 2024ToolACE: Winning the Points of LLM Function Callingcited by 204
  6. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
  7. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
  8. 2025Survey on Evaluation of LLM-based Agentscited by 190
  9. 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learningcited by 107
  10. 2025MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Serverscited by 101
  11. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 66
  12. 2024LLM With Tools: A Surveycited by 60
  13. 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
  14. 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 48
  15. 2025Survey of LLM Agent Communication with MCP: A Software Design Pattern Centric Reviewcited by 14
  16. 2023Evaluating ChatGPT as a Question Answering System: A Comprehensive Analysis and Comparison with Existing Modelscited by 11
  17. 2025MCP Bridge: A Lightweight, LLM-Agnostic RESTful Proxy for Model Context Protocol Serverscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.