SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces
Not on the map. Why?
Abstract (arXiv)
Large Language Model (LLM)-based agents increasingly automate software engineering tasks through reusable skills, natural-language instruction documents that guide planning and execution. Open skill marketplaces enable users to assemble agents by co-activating community-contributed skills, but marketplace operators typically audit skills in isolation. As a result, individually benign skills may interact to redirect an agent toward unintended objectives, which we term implicit intents. Detecting such intents is challenging because the effect emerges only through skill composition, execution environments are often unavailable at admission time, and the space of possible co-activations grows exponentially with marketplace size. In this paper, we formulate implicit-intent discovery as a fuzzing problem over skill compositions, where skill compositions are the unit under test, planning artifacts expose agent intent before execution, and deviations from a skill-free baseline serve as a differential oracle. Based on this formulation, we propose skillfuzz, the first execution-free testing approach that extracts structured skill contracts and uses contract-guided Monte Carlo Tree Search to prioritize potentially conflicting compositions. Across representative skill-marketplace workloads, skillfuzz discovers over 1,000 distinct implicit intents under a fixed query budget, confirms more than 80% of the highest-risk flagged compositions during execution-time validation, and identifies substantially more high-severity implicit intents than alternative search strategies while exploring only a fraction of the pairwise interaction space they require.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 49 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
27 of 49 references.
References · 27
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 476
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 306
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 190
15 more
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 120
- 2025Agentic Large Language Models, a surveycited by 105
- 2022Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Modelscited by 102
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scalecited by 94
- 2023Fuzz4All: Universal Fuzzing with Large Language Modelscited by 88
- 2025PlanGenLLMs: A Modern Survey of LLM Planning Capabilitiescited by 82
- 2018The Art, Science, and Engineering of Fuzzing: A Surveycited by 61
- 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
- 2023WhiteFox: White-Box Compiler Fuzzing Empowered by Large Language Modelscited by 37
- 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
- 2026Lying with Truths: Open-Channel Multi-Agent Collusion for Belief Manipulation via Generative Montagecited by 17
- 2025Enhancing Robustness of LLM-Driven Multi-Agent Systems through Randomized Smoothingcited by 9
- 2025Tapas Are Free! Training-Free Adaptation of Programmatic Agents via LLM-Guided Program Synthesis in Dynamic Environmentscited by 9
- 2025Locus: Agentic Predicate Synthesis for Directed Fuzzingcited by 8
- 2025On Interaction Effects in Greybox Fuzzingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.