SkillTrace: Multi-Trace Provenance Auditing for LLM-Agent Skill Reuse
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
LLM-agent ecosystems are rapidly growing around reusable skills: mixed-modality packages of metadata, natural-language instructions, code, tools, references, and operational workflows. As skills become marketplace artifacts, auditing their reuse is no longer the same problem as ordinary code clone detection. Existing detectors target single-modality source code or whole-package similarity, yet skill reuse evidence is distributed across authored text, implementation fragments, and operational structure. As a result, they can miss reuse that preserves only one part of a skill. We present SKILLTRACE, a multi-trace provenance auditing framework for LLM-agent skill reuse. SKILLTRACE extracts three provenance traces: Expression, Implementation, and Operational. It represents the Operational Trace as a Skill Operational Graph (SOG) that captures activation, procedure, and resource-flow structure. An LLM assists only the Operational-trace extraction, once at ingestion; at audit time SKILLTRACE compares cached traces deterministically, calibrates each trace against same-function strict negatives, and reports which trace supports a reuse decision. On SKILLTRACE-BENCH, with 820 transformed reuse positives over 100 marketplace anchors and 751 negative controls, SKILLTRACE achieves AUROC 0.938 and F1 0.898. A 36,446-skill wild audit further shows that trace-attributed evidence surfaces actionable reuse review queues beyond repository-level baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 10 of its 41 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
10 of 41 references.
Closest ancestors · 4
Same direction, newest first
- 2026SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agents18 May
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agents24 Feb
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward12 Feb
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionality8 Feb
Other references · 6
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scalecited by 94
- 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wildcited by 46
- 2025When MCP Servers Attack: Taxonomy, Feasibility, and Mitigationcited by 17
- 2026Evaluating Tool Cloning in Agentic-AI Ecosystemscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Latent Reuse in Agent Skills: Multi-modal Clone Detection at Ecosystem Scale
- 2026AgentTrails: Towards Trust and Reuse for Agentic Tasks
- 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agents
- 2026ClawTrace: Cost-Aware Tracing for LLM Agent Skill Distillation
- 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
- 2026Skill Drift Is Contract Violation: Proactive Maintenance for LLM Agent Skill Libraries
- 2026SkillScriptBench: Benchmarking Self-Evolution of Executable Agent Skill Packages Beyond Markdown
- 2026Counterfactual Trace Auditing of LLM Agent Skills