Skill Availability and Presentation Granularity in Large-Language-Model Agents: A Controlled SkillsBench Study
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Skill documents provide procedural knowledge to large-language-model agents at inference time. This article studies whether the presentation granularity of controlled skill knowledge changes downstream task success. The experiment uses a pinned SkillsBench version, a 30-task domain-balanced subset validated by official oracle runs, two reasoning-enabled model configurations, six skill conditions, and five trials per task-condition-model cell. Skill availability is the clearest empirical signal. Relative to no skill, skill conditions increase task-mean pass rate by 26.7 to 36.0 percentage points for GPT-5.5 and by 18.0 to 26.0 percentage points for DeepSeek V4-Flash. The final data contain 1,800 rows, with 900 rows for each model. The task is the inference unit. Five trials are aggregated within each task-condition-model cell before paired contrasts are estimated over 30 tasks. The primary presentation contrasts are smaller and uncertain. Low-abstraction guidance differs from high-abstraction guidance by +0.7 percentage points for GPT-5.5 and -6.7 percentage points for DeepSeek V4-Flash, with both 95% bootstrap confidence intervals crossing zero. Adding one worked example to medium-abstraction guidance differs from the no-example variant by +0.7 and +1.3 percentage points. Mean-reward robustness checks preserve the same substantive conclusion. In this controlled subset, skill availability is associated with higher success than no skill, while the tested presentation-granularity changes yield small, uncertain, and model-dependent effects.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 17 of its 23 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
17 of 23 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
4 more
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Compression, structure, and executor capability: a controlled real-cost decomposition of language-model agent skill optimisationcited by 0
- 2026Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agentscited by 0
- 2026Demystifying Agent Skills for Smart Contract Auditing: Design, Effectiveness, Behavioral Impactcited by 0
- 2026Demystifying Agent Skills for Smart Contract Auditing: Design, Effectiveness, Behavioral Impact24 Sep 2026
- 2026Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agents31 Aug 2026
- 2026Compression, structure, and executor capability: a controlled real-cost decomposition of language-model agent skill optimisation3 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026SkillJuror: Measuring How Agent Skill Organization Changes Runtime Behavior
- 2026Demystifying Agent Skills: Why They Work-Until They Don't
- 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents
- 2026Skill Use or Skill Theater? Evaluating the Reasoning Backroom in Skill-Augmented Language Agents
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward
- 2026Skill Following: Evaluating Actual Skill Use in Retrieval-Enabled LLM Agents
- 2026From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skills
- 2026Break It Down, Pass It On: Cross-Task Skill Transfer in LLM Agents