Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agents
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Markdown skill libraries for LLM agents ship as free-form prose, forcing the agent to re-derive both the input schema and the concrete invocation syntax on every retrieval. This produces a "confused → re-retrieve → still confused" loop: the agent issues a partially-correct action, receives uninformative feedback, and re-retrieves the same prose. We propose Skill-as-Pseudocode (SaP), an automatic conversion of markdown skill libraries into typed pseudocode with deterministic quality control. From each cluster of similar procedural passages, SaP extracts a typed contract and filters it through a four-check deterministic verifier (coverage, binding, replacement, risk). Promoted contracts are inlined into a rewritten skill skeleton alongside restored action templates, giving the agent two complementary signals: a typed signature for what a skill does and a concrete template for how to invoke it. On the ALFWorld unseen split (134 games, gpt-4o-mini, three seeds), SaP wins 82/402 paired games versus 47/402 for the Graph-of-Skills (GoS) baseline (pooled McNemar p = 8.2 × 10-5), at -22.8 ± 6.4% input tokens and -14.5 ± 4.1% LLM calls per game. A bundle-component ablation attributes the gain to the pairing of typed contracts with concrete action templates: the contract alone falls below the prose baseline.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 35 of its 57 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
35 of 57 references.
Closest ancestors · 5
Same direction, newest first
- 2026SkillOps: Managing LLM Agent Skill Libraries as Self-Maintaining Software Ecosystems13 May
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents7 May
- 2026GraSP: Graph-Structured Skill Compositions for LLM Agents20 Apr
- 2026Graph-of-Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills7 Apr
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb
Other references · 30
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
18 more
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
- 2024Agent Workflow Memorycited by 383
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
- 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
- 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 135
- 2023Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidancecited by 86
- 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 61
- 2022Top-Down Synthesis for Library Learningcited by 58
- 2021Leveraging Language to Learn Program Abstractions and Search Heuristicscited by 45
- 2023Refactoring Programs Using Large Language Models with Few-Shot Examplescited by 28
- 2023Take a Break in the Middle: Investigating Subgoals towards Hierarchical Script Generationcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ResearchStudio-Reel: Automate the Last Mile of Research from Paper to Poster, Video, and Blogcited by 2
- 2026Binocular Gaze Estimation with Single Camera and Single Light Sourcecited by 0
- 2026Re-derivability Decides What a Staged Agent Pipeline Recovers After an Upstream Faultcited by 0
- 2026Learning from Research: Toward Lifelong Agent Harness Evolutioncited by 0
- 2026Learning from Research: Toward Lifelong Agent Harness Evolution30 Sep 2026
- 2026Re-derivability Decides What a Staged Agent Pipeline Recovers After an Upstream Fault26 Sep 2026
- 2026Binocular Gaze Estimation with Single Camera and Single Light Source6 Jul 2026
- 2026ResearchStudio-Reel: Automate the Last Mile of Research from Paper to Poster, Video, and Blog5 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026SkillFusion: Towards Reliable Multi-Skill Composition for LLM Agents
- 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
- 2026SkillDAG: Self-Evolving Typed Skill Graphs for LLM Skill Selection at Scale
- 2026SkCC: Portable and Secure Skill Compilation for Cross-Framework LLM Agents
- 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents
- 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries
- 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents
- 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories