mlsanityData to 14 Oct 2026

Skill-as-Pseudocode: Refactoring Skill Libraries to Pseudocode for LLM Agents

arXiv 2605.27955 ↗First posted 27 May 2026cs.PL cs.CLcited by 4

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Markdown skill libraries for LLM agents ship as free-form prose, forcing the agent to re-derive both the input schema and the concrete invocation syntax on every retrieval. This produces a "confused → re-retrieve → still confused" loop: the agent issues a partially-correct action, receives uninformative feedback, and re-retrieves the same prose. We propose Skill-as-Pseudocode (SaP), an automatic conversion of markdown skill libraries into typed pseudocode with deterministic quality control. From each cluster of similar procedural passages, SaP extracts a typed contract and filters it through a four-check deterministic verifier (coverage, binding, replacement, risk). Promoted contracts are inlined into a rewritten skill skeleton alongside restored action templates, giving the agent two complementary signals: a typed signature for what a skill does and a concrete template for how to invoke it. On the ALFWorld unseen split (134 games, gpt-4o-mini, three seeds), SaP wins 82/402 paired games versus 47/402 for the Graph-of-Skills (GoS) baseline (pooled McNemar p = 8.2 × 10-5), at -22.8 ± 6.4% input tokens and -14.5 ± 4.1% LLM calls per game. A bundle-component ablation attributes the gain to the pairing of typed contracts with concrete action templates: the contract alone falls below the prose baseline.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 35 of its 57 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

35 of 57 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026SkillOps: Managing LLM Agent Skill Libraries as Self-Maintaining Software Ecosystems13 May
  2. 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents7 May
  3. 2026GraSP: Graph-Structured Skill Compositions for LLM Agents20 Apr
  4. 2026Graph-of-Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills7 Apr
  5. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks13 Feb

Other references · 30

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2017On Calibration of Modern Neural Networkscited by 4,960
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2023Let's Verify Step by Stepcited by 3,789
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  7. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  8. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  9. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  10. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  11. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  12. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
18 more
  1. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  2. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  3. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  4. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  5. 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
  6. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  7. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
  8. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
  9. 2024Agent Workflow Memorycited by 383
  10. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
  11. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
  12. 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 135
  13. 2023Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidancecited by 86
  14. 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 61
  15. 2022Top-Down Synthesis for Library Learningcited by 58
  16. 2021Leveraging Language to Learn Program Abstractions and Search Heuristicscited by 45
  17. 2023Refactoring Programs Using Large Language Models with Few-Shot Examplescited by 28
  18. 2023Take a Break in the Middle: Investigating Subgoals towards Hierarchical Script Generationcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillFusion: Towards Reliable Multi-Skill Composition for LLM Agents
  2. 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
  3. 2026SkillDAG: Self-Evolving Typed Skill Graphs for LLM Skill Selection at Scale
  4. 2026SkCC: Portable and Secure Skill Compilation for Cross-Framework LLM Agents
  5. 2026SkillAlign: Aligning Skill Interfaces for LLM-based Agents
  6. 2026SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries
  7. 2026Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents
  8. 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories