Doc2Agent: Scalable Generation of Tool-Using Agents from API Documentation
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
REST APIs play important roles in enriching the action space of web agents, yet most API-based agents rely on curated and uniform toolsets that do not reflect the complexity of real-world APIs. Building tool-using agents for arbitrary domains remains a major challenge, as it requires reading unstructured API documentation, testing APIs and inferring correct parameters. We propose Doc2Agent, a scalable pipeline to build agents that can call Python-based tools generated from API documentation. Doc2Agent generates executable tools from API documentations and iteratively refines them using a code agent. We evaluate our approach on real-world APIs, WebArena APIs, and research APIs, producing validated tools. We achieved a 55% relative performance improvement with 90% lower cost compared to direct API calling on WebArena benchmark. A domain-specific agent built for glycomaterial science further demonstrates the pipeline's adaptability to complex, knowledge-rich tasks. Doc2Agent offers a generalizable solution for building tool agents from unstructured API documentation at scale.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 58 references that are in the map. First posted on arXiv 24 Jun 2025.
Builds on
29 of 58 references.
Closest ancestors · 2
Same direction, newest first
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents26 Jul
- 2024Executable Code Actions Elicit Better LLM Agents1 Feb
Other references · 27
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
- 2024Tool Learning with Large Language Models: A Surveycited by 223
- 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2025Survey on Evaluation of LLM-based Agentscited by 204
15 more
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 149
- 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 135
- 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agentscited by 133
- 2024AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Callscited by 124
- 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 92
- 2024Beyond Browsing: API-Based Web Agentscited by 78
- 2023SteP: Stacked LLM Policies for Web Actionscited by 66
- 2024Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agentscited by 56
- 2023A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challengecited by 55
- 2025ComplexFuncBench: Exploring Multi-Step and Constrained Function Calling under Long-Context Scenariocited by 55
- 2023Automating the Generation of Prompts for LLM-based Action Choice in PDDL Planningcited by 24
- 2025The Hidden Dangers of Browsing AI Agentscited by 11
- 2023Microservice API Evolution in Practice: A Study on Strategies and Challengescited by 7
- 2025CallNavi, A Challenge and Empirical Study on LLM Function Calling and Routingcited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025WALT: Web Agents that Learn Toolscited by 16
- 2026Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actionscited by 1
- 2026Making OpenAPI Documentation Agent-Ready: Detecting Documentation and REST Smells with a Multi-Agent LLM Systemcited by 0
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systemscited by 0
- 2026A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolutioncited by 0
- 2026A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution11 Oct 2026
- 2026Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actions6 Sep 2026
- 2026Making OpenAPI Documentation Agent-Ready: Detecting Documentation and REST Smells with a Multi-Agent LLM System14 May 2026
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systems16 Apr 2026
- 2025WALT: Web Agents that Learn Tools1 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025In-N-Out: A Parameter-Level API Graph Dataset for Tool Agents
- 2026SW-A2-Bench: Benchmarking Autonomous Software Agent Generation for Agentic Web
- 2025A Framework for Testing and Adapting REST APIs as LLM Tools
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges
- 2025DocAgent: A Multi-Agent System for Automated Code Documentation Generation
- 2025TheMCPCompany: Creating General-purpose Agents with Task-specific Tools
- 2026ToolRosella: Translating Code Repositories into Standardized Tools for Scientific Agents
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents