ToolRegistry: A Protocol-Agnostic Tool Management Library for Function-Calling LLMs
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Every LLM tool call is structurally an RPC -- a function name, JSON arguments, and a serialized result -- yet each protocol (native Python, MCP, OpenAPI, LangChain) is integrated from scratch. We present ToolRegistry, a system that makes this RPC nature explicit: a single Tool object acts as a universal stub regardless of transport, while the registry serves as the RPC client runtime for dispatch, schema generation, and execution. The system ships as three packages -- a core registry, a server exposing tools over MCP and OpenAPI, and a hub of production-ready implementations -- and invokes tools through pluggable thread or process backends. The system now also provides tag-based permission policies, BM25F-powered progressive tool disclosure for large registries, think-augmented function calling, multi-provider schema support (OpenAI, Anthropic, Gemini), declarative JSONC/YAML configuration, and a near-zero-dependency core built on stdlib-only vendored modules. In our benchmarks the library cuts integration code by 60-80%, and choosing the right concurrency mode (thread vs. process) yields up to 3.1x throughput over the alternative for a given workload. ToolRegistry is open-source at https://github.com/Oaklight/ToolRegistry; documentation lives at https://toolregistry.readthedocs.io/.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 13 of its 28 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
13 of 28 references.
Closest ancestors · 7
Same direction, newest first
- 2025Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models3 Mar
- 2024LLM With Tools: A Survey24 Sep
- 2024Tool Learning with Large Language Models: A Survey28 May
- 2024AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls6 Feb
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 6
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 352
- 2025A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)cited by 98
- 2025A Survey of AI Agent Protocolscited by 77
- 2025MCP Bridge: A Lightweight, LLM-Agnostic RESTful Proxy for Model Context Protocol Serverscited by 8
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
- 2025AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoningcited by 11
- 2026Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Usecited by 7
- 2025Agentic Services Computingcited by 6
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Use3 Mar 2026
- 2025AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning15 Dec 2025
- 2025Agentic Services Computing29 Sep 2025
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directions23 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Unified Tool Integration for LLMs: A Protocol-Agnostic Approach to Function Calling
- 2026The Bitter Lesson of Tool Calling
- 2026Harness Engineering in LLM Tool Use via Agent-Native Reusable Tool Primitives
- 2026Orchestral AI: A Framework for Agent Orchestration
- 2026OoO-Spec: Out-of-Order Semantic Speculation for Fast Tool Calling
- 2025ScaleMCP: Dynamic and Auto-Synchronizing Model Context Protocol Tools for LLM Agents
- 2025From REST to MCP: An Empirical Study of API Wrapping and Automated Server Generation for LLM Agents
- 2026DADL: A Declarative Description Language for Enterprise Tool Libraries in LLM Agent Systems