Tulip Agent -- Enabling LLM-Based Agents to Solve Tasks Using Large Tool Libraries
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
We introduce tulip agent, an architecture for autonomous LLM-based agents with Create, Read, Update, and Delete access to a tool library containing a potentially large number of tools. In contrast to state-of-the-art implementations, tulip agent does not encode the descriptions of all available tools in the system prompt, which counts against the model's context window, or embed the entire prompt for retrieving suitable tools. Instead, the tulip agent can recursively search for suitable tools in its extensible tool library, implemented exemplarily as a vector store. The tulip agent architecture significantly reduces inference costs, allows using even large tool libraries, and enables the agent to adapt and extend its set of tools. We evaluate the architecture with several ablation studies in a mathematics context and demonstrate its generalizability with an application to robotics. A reference implementation and the benchmark are available at github.com/HRI-EU/tulip_agent.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 44 of its 49 references that are in the map. First posted on arXiv 31 Jul 2024.
Builds on
44 of 49 references.
Closest ancestors · 1
Same direction, newest first
Other references · 43
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
31 more
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
- 2022PAL: Program-aided Language Modelscited by 635
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
- 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 352
- 2023Language to Rewards for Robotic Skill Synthesiscited by 307
- 2023Tool Learning with Foundation Modelscited by 302
- 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 296
- 2023Large Language Models as Tool Makerscited by 293
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 285
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2023TidyBot: Personalized Robot Assistance with Large Language Modelscited by 219
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
- 2024Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8Bcited by 156
- 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learningcited by 153
- 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
- 2023Large Language Models for Robotics: A Surveycited by 132
- 2023ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Searchcited by 103
- 2023CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Modelscited by 90
- 2023Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidancecited by 85
- 2024Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarioscited by 85
- 2023ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planningcited by 77
- 2023ControlLLM: Augment Language Models with Tools by Searching on Graphscited by 59
- 2023SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledgecited by 49
- 2024Octopus v2: On-device language model for super agentcited by 45
- 2023CoPAL: Corrective Planning of Robot Actions with Large Language Modelscited by 39
- 2023LLM as OS, Agents as Apps: Envisioning AIOS, Agents and the AIOS-Agent Ecosystemcited by 35
- 2024Octopus: On-device language model for function calling of software APIscited by 26
- 2024LaMI: Large Language Models for Multi-Modal Human-Robot Interactioncited by 21
- 2024To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactionscited by 10
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 2.
7 papers.
- 2025Agentic Large Language Models, a surveycited by 105
- 2024EcoAct: Economic Agent Determines When to Register What Actioncited by 11
- 2024Towards Full Delegation: Designing Ideal Agentic Behaviors for Travel Planningcited by 7
- 2025A Grounded Memory System For Smart Personal Assistantscited by 5
- 2025Graph-Grounded LLMs: Leveraging Graphical Function Calling to Minimize LLM Hallucinationscited by 4
- 2026MistyPilot: An Agentic Fast-Slow Thinking LLM Framework for Misty Social Robotscited by 2
- 2026MistyPilot: Enabling Social-Robot Control through Multi-Agent LLM Skill Orchestrationcited by 0
- 2026MistyPilot: Enabling Social-Robot Control through Multi-Agent LLM Skill Orchestration16 Aug 2026
- 2026MistyPilot: An Agentic Fast-Slow Thinking LLM Framework for Misty Social Robots4 Mar 2026
- 2025A Grounded Memory System For Smart Personal Assistants9 May 2025
- 2025Agentic Large Language Models, a survey29 Mar 2025
- 2025Graph-Grounded LLMs: Leveraging Graphical Function Calling to Minimize LLM Hallucinations13 Mar 2025
- 2024Towards Full Delegation: Designing Ideal Agentic Behaviors for Travel Planning21 Nov 2024
- 2024EcoAct: Economic Agent Determines When to Register What Action3 Nov 2024
Similar, not cited
Close in wording, no citation either way
- 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration
- 2025MCP-Zero: Active Tool Discovery for Autonomous LLM Agents
- 2026HyperAgent: Planning and Acting over Tool-Schema Hypergraphs for Tool-Use LLM Agents
- 2026Are Tools All We Need? Unveiling the Tool-Use Tax in LLM Agents
- 2025Control Plane as a Tool: A Scalable Design Pattern for Agentic AI Systems
- 2025AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocol
- 2025ML-Tool-Bench: Tool-Augmented Planning for ML Tasks
- 2025AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Search