ToolOmni: Enabling Open-World Tool Use via Agentic learning with Proactive Retrieval and Grounded Execution
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
Large Language Models (LLMs) enhance their problem-solving capability by utilizing external tools. However, in open-world scenarios with massive and evolving tool repositories, existing methods relying on static embedding retrieval or parameter memorization of tools struggle to align user intent with tool semantics or generalize to unseen tools, respectively, leading to suboptimal accuracy of open-world tool retrieval and execution. To address these, we present ToolOmni, a unified agentic framework that enables LLMs for open-world tool use by proactive retrieval and grounded execution within a reasoning loop. First, we construct a cold-start multi-turn interaction dataset to instill foundational agentic capabilities via Supervised Fine-Tuning (SFT). Then, we introduce open-world tool learning based on a Decoupled Multi-Objective GRPO algorithm, which simultaneously optimizes LLMs for both tool retrieval accuracy and execution efficacy in online environments. Extensive experiments demonstrate that ToolOmni achieves state-of-the-art performance both in retrieval and execution, surpassing strong baselines by a significant margin of +10.8% in end-to-end execution success rate, while exhibiting exceptional robustness and generalization capabilities.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 24 of its 38 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
24 of 38 references.
Closest ancestors · 2
Same direction, newest first
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 22
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2025ToolRL: Reward is All Tool Learning Needscited by 342
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
- 2024The Power of Noise: Redefining Retrieval for RAG Systemscited by 275
- 2025ZeroSearch: Incentivize the Search Capability of LLMs without Searchingcited by 203
- 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
10 more
- 2025SimpleTIR: End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoningcited by 145
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 89
- 2024ToolGen: Unified Tool Retrieval and Calling via Generationcited by 72
- 2025DeepAgent: A General Reasoning Agent with Scalable Toolsetscited by 69
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 50
- 2025KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Modelcited by 35
- 2025Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agentcited by 28
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
- 2024Improving Tool Retrieval by Leveraging Large Language Models for Query Generationcited by 11
- 2026LMEB: Long-horizon Memory Embedding Benchmarkcited by 6
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026ReCache: Efficient KV Cache Reuse and Compression for Tool-Augmented LLM Agentscited by 3
- 2026MagicSelector: Joint Optimization for Agent Tool Selection via Counterfactual Decomposition and Progressive Rerankingcited by 1
- 2026SkillGate: Training In-Policy Skill Selection in Long-Horizon Agentscited by 1
- 2026StudyBench: Can Self-Evolution Squeeze Textbooks for Olympiad Capability?cited by 0
- 2026Toolcompass: Guiding Tool Trialing, Not Suppressing Itcited by 0
- 2026ParaAgent: Reinforcing Parallel Acting in Open-World Tool Environmentscited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnessescited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses28 Sep 2026
- 2026ParaAgent: Reinforcing Parallel Acting in Open-World Tool Environments27 Sep 2026
- 2026Toolcompass: Guiding Tool Trialing, Not Suppressing It22 Sep 2026
- 2026StudyBench: Can Self-Evolution Squeeze Textbooks for Olympiad Capability?1 Sep 2026
- 2026ReCache: Efficient KV Cache Reuse and Compression for Tool-Augmented LLM Agents20 Aug 2026
- 2026SkillGate: Training In-Policy Skill Selection in Long-Horizon Agents19 Aug 2026
- 2026MagicSelector: Joint Optimization for Agent Tool Selection via Counterfactual Decomposition and Progressive Reranking20 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026SING: Synthetic Intention Graph for Scalable Active Tool Discovery in LLM Agents
- 2026Tools Are Not Islands: Set-Level Tool Retrieval for LLM Agents via Query-Conditioned Hyperedge Prediction
- 2026Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Use
- 2025GRETEL: A Goal-driven Retrieval and Execution-based Trial Framework for LLM Tool Selection Enhancing
- 2026OpaqueToolsBench: Learning Nuances of Tool Behavior Through Interaction
- 2026Agentic Tool Use in Large Language Models
- 2024Learning to Use Tools via Cooperative and Interactive Agents
- 2026ToolSearcher: Optimizing Tool Selection at Scale via Reinforcement Learning