EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instruction
On the map: LLM agents and tool use → Tool learning and function calling
Abstract (arXiv)
To address intricate real-world tasks, there has been a rising interest in tool utilization in applications of large language models (LLMs). To develop LLM-based agents, it usually requires LLMs to understand many tool functions from different tool documentation. But these documentations could be diverse, redundant or incomplete, which immensely affects the capability of LLMs in using tools. To solve this, we introduce EASYTOOL, a framework transforming diverse and lengthy tool documentation into a unified and concise tool instruction for easier tool usage. EasyTool purifies essential information from extensive tool documentation of different sources, and elaborates a unified interface (i.e., tool instruction) to offer standardized tool descriptions and functionalities for LLM-based agents. Extensive experiments on multiple different tasks demonstrate that EasyTool can significantly reduce token consumption and improve the performance of tool utilization in real-world scenarios. Our code will be available at urlhttps://github.com/microsoft/JARVIS/ in the future.
Key facts. Cited by 153 papers in the map (data through 7 Oct 2026). Placed in Tool learning and function calling, one of 16 directions in LLM agents and tool use. Builds on 16 of its 39 references that are in the map. First posted on arXiv 11 Jan 2024.
Builds on
16 of 39 references.
Closest ancestors · 7
Same direction, newest first
- 2023Don't Fine-Tune, Decode: Syntax Error-Free Tool Use via Constrained Decoding10 Oct
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs31 Jul
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases8 Jun
- 2023Gorilla: Large Language Model Connected with Massive APIs24 May
- 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings19 May
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs14 Apr
- 2023Toolformer: Language Models Can Teach Themselves to Use Tools9 Feb
Other references · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 138
- 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 129
- 2023ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Searchcited by 103
- 2022Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Modelscited by 96
Built on by
Citing papers per year: 2024: 33; 2025: 65; 2026: 55.
153 papers.
Sort:
By area:
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
- 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
- 2024Tool Learning with Large Language Models: A Surveycited by 221
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
- 2025Prompt Injection Attack to Tool Selection in LLM Agentscited by 145
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
- 2025Agentic Large Language Models, a surveycited by 105
- 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 78
38 more
- 2024Beyond Browsing: API-Based Web Agentscited by 77
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 54
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 50
- 2024Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Toolscited by 47
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 47
- 2024From Exploration to Mastery: Enabling LLMs to Master Tools via Self-Driven Interactionscited by 46
- 2024Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agentscited by 39
- 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injectioncited by 39
- 2024TravelAgent: An AI Assistant for Personalized Travel Planningcited by 38
- 2024Benchmarking Agentic Workflow Generationcited by 36
- 2025ScaleMCP: Dynamic and Auto-Synchronizing Model Context Protocol Tools for LLM Agentscited by 36
- 2025GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modelingcited by 35
- 2024Foundation Models for Music: A Surveycited by 34
- 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Userscited by 32
- 2025A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrievalcited by 31
- 2024Exploring Autonomous Agents through the Lens of Large Language Models: A Reviewcited by 30
- 2024Speech-Copilot: Leveraging Large Language Models for Speech Processing via Task Decomposition, Modularization, and Program Generationcited by 27
- 2024Towards Completeness-Oriented Tool Retrieval for Large Language Modelscited by 26
- 2024Planning with Multi-Constraints via Collaborative Language Agentscited by 26
- 2024Toolshed: Scale Tool-Equipped Agents with Advanced RAG-Tool Fusion and Tool Knowledge Basescited by 23
- 2024Efficient and Scalable Estimation of Tool Representations in Vector Spacecited by 22
- 2025O2-Searcher: A Searching-based Agent Model for Open-Domain Open-Ended Question Answeringcited by 22
- 2025Advancing Tool-Augmented Large Language Models via Meta-Verification and Reflection Learningcited by 22
- 2025UItron: Foundational GUI Agent with Advanced Perception and Planningcited by 22
- 2026EvoTool: Self-Evolving Tool-Use Policy Optimization in LLM Agents via Blame-Aware Mutation and Diversity-Aware Selectioncited by 22
- 2024"A good pun is its own reword": Can Large Language Models Understand Puns?cited by 21
- 2025Beyond the Final Answer: Evaluating the Reasoning Trajectories of Tool-Augmented Agentscited by 20
- 2025The Lighthouse of Language: Enhancing LLM Agents via Critique-Guided Improvementcited by 19
- 2025CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarioscited by 19
- 2025Towards AI Search Paradigmcited by 19
- 2025ToolScope: Enhancing LLM Agent Tool Use through Tool Merging and Context-Aware Filteringcited by 19
- 2025ToolFuzz -- Automated Agent Tool Testingcited by 18
- 2024Enhancing Tool Retrieval with Iterative Feedback from Large Language Modelscited by 17
- 2025Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Trainingcited by 17
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applicationscited by 17
- 2025Divide-Then-Aggregate: An Efficient Tool Learning Method via Parallel Tool Invocationcited by 16
50 most cited of 153 All 153 (JSON)
- 2026Federated Agent Optimization1 Oct 2026
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses28 Sep 2026
- 2026FlexComp: One Model for Every Ratio in Context Compression10 Sep 2026
- 2026Implicit Manipulation for Skill Selection in LLM Agents with Semantic Matching2 Sep 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026Enrich-Retrieve-Rank: Scaling Capability Discovery Beyond In-Context Routing24 Aug 2026
- 2026LLM Agents Perform Controlled Experiments Using Simulation Models22 Aug 2026
- 2026Scientific Data Skills: Enabling Agent-Ready Scientific Data Services at Scale20 Aug 2026
- 2026DOCSCHISEL: Adaptive Tool Documentation Optimization Framework for LLM Agents10 Aug 2026
- 2026SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent7 Aug 2026
- 2026Towards Robust Tool Use in Agents via Experience-Driven Adaptive Guidance4 Aug 2026
- 2026Control Under Compression: Reliability Frontiers for Tool-Using Agents2 Aug 2026
38 more
- 2026SkillSight: Calibrating Generic Content Bias for Skill Retrieval21 Jul 2026
- 2026Orchestrating Power Grid Studies with Multi-Agent AI and MCP Servers14 Jul 2026
- 2026ToolAtlas: Learning Once, Reusing Everywhere with Tool-Side Memory13 Jul 2026
- 2026From Atomic Actions to Standard Operating Procedures: Iterative Tool Optimization for Self-Evolving LLM Agents8 Jul 2026
- 2026Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Use1 Jul 2026
- 2026From Registry to Repository: How AI Agent Skills Are Written, Adapted, and Maintained1 Jul 2026
- 2026A Single Rewrite Suffices: Empirical Lessons from Production Skill Description Optimization29 Jun 2026
- 2026Tool Use Enables Undetectable Steganography in Multi-Agent LLM Systems25 Jun 2026
- 2026DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understanding22 Jun 2026
- 2026MetaPS: Adaptive Programmatic Strategy Selection for Market Agents21 Jun 2026
- 2026SEAGym: An Evaluation Environment for Self-Evolving LLM Agents16 Jun 2026
- 2026Capability-Aligned Hierarchical Learning for Tool-Augmented LLMs8 Jun 2026
- 2026Self-evolving LLM agents with in-distribution Optimization5 Jun 2026
- 2026PyraMathBench: Evaluating and Improving Mathematical Capability in Large Language Models2 Jun 2026
- 2026Uncertainty-Aware Clarification in LLM Agents with Information Gain2 Jun 2026
- 2026Learning to Retrieve: Dual-Level Long-Term Memory for Text-to-SQL Agents30 May 2026
- 2026MoG: Mixture of Experts for Graph-based Retrieval-Augmented Generation29 May 2026
- 2026SkillsInjector: Dynamic Skill Context Construction for LLM Agents28 May 2026
- 2026ParaTool: Shifting Tool Representations from Context to Parameters28 May 2026
- 2026A Sober Look at Agentic Misalignment in Automated Workflows22 May 2026
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles21 May 2026
- 2026OpenEvoShield: Dual Non-Stationary Continual Defense for Open-World Multi-Agent System Attacks13 May 2026
- 2026SEIF: Self-Evolving Reinforcement Learning for Instruction Following8 May 2026
- 2026A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applications8 May 2026
- 2026NoisyCausal: A Benchmark for Evaluating Causal Reasoning Under Structured Noise5 May 2026
- 2026AgentVisor: Defending LLM Agents Against Prompt Injection via Semantic Virtualization27 Apr 2026
- 2026From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skills27 Apr 2026
- 2026AgentSearchBench: A Benchmark for AI Agent Search in the Wild24 Apr 2026
- 2026Tool Retrieval Bridge: Aligning Vague Instructions with Retriever Preferences via Bridge Model9 Apr 2026
- 2026Agentic Tool Use in Large Language Models1 Apr 2026
- 2026EvoTool: Self-Evolving Tool-Use Policy Optimization in LLM Agents via Blame-Aware Mutation and Diversity-Aware Selection5 Mar 2026
- 2026Learning to Rewrite Tool Descriptions for Reliable LLM-Agent Tool Use23 Feb 2026
- 2026MagicAgent: Towards Generalized Agent Planning22 Feb 2026
- 2026KLong: Training LLM Agent for Extremely Long-horizon Tasks19 Feb 2026
- 2026From Tool Orchestration to Code Execution: A Study of MCP Design Choices17 Feb 2026
- 2026OpaqueToolsBench: Learning Nuances of Tool Behavior Through Interaction16 Feb 2026
- 2026Picking the Right Specialist: Attentive Neural Process-based Selection of Task-Specialized Models as Tools for Agentic Healthcare Systems16 Feb 2026
- 2026Think Fast and Slow: Step-Level Cognitive Depth Adaptation for LLM Agents13 Feb 2026
50 newest of 153 All 153 (JSON)
- 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
- 2024Tool Learning with Large Language Models: A Surveycited by 221
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
- 2025Prompt Injection Attack to Tool Selection in LLM Agentscited by 145
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
- 2025Agentic Large Language Models, a surveycited by 105
- 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 78
- 2024Beyond Browsing: API-Based Web Agentscited by 77
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
- 2025A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasurescited by 54
12 most cited of 94 All 94 (JSON)
- 2026Federated Agent Optimization1 Oct 2026
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses28 Sep 2026
- 2026Implicit Manipulation for Skill Selection in LLM Agents with Semantic Matching2 Sep 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026LLM Agents Perform Controlled Experiments Using Simulation Models22 Aug 2026
- 2026DOCSCHISEL: Adaptive Tool Documentation Optimization Framework for LLM Agents10 Aug 2026
- 2026SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent7 Aug 2026
- 2026Control Under Compression: Reliability Frontiers for Tool-Using Agents2 Aug 2026
- 2026SkillSight: Calibrating Generic Content Bias for Skill Retrieval21 Jul 2026
- 2026Orchestrating Power Grid Studies with Multi-Agent AI and MCP Servers14 Jul 2026
- 2026ToolAtlas: Learning Once, Reusing Everywhere with Tool-Side Memory13 Jul 2026
- 2026From Atomic Actions to Standard Operating Procedures: Iterative Tool Optimization for Self-Evolving LLM Agents8 Jul 2026
12 newest of 94 All 94 (JSON)
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 47
- 2025Beyond the Final Answer: Evaluating the Reasoning Trajectories of Tool-Augmented Agentscited by 20
- 2025The Lighthouse of Language: Enhancing LLM Agents via Critique-Guided Improvementcited by 19
- 2025ToolFuzz -- Automated Agent Tool Testingcited by 18
- 2025Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Trainingcited by 17
- 2024Smurfs: Multi-Agent System using Context-Efficient DFSDT for Tool Planningcited by 12
- 2024A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Modelscited by 12
- 2025LENS: Multi-level Evaluation of Multimodal Reasoning with Large Language Modelscited by 7
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoningcited by 7
- 2026Think Fast and Slow: Step-Level Cognitive Depth Adaptation for LLM Agentscited by 5
12 most cited of 15 All 15 (JSON)
- 2026PyraMathBench: Evaluating and Improving Mathematical Capability in Large Language Models2 Jun 2026
- 2026NoisyCausal: A Benchmark for Evaluating Causal Reasoning Under Structured Noise5 May 2026
- 2026Think Fast and Slow: Step-Level Cognitive Depth Adaptation for LLM Agents13 Feb 2026
- 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoning22 Jan 2026
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
- 2025Beyond the Final Answer: Evaluating the Reasoning Trajectories of Tool-Augmented Agents3 Oct 2025
- 2025More Vulnerable than You Think: On the Stability of Tool-Integrated LLM Agents27 Jun 2025
- 2025Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Training25 Jun 2025
- 2025LENS: Multi-level Evaluation of Multimodal Reasoning with Large Language Models21 May 2025
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment22 Apr 2025
- 2025The Lighthouse of Language: Enhancing LLM Agents via Critique-Guided Improvement20 Mar 2025
- 2025ToolFuzz -- Automated Agent Tool Testing6 Mar 2025
12 newest of 15 All 15 (JSON)
- 2025Graph RAG-Tool Fusioncited by 15
- 2025Keyword search is all you need: Achieving RAG-Level Performance without vector databases using agentic tool usecited by 10
- 2025Talk to Right Specialists: Iterative Routing in Multi-agent Systems for Question Answeringcited by 6
- 2025Online-Optimized RAG for Tool Use and Function Callingcited by 2
- 2026MoG: Mixture of Experts for Graph-based Retrieval-Augmented Generationcited by 0
- 2026MoG: Mixture of Experts for Graph-based Retrieval-Augmented Generation29 May 2026
- 2025Keyword search is all you need: Achieving RAG-Level Performance without vector databases using agentic tool use19 Dec 2025
- 2025Online-Optimized RAG for Tool Use and Function Calling24 Sep 2025
- 2025Graph RAG-Tool Fusion11 Feb 2025
- 2025Talk to Right Specialists: Iterative Routing in Multi-agent Systems for Question Answering14 Jan 2025
- 2024Foundation Models for Music: A Surveycited by 34
- 2024Foundation Models for Music: A Survey26 Aug 2024
- 2026FlexComp: One Model for Every Ratio in Context Compression10 Sep 2026
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
- 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 50
- 2024Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Toolscited by 47
- 2024TravelAgent: An AI Assistant for Personalized Travel Planningcited by 38
- 2024Speech-Copilot: Leveraging Large Language Models for Speech Processing via Task Decomposition, Modularization, and Program Generationcited by 27
- 2024Towards Completeness-Oriented Tool Retrieval for Large Language Modelscited by 26
- 2025Advancing Tool-Augmented Large Language Models via Meta-Verification and Reflection Learningcited by 22
- 2024"A good pun is its own reword": Can Large Language Models Understand Puns?cited by 21
- 2025Towards AI Search Paradigmcited by 19
- 2024Enhancing Tool Retrieval with Iterative Feedback from Large Language Modelscited by 17
- 2025AutoLabs: Cognitive Multi-Agent Systems with Self-Correction for Autonomous Chemical Experimentationcited by 13
12 most cited of 35 All 35 (JSON)
- 2026Enrich-Retrieve-Rank: Scaling Capability Discovery Beyond In-Context Routing24 Aug 2026
- 2026Scientific Data Skills: Enabling Agent-Ready Scientific Data Services at Scale20 Aug 2026
- 2026Towards Robust Tool Use in Agents via Experience-Driven Adaptive Guidance4 Aug 2026
- 2026A Single Rewrite Suffices: Empirical Lessons from Production Skill Description Optimization29 Jun 2026
- 2026DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understanding22 Jun 2026
- 2026Learning to Retrieve: Dual-Level Long-Term Memory for Text-to-SQL Agents30 May 2026
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles21 May 2026
- 2026AgentSearchBench: A Benchmark for AI Agent Search in the Wild24 Apr 2026
- 2026Multi-Field Tool Retrieval5 Feb 2026
- 2025Experience-Evolving Multi-Turn Tool-Use Agent with Hybrid Episodic-Procedural Memory8 Dec 2025
- 2025Medication counseling with large language models: balancing flexibility and rigidity2 Dec 2025
- 2025Don't Adapt Small Language Models for Tools; Adapt Tool Schemas to the Models8 Oct 2025
12 newest of 35 All 35 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agents
- 2025AutoTool: Efficient Tool Selection for Large Language Model Agents
- 2024LLM With Tools: A Survey
- 2026ToolMenuBench: Benchmarking Tool-Menu Filtering Strategies for Reliable and Efficient LLM Agents
- 2026Harness Engineering in LLM Tool Use via Agent-Native Reusable Tool Primitives
- 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestration
- 2024Large Language Model-Based Agents for Software Engineering: A Survey
- 2025Tool Preferences in Agentic LLMs are Unreliable