MetaAgent: Toward Self-Evolving Agent via Tool Meta-Learning
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
In this work, we propose MetaAgent, an agentic paradigm inspired by the principle of learning-by-doing, where expertise is developed through hands-on practice and continual self-improvement. MetaAgent starts with a minimal workflow, equipped only with basic reasoning and adaptive help-seeking abilities. When a knowledge gap is encountered, MetaAgent generates natural language help requests, which are routed to the most suitable external tool by a dedicated tool router. As MetaAgent solves tasks, it continually conducts self-reflection and answer verification, distilling actionable experience into concise texts that are dynamically incorporated into future task contexts. Besides, MetaAgent autonomously builds in-house tools and a persistent knowledge base by organizing its tool-use history, further enhancing its ability to retrieve and integrate relevant information We term this continual, data-driven process as textitmeta tool learning, through which MetaAgent incrementally refines its reasoning and tool-use strategies, without changing model parameters or requiring further post-training. Evaluated on challenging knowledge discovery benchmarks, including GAIA, WebWalkerQA, and BrowseCamp, MetaAgent consistently outperforms workflow-based baselines and matches or exceeds end-to-end trained agents, demonstrating the promise of self-evolving agentic systems for robust, general-purpose knowledge discovery. We provide our source codes in https://github.com/qhjqhj00/MetaAgent.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 29 of its 36 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
29 of 36 references.
Closest ancestors · 1
Same direction, newest first
Other references · 28
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023A Survey of Large Language Modelscited by 2,576
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2025Humanity's Last Examcited by 491
16 more
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2025Acting Less is Reasoning More! Teaching Model to Act Efficientlycited by 80
- 2025Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learningcited by 72
- 2025Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learningcited by 70
- 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 66
- 2025Chain-of-Retrieval Augmented Generationcited by 49
- 2025An Empirical Study on Reinforcement Learning for Reasoning-Search Interleaved LLM Agentscited by 46
- 2025Coding Agents with Multimodal Browsing are Generalist Problem Solverscited by 25
- 2024Agentic Information Retrievalcited by 21
- 2025Towards AI Search Paradigmcited by 19
- 2025HawkBench: Investigating Resilience of RAG Methods on Stratified Information-Seeking Taskscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 19
- 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestrationcited by 14
- 2026Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learningcited by 2
- 2026MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselvescited by 2
- 2025Dissecting Role Cognition in Medical LLMs via Neuronal Ablationcited by 1
- 2026MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselves6 Sep 2026
- 2026Self-Improvements in Modern Agentic Systems: A Survey14 Jul 2026
- 2026Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learning23 Jun 2026
- 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestration24 Mar 2026
- 2025Dissecting Role Cognition in Medical LLMs via Neuronal Ablation28 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025SMART: Self-Aware Agent for Tool Overuse Mitigation
- 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution
- 2026MetaForge: A Self-Evolving Multimodal Agent that Retrieves, Adapts, and Forges Tools On Demand ↗
- 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolution
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
- 2025InfoAgent: Advancing Autonomous Information-Seeking Agents
- 2025MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machines
- 2026Meta Context Engineering via Agentic Skill Evolution