mlsanityData to 14 Oct 2026

MetaAgent: Toward Self-Evolving Agent via Tool Meta-Learning

arXiv 2508.00271 ↗First posted 1 Aug 2025cs.AI cs.CL cs.IRcited by 5

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

In this work, we propose MetaAgent, an agentic paradigm inspired by the principle of learning-by-doing, where expertise is developed through hands-on practice and continual self-improvement. MetaAgent starts with a minimal workflow, equipped only with basic reasoning and adaptive help-seeking abilities. When a knowledge gap is encountered, MetaAgent generates natural language help requests, which are routed to the most suitable external tool by a dedicated tool router. As MetaAgent solves tasks, it continually conducts self-reflection and answer verification, distilling actionable experience into concise texts that are dynamically incorporated into future task contexts. Besides, MetaAgent autonomously builds in-house tools and a persistent knowledge base by organizing its tool-use history, further enhancing its ability to retrieve and integrate relevant information We term this continual, data-driven process as textitmeta tool learning, through which MetaAgent incrementally refines its reasoning and tool-use strategies, without changing model parameters or requiring further post-training. Evaluated on challenging knowledge discovery benchmarks, including GAIA, WebWalkerQA, and BrowseCamp, MetaAgent consistently outperforms workflow-based baselines and matches or exceeds end-to-end trained agents, demonstrating the promise of self-evolving agentic systems for robust, general-purpose knowledge discovery. We provide our source codes in https://github.com/qhjqhj00/MetaAgent.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 29 of its 36 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

29 of 36 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023A Survey on Large Language Model based Autonomous Agents22 Aug

Other references · 28

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2023A Survey of Large Language Modelscited by 2,576
  7. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  8. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  9. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  10. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  11. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  12. 2025Humanity's Last Examcited by 491
16 more
  1. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
  2. 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
  3. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  4. 2023Large Language Models for Information Retrieval: A Surveycited by 331
  5. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
  6. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
  7. 2025Acting Less is Reasoning More! Teaching Model to Act Efficientlycited by 80
  8. 2025Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learningcited by 72
  9. 2025Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learningcited by 70
  10. 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 66
  11. 2025Chain-of-Retrieval Augmented Generationcited by 49
  12. 2025An Empirical Study on Reinforcement Learning for Reasoning-Search Interleaved LLM Agentscited by 46
  13. 2025Coding Agents with Multimodal Browsing are Generalist Problem Solverscited by 25
  14. 2024Agentic Information Retrievalcited by 21
  15. 2025Towards AI Search Paradigmcited by 19
  16. 2025HawkBench: Investigating Resilience of RAG Methods on Stratified Information-Seeking Taskscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SMART: Self-Aware Agent for Tool Overuse Mitigation
  2. 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution
  3. 2026MetaForge: A Self-Evolving Multimodal Agent that Retrieves, Adapts, and Forges Tools On Demand ↗
  4. 2025CASCADE: Cumulative Agentic Skill Creation through Autonomous Development and Evolution
  5. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
  6. 2025InfoAgent: Advancing Autonomous Information-Seeking Agents
  7. 2025MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machines
  8. 2026Meta Context Engineering via Agentic Skill Evolution