mlsanityData to 7 Oct 2026

Gentopia: A Collaborative Platform for Tool-Augmented LLMs

arXiv 2308.04030 ↗First posted 8 Aug 2023cs.AIcited by 25

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Augmented Language Models (ALMs) empower large language models with the ability to use tools, transforming them into intelligent agents for real-world interactions. However, most existing frameworks for ALMs, to varying degrees, are deficient in the following critical features: flexible customization, collaborative democratization, and holistic evaluation. We present gentopia, an ALM framework enabling flexible customization of agents through simple configurations, seamlessly integrating various language models, task formats, prompting modules, and plugins into a unified paradigm. Furthermore, we establish gentpool, a public platform enabling the registration and sharing of user-customized agents. Agents registered in gentpool are composable such that they can be assembled together for agent collaboration, advancing the democratization of artificial intelligence. To ensure high-quality agents, gentbench, an integral component of gentpool, is designed to thoroughly evaluate user-customized agents across diverse aspects such as safety, robustness, efficiency, etc. We release gentopia on Github and will continuously move forward.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 42 references that are in the map. First posted on arXiv 8 Aug 2023.

Builds on

28 of 42 references.

References · 28

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2023Let's Verify Step by Stepcited by 3,598
  10. 2021Program Synthesis with Large Language Modelscited by 3,509
  11. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  12. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
16 more
  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  2. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  3. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  4. 2021Measuring Coding Challenge Competence With APPScited by 879
  5. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
  6. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
  7. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  8. 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 425
  9. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 410
  10. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  11. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  12. 2023Specializing Smaller Language Models towards Multi-Step Reasoningcited by 249
  13. 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
  14. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
  15. 2023On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark)cited by 85
  16. 2023Zeno: An Interactive Framework for Behavioral Evaluation of Machine Learningcited by 33

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 9; 2024: 10; 2025: 4; 2026: 2.

25 papers.

Sort:

By area:

  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  3. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  4. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
  5. 2023Cognitive Architectures for Language Agentscited by 422
  6. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
  7. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
  8. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
  9. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 136
  10. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 130
  11. 2023Agents: An Open-source Framework for Autonomous Language Agentscited by 116
  12. 2024Large Language Models Can Learn Temporal Reasoningcited by 110
13 more
  1. 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generationcited by 50
  2. 2024WIPI: A New Web Threat for LLM-Driven Web Agentscited by 50
  3. 2024On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS)cited by 40
  4. 2024MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Educationcited by 35
  5. 2023An In-depth Survey of Large Language Model-based Artificial Intelligence Agentscited by 30
  6. 2023Zero-shot Referring Expression Comprehension via Structural Similarity Between Images and Captionscited by 21
  7. 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
  8. 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspectivecited by 11
  9. 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
  10. 2025An LLM Agentic Approach for Legal-Critical Software: A Case Study for Tax Prep Softwarecited by 5
  11. 2025ToolLibGen: Scalable Automatic Tool Creation and Aggregation for LLM Reasoningcited by 5
  12. 2025Bridging Language Models and Financial Analysiscited by 4
  13. 2026TRUST Agents: A Collaborative Multi-Agent Framework for Fake News Detection, Explainable Verification, and Logic-Aware Claim Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Creating an LLM-based AI-agent: A high-level methodology towards enhancing LLMs with APIs
  2. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents
  3. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
  4. 2026Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report
  5. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges
  6. 2024Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments
  7. 2025Generalizability of Large Language Model-Based Agents: A Comprehensive Survey
  8. 2024Designing Algorithms Empowered by Language Models: An Analytical Framework, Case Studies, and Insights