mlsanityData to 7 Oct 2026

OpenAgents: An Open Platform for Language Agents in the Wild

arXiv 2310.10634 ↗First posted 16 Oct 2023cs.CL cs.AIcited by 136

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Language agents show potential in being capable of utilizing natural language for varied and intricate tasks in diverse environments, particularly when built upon large language models (LLMs). Current language agent frameworks aim to facilitate the construction of proof-of-concept language agents while neglecting the non-expert user access to agents and paying little attention to application-level designs. We present OpenAgents, an open platform for using and hosting language agents in the wild of everyday life. OpenAgents includes three agents: (1) Data Agent for data analysis with Python/SQL and data tools; (2) Plugins Agent with 200+ daily API tools; (3) Web Agent for autonomous web browsing. OpenAgents enables general users to interact with agent functionalities through a web user interface optimized for swift responses and common failures while offering developers and researchers a seamless deployment experience on local setups, providing a foundation for crafting innovative language agents and facilitating real-world evaluations. We elucidate the challenges and opportunities, aspiring to set a foundation for future research and development of real-world language agents.

Key facts. Cited by 136 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 46 of its 75 references that are in the map. First posted on arXiv 16 Oct 2023.

Builds on

46 of 75 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023Lemur: Harmonizing Natural Language and Code for Language Agents10 Oct
  2. 2023Agents: An Open-source Framework for Autonomous Language Agents14 Sep
  3. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  4. 2023Gentopia: A Collaborative Platform for Tool-Augmented LLMs8 Aug
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  6. 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks27 May

Other references · 40

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  8. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  9. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  10. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  11. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  12. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
28 more
  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  2. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  3. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  4. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  5. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  6. 2023LIMA: Less Is More for Alignmentcited by 1,080
  7. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  8. 2023Instruction Tuning with GPT-4cited by 676
  9. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
  10. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 574
  11. 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 329
  12. 2023Tool Learning with Foundation Modelscited by 302
  13. 2023Effective Long-Context Scaling of Foundation Modelscited by 301
  14. 2023Large Language Models as Tool Makerscited by 293
  15. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 293
  16. 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 276
  17. 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
  18. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  19. 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 229
  20. 2022Binding Language Models in Symbolic Languagescited by 224
  21. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
  22. 2023Focused Transformer: Contrastive Training for Context Scalingcited by 133
  23. 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
  24. 2023Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language Promptscited by 30
  25. 2023On the Design of AI-powered Code Assistants for Notebookscited by 28
  26. 2021Adapting User Interfaces with Model-based Reinforcement Learningcited by 16
  27. 2023GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyondcited by 14
  28. 2021The Personalization Paradox: the Conflict between Accurate User Models and Personalized Adaptive Systemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 57; 2025: 53; 2026: 22.

136 papers.

Sort:

By area:

  1. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  2. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  3. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  4. 2023AppAgent: Multimodal Agents as Smartphone Userscited by 407
  5. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
  6. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
  7. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
  8. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  9. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 268
  10. 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 257
  11. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
  12. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
38 more
  1. 2024Large Language Model-Brained GUI Agents: A Surveycited by 160
  2. 2023MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQLcited by 158
  3. 2024The BrowserGym Ecosystem for Web Agent Researchcited by 152
  4. 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 134
  5. 2024CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQLcited by 132
  6. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 129
  7. 2024AgentScope: A Flexible yet Robust Multi-Agent Platformcited by 120
  8. 2024xLAM: A Family of Large Action Models to Empower AI Agent Systemscited by 108
  9. 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Modelcited by 101
  10. 2025Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoningcited by 101
  11. 2024Large Multimodal Agents: A Surveycited by 99
  12. 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 98
  13. 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environmentscited by 93
  14. 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
  15. 2024Watch Every Step! LLM Agent Learning via Iterative Step-Level Process Refinementcited by 86
  16. 2024AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planningcited by 81
  17. 2024Language Agents as Optimizable Graphscited by 81
  18. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 80
  19. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
  20. 2024KnowAgent: Knowledge-Augmented Planning for LLM-Based Agentscited by 61
  21. 2025LVAgent: Long Video Understanding by Multi-Round Dynamical Collaboration of MLLM Agentscited by 58
  22. 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systemscited by 58
  23. 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
  24. 2024AgentOhana: Design Unified Data and Training Pipeline for Effective Agent Learningcited by 53
  25. 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agentscited by 48
  26. 2025Contextual Experience Replay for Self-Improvement of Language Agentscited by 46
  27. 2024AgentStudio: A Toolkit for Building General Virtual Agentscited by 45
  28. 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Modelscited by 42
  29. 2024On the Multi-turn Instruction Following for Conversational Web Agentscited by 42
  30. 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
  31. 2024OSCAR: Operating System Control via State-Aware Reasoning and Re-Planningcited by 37
  32. 2024Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agentscited by 35
  33. 2024VideoGUI: A Benchmark for GUI Automation from Instructional Videoscited by 35
  34. 2025AgentSafe: Safeguarding Large Language Model-based Multi-agent Systems via Hierarchical Data Managementcited by 35
  35. 2024VillagerAgent: A Graph-Based Multi-Agent Framework for Coordinating Complex Task Dependencies in Minecraftcited by 34
  36. 2024MAGIC: Generating Self-Correction Guideline for In-Context Text-to-SQLcited by 34
  37. 2025VideoChat-A1: Thinking with Long Videos by Chain-of-Shot Reasoningcited by 32
  38. 2024InsightBench: Evaluating Business Analytics Agents Through Multi-Step Insight Generationcited by 30

50 most cited of 136 All 136 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System
  2. 2023Enhancing Open-Domain Task-Solving Capability of LLMs via Autonomous Tool Integration from GitHub
  3. 2026Rethinking Scale: Deployment Trade-offs of Small Language Models under Agent Paradigms
  4. 2026BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents
  5. 2026AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
  6. 2026Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Use
  7. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  8. 2025AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agents