mlsanityData to 7 Oct 2026

An In-depth Survey of Large Language Model-based Artificial Intelligence Agents

arXiv 2309.14365 ↗First posted 23 Sep 2023cs.CL cs.AIcited by 30

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Due to the powerful capabilities demonstrated by large language model (LLM), there has been a recent surge in efforts to integrate them with AI agents to enhance their performance. In this paper, we have explored the core differences and characteristics between LLM-based AI agents and traditional AI agents. Specifically, we first compare the fundamental characteristics of these two types of agents, clarifying the significant advantages of LLM-based agents in handling natural language, knowledge storage, and reasoning capabilities. Subsequently, we conducted an in-depth analysis of the key components of AI agents, including planning, memory, and tool use. Particularly, for the crucial component of memory, this paper introduced an innovative classification scheme, not only departing from traditional classification methods but also providing a fresh perspective on the design of an AI agent's memory system. We firmly believe that in-depth research and understanding of these core components will lay a solid foundation for the future advancement of AI agent technology. At the end of the paper, we provide directional suggestions for further research in this field, with the hope of offering valuable insights to scholars and researchers in the field.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 76 of its 110 references that are in the map. First posted on arXiv 23 Sep 2023.

Builds on

76 of 110 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents11 Aug
  2. 2023Gentopia: A Collaborative Platform for Tool-Augmented LLMs8 Aug
  3. 2023InterAct: Exploring the Potentials of ChatGPT as a Cooperative Agent3 Aug
  4. 2023AdaPlanner: Adaptive Planning from Feedback with Language Models26 May

Other references · 72

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  8. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  9. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  11. 2022Emergent Abilities of Large Language Modelscited by 2,483
  12. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
38 more
  1. 2019Language Models as Knowledge Bases?cited by 1,922
  2. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  3. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  4. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  5. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  6. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  7. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
  8. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  9. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  10. 2020A Primer in BERTology: What we know about how BERT workscited by 807
  11. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  12. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  13. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  14. 2022Towards Reasoning in Large Language Models: A Surveycited by 593
  15. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  16. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  17. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  18. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  19. 2017A Brief Survey of Deep Reinforcement Learningcited by 466
  20. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
  21. 2017Deep Reinforcement Learning: An Overviewcited by 327
  22. 2023Large Language Models as Tool Makerscited by 293
  23. 2023Large Language Model Guided Tree-of-Thoughtcited by 218
  24. 2023Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planningcited by 204
  25. 2022TALM: Tool Augmented Language Modelscited by 197
  26. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  27. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
  28. 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
  29. 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
  30. 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
  31. 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 177
  32. 2022Large Language Models with Controllable Working Memorycited by 169
  33. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 153
  34. 2023Chain of Hindsight Aligns Language Models with Feedbackcited by 147
  35. 2023Translating Natural Language to Planning Goals with Large-Language Modelscited by 132
  36. 2023Emergent autonomous scientific research capabilities of large language modelscited by 127
  37. 2023Retroformer: Retrospective Large Language Agents with Policy Gradient Optimizationcited by 110
  38. 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 9; 2025: 15; 2026: 4.

30 papers.

Sort:

By area:

  1. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  2. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
  3. 2024Large Language Model-Brained GUI Agents: A Surveycited by 160
  4. 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 134
  5. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  6. 2024GUI Agents: A Surveycited by 101
  7. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agentscited by 77
  8. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 68
  9. 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46
  10. 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulationscited by 28
  11. 2023LLMind: Orchestrating AI and IoT with LLM for Complex Task Executioncited by 24
  12. 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
18 more
  1. 2024Cohesive Conversations: Enhancing Authenticity in Multi-Agent Simulated Dialoguescited by 11
  2. 2025Agent Safety Alignment via Reinforcement Learningcited by 10
  3. 2025SEM: Reinforcement Learning for Search-Efficient Large Language Modelscited by 9
  4. 2026MemSyco-Bench: Benchmarking Sycophancy in Agent Memorycited by 9
  5. 2024Levels of AI Agents: from Rules to Large Language Modelscited by 6
  6. 2024On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboardscited by 6
  7. 2025Bias-Aware Agent: Enhancing Fairness in AI-Driven Knowledge Retrievalcited by 5
  8. 2025Context-aware LLM-based AI Agents for Human-centered Energy Management Systems in Smart Buildingscited by 4
  9. 2025Leveraging a Multi-Agent LLM-Based System to Educate Teachers in Hate Incidents Managementcited by 3
  10. 2025OracleAgent: A Multimodal Reasoning Agent for Oracle Bone Script Researchcited by 3
  11. 2023The Tyranny of Possibilities in the Design of Task-Oriented LLM Systems: A Scoping Surveycited by 2
  12. 2025Exploring Agentic Artificial Intelligence Systems: Towards a Typological Frameworkcited by 2
  13. 2024GAI: Generative Agents for Innovationcited by 1
  14. 2026Agentic AI in Healthcare & Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-based Agentscited by 1
  15. 2026What Guides the Agent? Adjudicating Unauthorized Behavior via Localizing Behavior-Guiding Instructionscited by 1
  16. 2025Intelligent Assistants for the Semiconductor Failure Analysis with LLM-Based Planning Agentscited by 0
  17. 2025MultiGA: Leveraging Multi-Source Seeding in Genetic Algorithmscited by 0
  18. 2026LLM-as-an-Investigator: Evidence-First Reasoning for Robust Interactive Problem Diagnosiscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023The Rise and Potential of Large Language Model Based Agents: A Survey
  2. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
  3. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects
  4. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics
  5. 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
  6. 2023TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usage
  7. 2023A Survey on Large Language Model based Autonomous Agents
  8. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions