mlsanityData to 14 Oct 2026

Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents

arXiv 2601.12560 ↗First posted 18 Jan 2026cs.AI cs.MAcited by 14

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Artificial Intelligence is moving from models that only generate text to Agentic AI, where systems behave as autonomous entities that can perceive, reason, plan, and act. Large Language Models (LLMs) are no longer used only as passive knowledge engines but as cognitive controllers that combine memory, tool use, and feedback from their environment to pursue extended goals. This shift already supports the automation of complex workflows in software engineering, scientific discovery, and web navigation, yet the variety of emerging designs, from simple single loop agents to hierarchical multi agent systems, makes the landscape hard to navigate. In this paper, we investigate architectures and propose a unified taxonomy that breaks agents into Perception, Brain, Planning, Action, Tool Use, and Collaboration. We use this lens to describe the move from linear reasoning procedures to native inference time reasoning models, and the transition from fixed API calls to open standards like the Model Context Protocol (MCP) and Native Computer Use. We also group the environments in which these agents operate, including digital operating systems, embodied robotics, and other specialized domains, and we review current evaluation practices. Finally, we highlight open challenges, such as hallucination in action, infinite loops, and prompt injection, and outline future research directions toward more robust and reliable autonomous systems.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 89 of its 149 references that are in the map. First posted on arXiv 18 Jan 2026.

Builds on

89 of 149 references.

Closest ancestors · 23

Same direction, newest first

  1. 2025ReAcTree: Hierarchical LLM Agent Trees with Control Flow for Long-Horizon Task Planning4 Nov
  2. 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directions29 Oct
  3. 2025Self-Improving LLM Agents at Test-Time9 Oct
  4. 2025Enhancing LLM-Based Agents via Global Planning and Hierarchical Execution23 Apr
  5. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar
  6. 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar
  7. 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agents6 Feb
  8. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs10 Jan
  9. 2024Agent-Oriented Planning in Multi-Agent Systems3 Oct
  10. 2024Recursive Introspection: Teaching Language Model Agents How to Self-Improve25 Jul
  11. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  12. 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks4 Jun
11 more
  1. 2024Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration23 May
  2. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models19 Mar
  3. 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security10 Jan
  4. 2023FireAct: Toward Language Agent Fine-tuning9 Oct
  5. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
  6. 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
  7. 2023A Survey on Large Language Model based Autonomous Agents22 Aug
  8. 2023ExpeL: LLM Agents Are Experiential Learners20 Aug
  9. 2023BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents11 Aug
  10. 2023AgentBench: Evaluating LLMs as Agents7 Aug
  11. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug

Other references · 66

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  7. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  8. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  9. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  11. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  12. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
38 more
  1. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  5. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  6. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  7. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  8. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  9. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  10. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  11. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  12. 2023Reasoning with Language Model is Planning with World Modelcited by 861
  13. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  14. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  15. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  16. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
  17. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  18. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  19. 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
  20. 2023Augmented Language Models: a Surveycited by 403
  21. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  22. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  23. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 265
  24. 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 243
  25. 2024Tool Learning with Large Language Models: A Surveycited by 223
  26. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 223
  27. 2022TALM: Tool Augmented Language Modelscited by 197
  28. 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
  29. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 184
  30. 2023A Language Agent for Autonomous Drivingcited by 164
  31. 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 140
  32. 2025Magma: A Foundation Model for Multimodal AI Agentscited by 139
  33. 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agentscited by 125
  34. 2025PromptArmor: Simple yet Effective Prompt Injection Defensescited by 108
  35. 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agentscited by 98
  36. 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 85
  37. 2025MemInsight: Autonomous Memory Augmentation for LLM Agentscited by 85
  38. 2023ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agentcited by 81

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026The Path Ahead for Agentic AI: Challenges and Opportunities
  2. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
  3. 2025A Survey on Agentic Multimodal Large Language Models
  4. 2025A Comprehensive Review of AI Agents: Transforming Possibilities in Technology and Beyond
  5. 2025AI Agents: Evolution, Architecture, and Real-World Applications
  6. 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?
  7. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
  8. 2026AI Agent Systems: Architectures, Applications, and Evaluation