Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Artificial Intelligence is moving from models that only generate text to Agentic AI, where systems behave as autonomous entities that can perceive, reason, plan, and act. Large Language Models (LLMs) are no longer used only as passive knowledge engines but as cognitive controllers that combine memory, tool use, and feedback from their environment to pursue extended goals. This shift already supports the automation of complex workflows in software engineering, scientific discovery, and web navigation, yet the variety of emerging designs, from simple single loop agents to hierarchical multi agent systems, makes the landscape hard to navigate. In this paper, we investigate architectures and propose a unified taxonomy that breaks agents into Perception, Brain, Planning, Action, Tool Use, and Collaboration. We use this lens to describe the move from linear reasoning procedures to native inference time reasoning models, and the transition from fixed API calls to open standards like the Model Context Protocol (MCP) and Native Computer Use. We also group the environments in which these agents operate, including digital operating systems, embodied robotics, and other specialized domains, and we review current evaluation practices. Finally, we highlight open challenges, such as hallucination in action, infinite loops, and prompt injection, and outline future research directions toward more robust and reliable autonomous systems.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 89 of its 149 references that are in the map. First posted on arXiv 18 Jan 2026.
Builds on
89 of 149 references.
Closest ancestors · 23
Same direction, newest first
- 2025ReAcTree: Hierarchical LLM Agent Trees with Control Flow for Long-Horizon Task Planning4 Nov
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directions29 Oct
- 2025Self-Improving LLM Agents at Test-Time9 Oct
- 2025Enhancing LLM-Based Agents via Global Planning and Hierarchical Execution23 Apr
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar
- 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agents6 Feb
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs10 Jan
- 2024Agent-Oriented Planning in Multi-Agent Systems3 Oct
- 2024Recursive Introspection: Teaching Language Model Agents How to Self-Improve25 Jul
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks4 Jun
11 more
- 2024Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration23 May
- 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models19 Mar
- 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security10 Jan
- 2023FireAct: Toward Language Agent Fine-tuning9 Oct
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug
- 2023ExpeL: LLM Agents Are Experiential Learners20 Aug
- 2023BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents11 Aug
- 2023AgentBench: Evaluating LLMs as Agents7 Aug
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
Other references · 66
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
38 more
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023Reasoning with Language Model is Planning with World Modelcited by 861
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
- 2023Augmented Language Models: a Surveycited by 403
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
- 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 265
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 243
- 2024Tool Learning with Large Language Models: A Surveycited by 223
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 223
- 2022TALM: Tool Augmented Language Modelscited by 197
- 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
- 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 184
- 2023A Language Agent for Autonomous Drivingcited by 164
- 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 140
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 139
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agentscited by 125
- 2025PromptArmor: Simple yet Effective Prompt Injection Defensescited by 108
- 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agentscited by 98
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 85
- 2025MemInsight: Autonomous Memory Augmentation for LLM Agentscited by 85
- 2023ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agentcited by 81
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 24
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026Co-Evolving Skill Generation and Policy Optimizationcited by 7
- 2026Memanto: Typed Semantic Memory with Information-Theoretic Retrieval for Long-Horizon Agentscited by 6
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Webcited by 2
- 2026Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagramscited by 2
- 2026BaseRT: Best-in-Class LLM Inference on Apple Silicon via Native Metalcited by 1
- 2026BaseRT: Advancing Best-in-Class LLM Inference with Apple M5 Neural Acceleratorscited by 0
- 2026Agentic Metaverse Services: A New As-a-Service Paradigmcited by 0
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systemscited by 0
- 2026ASTELD: A Six-Axis Classification Framework for Autonomous AI Agents - Design, Evaluation, and an OpenClaw Case Studycited by 0
- 2026Agentic Cognitive Depth: Operational Criteria for Evaluating LLM Agents3 Oct 2026
- 2026Resilience Matters for Embodied Agents System: New Metrics, Systematic Evaluation, and Optimization24 Aug 2026
- 2026Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams12 Aug 2026
- 2026ASTELD: A Six-Axis Classification Framework for Autonomous AI Agents - Design, Evaluation, and an OpenClaw Case Study5 Aug 2026
- 2026Agentic Metaverse Services: A New As-a-Service Paradigm30 Jul 2026
- 2026BaseRT: Advancing Best-in-Class LLM Inference with Apple M5 Neural Accelerators21 Jul 2026
- 2026BaseRT: Best-in-Class LLM Inference on Apple Silicon via Native Metal1 Jul 2026
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI12 Jun 2026
- 2026Co-Evolving Skill Generation and Policy Optimization7 Jun 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026Memanto: Typed Semantic Memory with Information-Theoretic Retrieval for Long-Horizon Agents23 Apr 2026
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systems16 Apr 2026
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 24
- 2026Memanto: Typed Semantic Memory with Information-Theoretic Retrieval for Long-Horizon Agentscited by 6
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Webcited by 2
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systemscited by 0
- 2026Agentic Cognitive Depth: Operational Criteria for Evaluating LLM Agentscited by 0
- 2026Agentic Cognitive Depth: Operational Criteria for Evaluating LLM Agents3 Oct 2026
- 2026Memanto: Typed Semantic Memory with Information-Theoretic Retrieval for Long-Horizon Agents23 Apr 2026
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systems16 Apr 2026
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Web30 Mar 2026
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents23 Mar 2026
- 2026Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams12 Aug 2026
- 2026Co-Evolving Skill Generation and Policy Optimizationcited by 7
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026BaseRT: Best-in-Class LLM Inference on Apple Silicon via Native Metalcited by 1
- 2026Agentic Metaverse Services: A New As-a-Service Paradigmcited by 0
- 2026ASTELD: A Six-Axis Classification Framework for Autonomous AI Agents - Design, Evaluation, and an OpenClaw Case Studycited by 0
- 2026Resilience Matters for Embodied Agents System: New Metrics, Systematic Evaluation, and Optimizationcited by 0
- 2026Resilience Matters for Embodied Agents System: New Metrics, Systematic Evaluation, and Optimization24 Aug 2026
- 2026ASTELD: A Six-Axis Classification Framework for Autonomous AI Agents - Design, Evaluation, and an OpenClaw Case Study5 Aug 2026
- 2026Agentic Metaverse Services: A New As-a-Service Paradigm30 Jul 2026
- 2026BaseRT: Best-in-Class LLM Inference on Apple Silicon via Native Metal1 Jul 2026
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI12 Jun 2026
- 2026Co-Evolving Skill Generation and Policy Optimization7 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Path Ahead for Agentic AI: Challenges and Opportunities
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
- 2025A Survey on Agentic Multimodal Large Language Models
- 2025A Comprehensive Review of AI Agents: Transforming Possibilities in Technology and Beyond
- 2025AI Agents: Evolution, Architecture, and Real-World Applications
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?
- 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
- 2026AI Agent Systems: Architectures, Applications, and Evaluation