mlsanityData to 14 Oct 2026

The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey

arXiv 2404.11584 ↗First posted 17 Apr 2024cs.AI cs.CLcited by 168

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

This survey paper examines the recent advancements in AI agent implementations, with a focus on their ability to achieve complex goals that require enhanced reasoning, planning, and tool execution capabilities. The primary objectives of this work are to a) communicate the current capabilities and limitations of existing AI agent implementations, b) share insights gained from our observations of these systems in action, and c) suggest important considerations for future developments in AI agent design. We achieve this by providing overviews of single-agent and multi-agent architectures, identifying key patterns and divergences in design choices, and evaluating their overall impact on accomplishing a provided goal. Our contribution outlines key themes when selecting an agentic architecture, the impact of leadership on agent systems, agent communication styles, and key phases for planning, execution, and reflection that enable robust AI agent systems.

Key facts. Cited by 168 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 37 references that are in the map. First posted on arXiv 17 Apr 2024.

Builds on

36 of 37 references.

Closest ancestors · 14

Same direction, newest first

  1. 2024Embodied LLM Agents Learn to Cooperate in Organized Teams19 Mar
  2. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?28 Feb
  3. 2024Dynamic Evaluation of Large Language Models by Meta Probing Agents21 Feb
  4. 2024Large Language Model-based Human-Agent Collaboration for Complex Task Solving20 Feb
  5. 2024Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluation18 Feb
  6. 2024Understanding the planning of LLM agents: A survey5 Feb
  7. 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Models5 Jan
  8. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
  9. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
  10. 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
  11. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  12. 2023AgentBench: Evaluating LLMs as Agents7 Aug
2 more
  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  2. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul

Other references · 22

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  8. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 743
  9. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  10. 2023How Language Model Hallucinations Can Snowballcited by 311
  11. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  12. 2023Time Travel in LLMs: Tracing Data Contamination in Large Language Modelscited by 177
10 more
  1. 2023Personality Traits in Large Language Modelscited by 169
  2. 2023SmartPlay: A Benchmark for LLMs as Intelligent Agentscited by 125
  3. 2023Evil Geniuses: Delving into the Safety of LLM-based Agentscited by 106
  4. 2023DyVal: Dynamic Evaluation of Large Language Models for Reasoning Taskscited by 101
  5. 2024Systematic Biases in LLM Simulations of Debatescited by 99
  6. 2024Learning to Use Tools via Cooperative and Interactive Agentscited by 54
  7. 2024Graph-enhanced Large Language Models in Asynchronous Plan Reasoningcited by 37
  8. 2024Efficient Tool Use with Chain-of-Abstraction Reasoningcited by 33
  9. 2024AutoGPT+P: Affordance-based Task Planning with Large Language Modelscited by 19
  10. 2023S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Modelscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 22; 2025: 82; 2026: 64.

168 papers.

Sort:

By area:

  1. 2025Small Language Models are the Future of Agentic AIcited by 270
  2. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 248
  3. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
  4. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  5. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  6. 2024Large Language Model-Brained GUI Agents: A Surveycited by 162
  7. 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 127
  8. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
  9. 2025A Survey of Context Engineering for Large Language Modelscited by 126
  10. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
  11. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 116
  12. 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systemscited by 111
38 more
  1. 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 87
  2. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
  3. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
  4. 2025A Survey on (M)LLM-Based GUI Agentscited by 62
  5. 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 48
  6. 2025Agentic Web: Weaving the Next Web with AI Agentscited by 45
  7. 2025Magentic-UI: Towards Human-in-the-loop Agentic Systemscited by 43
  8. 2024FIRE: Fact-checking with Iterative Retrieval and Verificationcited by 39
  9. 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attackscited by 38
  10. 2025Measuring Agents in Productioncited by 37
  11. 2025MCP-Zero: Active Tool Discovery for Autonomous LLM Agentscited by 33
  12. 2025Characterizing AI Agents for Alignment and Governancecited by 30
  13. 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
  14. 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agentscited by 29
  15. 2024Planning with Multi-Constraints via Collaborative Language Agentscited by 26
  16. 2025ML-Agent: Reinforcing LLM Agents for Autonomous Machine Learning Engineeringcited by 26
  17. 2025Simple Prompt Injection Attacks Can Leak Personal Data Observed by LLM Agents During Task Executioncited by 26
  18. 2025LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarioscited by 26
  19. 2025TAMAS: Benchmarking Adversarial Risks in Multi-Agent LLM Systemscited by 26
  20. 2025AutoData: A Multi-Agent System for Open Web Data Collectioncited by 25
  21. 2025MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detectioncited by 24
  22. 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
  23. 2024CoMAL: Collaborative Multi-Agent Large Language Models for Mixed-Autonomy Trafficcited by 22
  24. 2025LLM-Powered AI Agent Systems and Their Applications in Industrycited by 22
  25. 2025TableMind: An Autonomous Programmatic Agent for Tool-Augmented Table Reasoningcited by 20
  26. 2025AI for Service: Proactive Assistance with AI Glassescited by 20
  27. 2025A Vision for Auto Research with LLM Agentscited by 18
  28. 2025Multi-Agent Deep Research: Training Multi-Agent Systems with M-GRPOcited by 18
  29. 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architecturescited by 18
  30. 2025Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agentscited by 17
  31. 2026EvoRoute: Experience-Driven Self-Routing LLM Agent Systemscited by 16
  32. 2026BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agentscited by 16
  33. 2025The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Marketscited by 15
  34. 2025An Empirical Study of Testing Practices in Open Source AI Agent Frameworks and Agentic Applicationscited by 15
  35. 2025A Practical Guide for Designing, Developing, and Deploying Production-Grade Agentic AI Workflowscited by 15
  36. 2025A Survey on Agent Workflow -- Status and Futurecited by 14
  37. 2025An Empirical Study of Agent Developer Practices in AI Agent Frameworkscited by 14
  38. 2025GTM: Simulating the World of Tools for AI Agentscited by 14

50 most cited of 168 All 168 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025AI Agents: Evolution, Architecture, and Real-World Applications
  2. 2025A Comprehensive Review of AI Agents: Transforming Possibilities in Technology and Beyond
  3. 2025Distinguishing Autonomous AI Agents from Collaborative Agentic Systems: A Comprehensive Framework for Understanding Modern Intelligent Architectures
  4. 2025Control Plane as a Tool: A Scalable Design Pattern for Agentic AI Systems
  5. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
  6. 2026The Path Ahead for Agentic AI: Challenges and Opportunities
  7. 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents
  8. 2025AgentArch: A Comprehensive Benchmark to Evaluate Agent Architectures in Enterprise