mlsanityData to 14 Oct 2026

Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems

arXiv 2504.01990 ↗First posted 31 Mar 2025cs.AIcited by 126

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

The advent of large language models (LLMs) has catalyzed a transformative shift in artificial intelligence, paving the way for advanced intelligent agents capable of sophisticated reasoning, robust perception, and versatile action across diverse domains. As these agents increasingly drive AI research and practical applications, their design, evaluation, and continuous improvement present intricate, multifaceted challenges. This book provides a comprehensive overview, framing intelligent agents within modular, brain-inspired architectures that integrate principles from cognitive science, neuroscience, and computational research. We structure our exploration into four interconnected parts. First, we systematically investigate the modular foundation of intelligent agents, systematically mapping their cognitive, perceptual, and operational modules onto analogous human brain functionalities and elucidating core components such as memory, world modeling, reward processing, goal, and emotion. Second, we discuss self-enhancement and adaptive evolution mechanisms, exploring how agents autonomously refine their capabilities, adapt to dynamic environments, and achieve continual learning through automated optimization paradigms. Third, we examine multi-agent systems, investigating the collective intelligence emerging from agent interactions, cooperation, and societal structures. Finally, we address the critical imperative of building safe and beneficial AI systems, emphasizing intrinsic and extrinsic security threats, ethical alignment, robustness, and practical mitigation strategies necessary for trustworthy real-world deployment. By synthesizing modular AI architectures with insights from different disciplines, this survey identifies key research challenges and opportunities, encouraging innovations that harmonize technological advancement with meaningful societal benefit.

Key facts. Cited by 126 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 727 of its 1,606 references that are in the map. First posted on arXiv 31 Mar 2025.

Builds on

727 of 1,606 references.

Closest ancestors · 77

Same direction, newest first

  1. 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems5 Mar
  2. 2025Unified Mind Model: Reimagining Autonomous Agents in the LLM Era5 Mar
  3. 2025ATLaS: Agent Tuning via Learning Critical Steps4 Mar
  4. 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar
  5. 2025Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agents27 Feb
  6. 2025REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Tasks26 Feb
  7. 2025Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaboration17 Feb
  8. 2025LLM-Powered Decentralized Generative Agents with Adaptive Hierarchical Knowledge Graph for Cooperative Planning8 Feb
  9. 2025SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning7 Feb
  10. 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
  11. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
  12. 2025MASTER: A Multi-Agent System with LLM Specialized MCTS24 Jan
38 more
  1. 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environments18 Jan
  2. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs10 Jan
  3. 2024Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration20 Dec
  4. 2024LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation12 Dec
  5. 2024How to Correctly do Semantic Backpropagation on Language-based Agentic Systems4 Dec
  6. 2024BudgetMLAgent: A Cost-Effective LLM Multi-Agent system for Automating Machine Learning Tasks12 Nov
  7. 2024Agent-as-a-Judge: Evaluate Agents with Agents14 Oct
  8. 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System10 Oct
  9. 2024COMMA: A Communicative Multimodal Multi-Agent Benchmark10 Oct
  10. 2024G"odel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement6 Oct
  11. 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML3 Oct
  12. 2024ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning2 Oct
  13. 2024From Commands to Prompts: LLM-based Semantic File System for AIOS23 Sep
  14. 2024xLAM: A Family of Large Action Models to Empower AI Agent Systems5 Sep
  15. 2024BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systems28 Aug
  16. 2024Automated Design of Agentic Systems15 Aug
  17. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents2 Aug
  18. 2024Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents11 Jul
  19. 2024Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence9 Jul
  20. 2024Symbolic Learning Enables Self-Evolving Agents26 Jun
  21. 2024Autonomous Agents for Collaborative Task under Information Asymmetry21 Jun
  22. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  23. 2024Improving Multi-Agent Debate with Sparse Communication Topology17 Jun
  24. 2024Multi-Agent Collaboration via Cross-Team Orchestration13 Jun
  25. 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
  26. 2024Auto-Arena: Automating LLM Evaluations with Agent Peer Battles and Committee Discussions30 May
  27. 2024A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Models28 May
  28. 2024Position: Foundation Agents as the Paradigm Shift for Decision Making27 May
  29. 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning25 May
  30. 2024Iterative Experience Refinement of Software-Developing Agents7 May
  31. 2024Sub-goal Distillation: A Method to Improve Small Language Agents4 May
  32. 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaboration18 Apr
  33. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey17 Apr
  34. 2024ReAct Meets ActRe: When Language Agents Enjoy Training Data Autonomy21 Mar
  35. 2024Embodied LLM Agents Learn to Cooperate in Organized Teams19 Mar
  36. 2024AutoGuide: Automated Generation and Selection of Context-Aware Guidelines for Large Language Model Agents13 Mar
  37. 2024KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents5 Mar
  38. 2024Language Agents as Optimizable Graphs26 Feb

50 newest of 77 All 77 (JSON)

Other references · 650

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  8. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  9. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  10. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  11. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  12. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
38 more
  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024Qwen2.5 Technical Reportcited by 4,942
  8. 2024GPT-4o System Cardcited by 4,588
  9. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  11. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  12. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  13. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  14. 2021Program Synthesis with Large Language Modelscited by 3,637
  15. 2020Longformer: The Long-Document Transformercited by 3,413
  16. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  17. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  18. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  19. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  20. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  21. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  22. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  23. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  24. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  25. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  26. 2022Emergent Abilities of Large Language Modelscited by 2,512
  27. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  28. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  29. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  30. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  31. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  32. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  33. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  34. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  35. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  36. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
  37. 2017Decoupled Weight Decay Regularizationcited by 1,831
  38. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745

50 most cited of 650 All 650 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 74; 2026: 52.

126 papers.

Sort:

By area:

  1. 2025Memory in the Age of AI Agentscited by 303
  2. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 284
  3. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 215
  4. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  5. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
  6. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 180
  7. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
  8. 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 152
  9. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 120
  10. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 116
  11. 2025Memp: Exploring Agent Procedural Memorycited by 103
  12. 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 94
38 more
  1. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
  2. 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 62
  3. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 50
  4. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
  5. 2025Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systemscited by 43
  6. 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AIcited by 42
  7. 2025Look Back to Reason Forward: Revisitable Memory for Long-Context LLM Agentscited by 38
  8. 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestrationcited by 35
  9. 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
  10. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Datacited by 29
  11. 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challengescited by 28
  12. 2025System-1.5 Reasoning: Traversal in Language and Latent Spaces with Dynamic Shortcutscited by 27
  13. 2025LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarioscited by 26
  14. 2025Get Experience from Practice: LLM Agents with Record & Replaycited by 23
  15. 2026Why Reasoning Fails to Plan: A Planning-Centric Analysis of Long-Horizon Decision Making in LLM Agentscited by 23
  16. 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMscited by 22
  17. 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skillscited by 22
  18. 2025Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarkingcited by 21
  19. 2025AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learningcited by 20
  20. 2026Beyond Task Completion: Revealing Corrupt Success in LLM Agents through Procedure-Aware Evaluationcited by 20
  21. 2025Oyster-I: Beyond Refusal -- Constructive Safety Alignment for Responsible Language Modelscited by 19
  22. 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?cited by 18
  23. 2025Concise Reasoning, Big Gains: Pruning Long Reasoning Trace with Difficulty-Aware Promptingcited by 15
  24. 2025Measuring and Augmenting Large Language Models for Solving Capture-the-Flag Challengescited by 15
  25. 2025RoboMemory: A Brain-inspired Multi-memory Agentic Framework for Interactive Environmental Learning in Physical Embodied Systemscited by 15
  26. 2025ReCode: Unify Plan and Action for Universal Granularity Controlcited by 15
  27. 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 15
  28. 2025A Vision for Access Control in LLM-based Agent Systemscited by 14
  29. 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoningcited by 14
  30. 2026Agent Primitives: Reusable Latent Building Blocks for Multi-Agent Systemscited by 14
  31. 2025HALO: Hierarchical Autonomous Logic-Oriented Orchestration for Multi-Agent LLM Systemscited by 13
  32. 2025PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Imagescited by 12
  33. 2025InteractComp: Evaluating Search Agents With Ambiguous Queriescited by 12
  34. 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
  35. 2026InfoPO: Information-Driven Policy Optimization for User-Centric Agentscited by 12
  36. 2025MapAgent: Trajectory-Constructed Memory-Augmented Planning for Mobile Task Automationcited by 11
  37. 2026AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systemscited by 11
  38. 2026Harnessing Agentic Evolutioncited by 11

50 most cited of 126 All 126 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025A Comprehensive Review of AI Agents: Transforming Possibilities in Technology and Beyond
  2. 2025Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligence
  3. 2025Towards Cognitive Synergy in LLM-Based Multi-Agent Systems: Integrating Theory of Mind and Critical Evaluation
  4. 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents
  5. 2025AI Agents: Evolution, Architecture, and Real-World Applications
  6. 2025Nature's Insight: A Novel Framework and Comprehensive Analysis of Agentic Reasoning Through the Lens of Neuroscience
  7. 2026A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AI
  8. 2026The Path Ahead for Agentic AI: Challenges and Opportunities