EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The rise of powerful large language models (LLMs) has spurred a new trend in building LLM-based autonomous agents for solving complex tasks, especially multi-agent systems. Despite the remarkable progress, we notice that existing works are heavily dependent on human-designed frameworks, which greatly limits the functional scope and scalability of agent systems. How to automatically extend the specialized agent to multi-agent systems to improve task-solving capability still remains a significant challenge. In this paper, we introduce EvoAgent, a generic method to automatically extend specialized agents to multi-agent systems via the evolutionary algorithm, thereby improving the effectiveness of LLM-based agents in solving tasks. Specifically, we consider the existing agent frameworks as the initial individual and then apply a series of evolutionary operators (e.g., mutation, crossover, selection, etc.) to generate multiple agents with diverse settings. Experimental results across various tasks show that EvoAgent can significantly enhance the task-solving capability of LLM-based agents, and can be generalized to any LLM-based agent framework to extend them into multi-agent systems. Resources are available at https://evo-agent.github.io/.
Key facts. Cited by 109 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 53 references that are in the map. First posted on arXiv 20 Jun 2024.
Builds on
28 of 53 references.
Closest ancestors · 7
Same direction, newest first
- 2024TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation8 Feb
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agents2 Feb
- 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks27 May
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 21
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
- 2014Memory Networkscited by 354
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
9 more
- 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
- 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
- 2024EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instructioncited by 153
- 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 140
- 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 138
- 2023EvoPrompting: Language Models for Code-Level Neural Architecture Searchcited by 129
- 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teamingcited by 85
- 2023Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction Arenacited by 78
- 2023Distilling Script Knowledge from Large Language Models for Constrained Language Planningcited by 45
Built on by
Citing papers per year: 2024: 4; 2025: 53; 2026: 52.
109 papers.
Sort:
By area:
- 2024Automated Design of Agentic Systemscited by 360
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
- 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systemscited by 108
- 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 102
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 74
- 2025Evolving Deeper LLM Thinkingcited by 58
- 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
38 more
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 49
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 43
- 2025EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systemscited by 34
- 2025Generative to Agentic AI: Survey, Conceptualization, and Challengescited by 32
- 2025Adaptive Graph Pruning for Multi-Agent Communicationcited by 28
- 2025A Comprehensive Survey on Multi-Agent Cooperative Decision-Making: Scenarios, Approaches, Challenges and Perspectivescited by 27
- 2025AutoPDL: Automatic Prompt Optimization for LLM Agentscited by 27
- 2025CoMAS: Co-Evolving Multi-Agent Systems via Interaction Rewardscited by 27
- 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervisioncited by 26
- 2025From Debate to Equilibrium: Belief-Driven Multi-Agent LLM Reasoning via Bayesian Nash Equilibriumcited by 24
- 2025Difficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflowscited by 23
- 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generationcited by 18
- 2025SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligencecited by 17
- 2025MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machinescited by 17
- 2025Agent Exchange: Shaping the Future of AI Agent Economicscited by 15
- 2025Nature-Inspired Population-Based Evolution of Large Language Modelscited by 14
- 2025AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Searchcited by 14
- 2025AgentBreeder: Mitigating the AI Safety Risks of Multi-Agent Scaffolds via Self-Improvementcited by 13
- 2025TP-RAG: Benchmarking Retrieval-Augmented Large Language Model Agents for Spatiotemporal-Aware Travel Planningcited by 12
- 2025AdsQA: Towards Advertisement Video Understandingcited by 12
- 2025Blueprint First, Model Second: A Framework for Deterministic LLM Workflowcited by 11
- 2025AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaborationcited by 10
- 2025Alita-G: Self-Evolving Generative Agent for Agent Generationcited by 10
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillationcited by 10
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 10
- 2025RETAIL: Towards Real-world Travel Planning for Large Language Modelscited by 9
- 2024ReDel: A Toolkit for LLM-Powered Recursive Multi-Agent Systemscited by 8
- 2025EvoEmo: Towards Evolved Emotional Policies for Adversarial LLM Agents in Multi-Turn Price Negotiationcited by 8
- 2025AgentArch: A Comprehensive Benchmark to Evaluate Agent Architectures in Enterprisecited by 8
- 2024LLM-Virus: Evolutionary Jailbreak Attack on Large Language Modelscited by 7
- 2025BOAD: Discovering Hierarchical Software Engineering Agents via Bandit Optimizationcited by 7
- 2026ABSTRAL: Automatic Design of Multi-Agent Systems Through Iterative Refinement and Topology Optimizationcited by 6
- 2025Tournament of Prompts: Evolving LLM Instructions Through Structured Debates and Elo Ratingscited by 5
- 2025Toward Autonomous Engineering Design: A Knowledge-Guided Multi-Agent Frameworkcited by 5
- 2026A-MapReduce: Executing Wide Search via Agentic MapReducecited by 5
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generationcited by 5
- 2025Cross-Task Experiential Learning on LLM-based Multi-Agent Collaborationcited by 4
- 2025InfiAgent: Self-Evolving Pyramid Agent Framework for Infinite Scenarioscited by 4
50 most cited of 109 All 109 (JSON)
- 2026Topological Coherence for Self-evolving Multi-agent Systems29 Sep 2026
- 2026EpiCon: Collective Agent Learning through Co-Evolving Multimodal Memory29 Sep 2026
- 2026MACE: Memory-Agent Co-Evolution with Adaptive Memory Graphs for Multi-Agent Systems18 Sep 2026
- 2026HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses14 Sep 2026
- 2026MOAE: Multi-Objective Agent Evolution with Pareto-Preserving Search5 Sep 2026
- 2026Behavior2Trip: Towards Personalized Travel Planning via User Behavior Trajectory27 Aug 2026
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution26 Aug 2026
- 2026OptiMAS: Automatically Optimize Multi-Agent System22 Aug 2026
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
- 2026MetaVideoAgent: Automated Video-Agent Evolution for Long-Form Video Understanding5 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026Adaptive Graph-of-Islands Evolution for Automatic Feature Engineering with LLMs25 Jul 2026
38 more
- 2026Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolution19 Jul 2026
- 2026Fantastic Adaptive Taxonomies and How to Use Them17 Jul 2026
- 2026AnovaX: A Local, Multi-Agent Voice Assistant with LLM Planning, Typed Executors, and Adaptive Recovery16 Jul 2026
- 2026Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning12 Jul 2026
- 2026At Equal Inference Cost, Multi-Agent Structure Does Not Beat a Single Frozen Agent25 Jun 2026
- 2026Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems17 Jun 2026
- 2026DICE: Entropy-Regularized Equilibrium Selection for Stable Multi-Agent LLM Coordination6 Jun 2026
- 2026Do More Agents Help? Controlled and Protocol-Aligned Evaluation of LLM Agent Workflows4 Jun 2026
- 2026Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis2 Jun 2026
- 2026EvoPool: Evolutionary Programmatic Annotation for Label-Efficient Specialized Supervision1 Jun 2026
- 2026EvoGens: A Population-Based Heuristic Search Framework for Scientific Idea Generation29 May 2026
- 2026Multi-Agent Coordination Adaptation via Structure-Guided Orchestration25 May 2026
- 2026LLM-driven design of physics-constrained constitutive models: two agents are better than one22 May 2026
- 2026Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Induction18 May 2026
- 2026Reinforced Collaboration in Multi-Agent Flow Networks13 May 2026
- 2026State-Centric Decision Process12 May 2026
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems12 May 2026
- 2026EVOCHAMBER: Test-Time Co-evolution of Multi-Agent System at Individual, Team, and Population Scales11 May 2026
- 2026Swarm Skills: A Portable, Self-Evolving Multi-Agent System Specification for Coordination Engineering11 May 2026
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generation11 May 2026
- 2026EvoMAS: Learning Execution-Time Workflows for Multi-Agent Systems9 May 2026
- 2026When Agents Evolve, Institutions Follow30 Apr 2026
- 2026OxyGent: Making Multi-Agent Systems Modular, Observable, and Evolvable via Oxy Abstraction28 Apr 2026
- 2026Decoupled Travel Planning with Behavior Forest23 Apr 2026
- 2026Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization20 Apr 2026
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation13 Apr 2026
- 2026FlowPIE: Test-Time Scientific Idea Evolution with Flow-Guided Literature Exploration31 Mar 2026
- 2026Mimosa Framework: Toward Evolving Multi-Agent Systems for Scientific Research30 Mar 2026
- 2026ABSTRAL: Automatic Design of Multi-Agent Systems Through Iterative Refinement and Topology Optimization24 Mar 2026
- 2026Unified-MAS: Universally Generating Domain-Specific Nodes for Empowering Automatic Multi-Agent Systems23 Mar 2026
- 2026An Alternative Trajectory for Generative AI14 Mar 2026
- 2026Efficient and Interpretable Multi-Agent LLM Routing via Ant Colony Optimization13 Mar 2026
- 2026COMIC: Agentic Sketch Comedy Generation11 Mar 2026
- 2026HiMAP-Travel: Hierarchical Multi-Agent Planning for Long-Horizon Constrained Travel5 Mar 2026
- 2026MAS-on-the-Fly: In-Context Structural Adaptation of LLM-Based Multi-Agent Systems14 Feb 2026
- 2026E-VAds: An E-commerce Short Videos Understanding Benchmark for MLLMs9 Feb 2026
- 2026Towards Adaptive, Scalable, and Robust Coordination of LLM Agents: A Dynamic Ad-Hoc Networking Perspective8 Feb 2026
- 2026EvoMAS: Evolutionary Generation of Multi-Agent Systems6 Feb 2026
50 newest of 109 All 109 (JSON)
- 2024Automated Design of Agentic Systemscited by 360
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
- 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 102
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 49
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 43
- 2025EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systemscited by 34
- 2025Generative to Agentic AI: Survey, Conceptualization, and Challengescited by 32
- 2025Adaptive Graph Pruning for Multi-Agent Communicationcited by 28
12 most cited of 68 All 68 (JSON)
- 2026MACE: Memory-Agent Co-Evolution with Adaptive Memory Graphs for Multi-Agent Systems18 Sep 2026
- 2026HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses14 Sep 2026
- 2026MOAE: Multi-Objective Agent Evolution with Pareto-Preserving Search5 Sep 2026
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution26 Aug 2026
- 2026OptiMAS: Automatically Optimize Multi-Agent System22 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026AnovaX: A Local, Multi-Agent Voice Assistant with LLM Planning, Typed Executors, and Adaptive Recovery16 Jul 2026
- 2026At Equal Inference Cost, Multi-Agent Structure Does Not Beat a Single Frozen Agent25 Jun 2026
- 2026Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems17 Jun 2026
- 2026DICE: Entropy-Regularized Equilibrium Selection for Stable Multi-Agent LLM Coordination6 Jun 2026
- 2026Do More Agents Help? Controlled and Protocol-Aligned Evaluation of LLM Agent Workflows4 Jun 2026
- 2026Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis2 Jun 2026
12 newest of 68 All 68 (JSON)
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
- 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systemscited by 108
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 74
- 2025Evolving Deeper LLM Thinkingcited by 58
- 2025From Debate to Equilibrium: Belief-Driven Multi-Agent LLM Reasoning via Bayesian Nash Equilibriumcited by 24
- 2025EvoEmo: Towards Evolved Emotional Policies for Adversarial LLM Agents in Multi-Turn Price Negotiationcited by 8
- 2025BOAD: Discovering Hierarchical Software Engineering Agents via Bandit Optimizationcited by 7
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generationcited by 5
- 2025Explore-Execute Chain: Towards an Efficient Structured Reasoning Paradigmcited by 2
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
- 2026Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolutioncited by 1
- 2026Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimizationcited by 0
- 2026Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolution19 Jul 2026
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generation11 May 2026
- 2026Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization20 Apr 2026
- 2025BOAD: Discovering Hierarchical Software Engineering Agents via Bandit Optimization29 Dec 2025
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents20 Oct 2025
- 2025Explore-Execute Chain: Towards an Efficient Structured Reasoning Paradigm28 Sep 2025
- 2025EvoEmo: Towards Evolved Emotional Policies for Adversarial LLM Agents in Multi-Turn Price Negotiation4 Sep 2025
- 2025From Debate to Equilibrium: Belief-Driven Multi-Agent LLM Reasoning via Bayesian Nash Equilibrium9 Jun 2025
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment22 Apr 2025
- 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems12 Apr 2025
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training20 Jan 2025
- 2025Evolving Deeper LLM Thinking17 Jan 2025
- 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
- 2025Nature-Inspired Population-Based Evolution of Large Language Modelscited by 14
- 2025AdsQA: Towards Advertisement Video Understandingcited by 12
- 2025Blueprint First, Model Second: A Framework for Deterministic LLM Workflowcited by 11
- 2025RETAIL: Towards Real-world Travel Planning for Large Language Modelscited by 9
- 2025Tournament of Prompts: Evolving LLM Instructions Through Structured Debates and Elo Ratingscited by 5
- 2026Fantastic Adaptive Taxonomies and How to Use Themcited by 4
- 2025Ontologies in Design: How Imagining a Tree Reveals Possibilites and Assumptions in Large Language Modelscited by 3
- 2025A Knowledge-driven Adaptive Collaboration of LLMs for Enhancing Medical Decision-makingcited by 3
- 2026E-VAds: An E-commerce Short Videos Understanding Benchmark for MLLMscited by 3
- 2026Swarm Skills: A Portable, Self-Evolving Multi-Agent System Specification for Coordination Engineeringcited by 3
- 2026EVOCHAMBER: Test-Time Co-evolution of Multi-Agent System at Individual, Team, and Population Scalescited by 3
12 most cited of 27 All 27 (JSON)
- 2026Topological Coherence for Self-evolving Multi-agent Systems29 Sep 2026
- 2026EpiCon: Collective Agent Learning through Co-Evolving Multimodal Memory29 Sep 2026
- 2026Behavior2Trip: Towards Personalized Travel Planning via User Behavior Trajectory27 Aug 2026
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
- 2026MetaVideoAgent: Automated Video-Agent Evolution for Long-Form Video Understanding5 Aug 2026
- 2026Adaptive Graph-of-Islands Evolution for Automatic Feature Engineering with LLMs25 Jul 2026
- 2026Fantastic Adaptive Taxonomies and How to Use Them17 Jul 2026
- 2026Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning12 Jul 2026
- 2026EvoPool: Evolutionary Programmatic Annotation for Label-Efficient Specialized Supervision1 Jun 2026
- 2026EvoGens: A Population-Based Heuristic Search Framework for Scientific Idea Generation29 May 2026
- 2026State-Centric Decision Process12 May 2026
- 2026EVOCHAMBER: Test-Time Co-evolution of Multi-Agent System at Individual, Team, and Population Scales11 May 2026
12 newest of 27 All 27 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026EvoAgent: An Evolvable Agent Framework with Skill Learning and Multi-Agent Delegation
- 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments
- 2024LLM2TEA: An Agentic AI Designer for Discovery with Generative Evolutionary Multitasking
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges
- 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agents
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems
- 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolution