EvoAgentX: An Automated Framework for Evolving Agentic Workflows
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Multi-agent systems (MAS) have emerged as a powerful paradigm for orchestrating large language models (LLMs) and specialized tools to collaboratively address complex tasks. However, existing MAS frameworks often require manual workflow configuration and lack native support for dynamic evolution and performance optimization. In addition, many MAS optimization algorithms are not integrated into a unified framework. In this paper, we present EvoAgentX, an open-source platform that automates the generation, execution, and evolutionary optimization of multi-agent workflows. EvoAgentX employs a modular architecture consisting of five core layers: the basic components, agent, workflow, evolving, and evaluation layers. Specifically, within the evolving layer, EvoAgentX integrates three MAS optimization algorithms, TextGrad, AFlow, and MIPRO, to iteratively refine agent prompts, tool configurations, and workflow topologies. We evaluate EvoAgentX on HotPotQA, MBPP, and MATH for multi-hop reasoning, code generation, and mathematical problem solving, respectively, and further assess it on real-world tasks using GAIA. Experimental results show that EvoAgentX consistently achieves significant performance improvements, including a 7.44% increase in HotPotQA F1, a 10.00% improvement in MBPP pass@1, a 10.00% gain in MATH solve accuracy, and an overall accuracy improvement of up to 20.00% on GAIA. The source code is available at: https://github.com/EvoAgentX/EvoAgentX
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 40 references that are in the map. First posted on arXiv 4 Jul 2025.
Builds on
22 of 40 references.
Closest ancestors · 4
Same direction, newest first
- 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generation24 May
- 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization6 Feb
- 2024AutoFlow: Automated Workflow Generation for Large Language Model Agents1 Jul
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solving18 May
Other references · 18
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
- 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
- 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 156
- 2024AgentScope: A Flexible yet Robust Multi-Agent Platformcited by 120
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
6 more
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 106
- 2024Symbolic Learning Enables Self-Evolving Agentscited by 104
- 2024GTA: A Benchmark for General Tool Agentscited by 77
- 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
- 2024Adaptive In-conversation Team Building for Language Model Agentscited by 38
- 2024On the Structural Memory of LLM Agentscited by 37
Built on by
Citing papers per year: 2025: 4; 2026: 39.
43 papers.
Sort:
By area:
- 2025Memory in the Age of AI Agentscited by 285
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 37
- 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharingcited by 32
- 2025Enabling Agents to Communicate Entirely in Latent Spacecited by 31
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
- 2026RHO: Your Coding Agent is Secretly a Roboticistcited by 18
- 2026Position: Agentic Evolution is the Path to Evolving LLMscited by 13
- 2026Autogenesis: A Self-Evolving Agent Protocolcited by 12
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemscited by 9
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 9
- 2026Workflow-R1: Group Sub-sequence Policy Optimization for Multi-turn Workflow Constructioncited by 7
31 more
- 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?cited by 7
- 2026AgenticGEO: A Self-Evolving Agentic System for Generative Engine Optimizationcited by 6
- 2026Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptationcited by 5
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systemscited by 4
- 2026Learning Latency-Aware Orchestration for Multi-Agent Systemscited by 3
- 2026TrinityGuard: A Unified Framework for Safeguarding Multi-Agent Systemscited by 3
- 2026Let the Abyss Stare Back Adaptive Falsification for Autonomous Scientific Discoverycited by 3
- 2026DarwinNet: An Evolutionary Network Architecture for Agent-Driven Protocol Synthesiscited by 3
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
- 2026Bio-inspired Agentic Self-healing Framework for Resilient Distributed Computing Continuum Systemscited by 2
- 2026Self-Evolving Coding Agentscited by 2
- 2025IM-Chat: A Multi-agent LLM Framework Integrating Tool-Calling and Diffusion Modeling for Knowledge Transfer in Injection Molding Industrycited by 1
- 2026Towards Reliable ML Feature Engineering via Planning in Constrained-Topology of LLM Agentscited by 1
- 2026TheoremForge: Scaling up Formal Data Synthesis with Low-Budget Agentic Workflowcited by 1
- 2026DARWIN: Dynamic Agentically Rewriting Self-Improving Networkcited by 1
- 2026ST-EVO: Towards Generative Spatio-Temporal Evolution of Multi-Agent Communication Topologiescited by 1
- 2026Detect by Yourself: Self-Designing Agentic Workflows for Few-Shot Graph Anomaly Detectioncited by 1
- 2026Automating the Design of Embodied Agent Architecturescited by 1
- 2026FlowEvo: Self-Evolving Agents through the Co-Evolution of Workflows and Executable Skillscited by 1
- 2026TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answeringcited by 0
- 2026Differentiable Mixture-of-Agents Incentivizes Swarm Intelligence of Large Language Modelscited by 0
- 2026AgentCo-op: Retrieval-Based Synthesis of Interoperable Multi-Agent Workflowscited by 0
- 2026Serving Agentic Workflows with a Physical-Plan Compiler and Adaptive Runtimecited by 0
- 2026Learning Latency-Aware Orchestration for Multi-Agent Systemscited by 0
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Modelscited by 0
- 2026Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignmentcited by 0
- 2026Bilevel Coordinated Reflection: A Game-Theoretic Approach to Multi-Agent LLM Systemscited by 0
- 2026CALICO: A Human-Centered, Codebook-Aligned System for Annotationcited by 0
- 2026MoFlow: Multi-Objective Agentic Workflow Generationcited by 0
- 2026Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translationcited by 0
- 2026The Harness as the Only Mutable Surface: Compliance-Bounded Self-Evolution of LLM Agents in Credit Pipelines, with a Measured Admission Gatecited by 0
- 2026The Harness as the Only Mutable Surface: Compliance-Bounded Self-Evolution of LLM Agents in Credit Pipelines, with a Measured Admission Gate7 Oct 2026
- 2026Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translation29 Sep 2026
- 2026MoFlow: Multi-Objective Agentic Workflow Generation29 Sep 2026
- 2026CALICO: A Human-Centered, Codebook-Aligned System for Annotation13 Sep 2026
- 2026Bilevel Coordinated Reflection: A Game-Theoretic Approach to Multi-Agent LLM Systems2 Sep 2026
- 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?1 Sep 2026
- 2026Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment31 Aug 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces24 Aug 2026
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models11 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026Learning Latency-Aware Orchestration for Multi-Agent Systems15 Jul 2026
- 2026Serving Agentic Workflows with a Physical-Plan Compiler and Adaptive Runtime3 Jul 2026
31 more
- 2026Automating the Design of Embodied Agent Architectures29 Jun 2026
- 2026RHO: Your Coding Agent is Secretly a Roboticist15 Jun 2026
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry12 Jun 2026
- 2026Detect by Yourself: Self-Designing Agentic Workflows for Few-Shot Graph Anomaly Detection26 May 2026
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems21 May 2026
- 2026AgentCo-op: Retrieval-Based Synthesis of Interoperable Multi-Agent Workflows19 May 2026
- 2026Differentiable Mixture-of-Agents Incentivizes Swarm Intelligence of Large Language Models15 May 2026
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems10 May 2026
- 2026Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptation10 May 2026
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows7 May 2026
- 2026FlowEvo: Self-Evolving Agents through the Co-Evolution of Workflows and Executable Skills18 Apr 2026
- 2026Autogenesis: A Self-Evolving Agent Protocol16 Apr 2026
- 2026TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering13 Apr 2026
- 2026Let the Abyss Stare Back Adaptive Falsification for Autonomous Scientific Discovery30 Mar 2026
- 2026DarwinNet: An Evolutionary Network Architecture for Agent-Driven Protocol Synthesis27 Mar 2026
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents23 Mar 2026
- 2026TrinityGuard: A Unified Framework for Safeguarding Multi-Agent Systems16 Mar 2026
- 2026AgenticGEO: A Self-Evolving Agentic System for Generative Engine Optimization2 Mar 2026
- 2026ST-EVO: Towards Generative Spatio-Temporal Evolution of Multi-Agent Communication Topologies16 Feb 2026
- 2026DARWIN: Dynamic Agentically Rewriting Self-Improving Network5 Feb 2026
- 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharing4 Feb 2026
- 2026Workflow-R1: Group Sub-sequence Policy Optimization for Multi-turn Workflow Construction1 Feb 2026
- 2026Position: Agentic Evolution is the Path to Evolving LLMs30 Jan 2026
- 2026TheoremForge: Scaling up Formal Data Synthesis with Low-Budget Agentic Workflow24 Jan 2026
- 2026Towards Reliable ML Feature Engineering via Planning in Constrained-Topology of LLM Agents15 Jan 2026
- 2026Learning Latency-Aware Orchestration for Multi-Agent Systems15 Jan 2026
- 2026Bio-inspired Agentic Self-healing Framework for Resilient Distributed Computing Continuum Systems1 Jan 2026
- 2025Memory in the Age of AI Agents15 Dec 2025
- 2025Enabling Agents to Communicate Entirely in Latent Space12 Nov 2025
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents30 Sep 2025
- 2025IM-Chat: A Multi-agent LLM Framework Integrating Tool-Calling and Diffusion Modeling for Knowledge Transfer in Injection Molding Industry21 Jul 2025
- 2025Memory in the Age of AI Agentscited by 285
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
- 2025Enabling Agents to Communicate Entirely in Latent Spacecited by 31
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
- 2026RHO: Your Coding Agent is Secretly a Roboticistcited by 18
- 2026Position: Agentic Evolution is the Path to Evolving LLMscited by 13
- 2026Autogenesis: A Self-Evolving Agent Protocolcited by 12
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemscited by 9
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 9
- 2026Workflow-R1: Group Sub-sequence Policy Optimization for Multi-turn Workflow Constructioncited by 7
- 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?cited by 7
- 2026AgenticGEO: A Self-Evolving Agentic System for Generative Engine Optimizationcited by 6
12 most cited of 34 All 34 (JSON)
- 2026The Harness as the Only Mutable Surface: Compliance-Bounded Self-Evolution of LLM Agents in Credit Pipelines, with a Measured Admission Gate7 Oct 2026
- 2026Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translation29 Sep 2026
- 2026MoFlow: Multi-Objective Agentic Workflow Generation29 Sep 2026
- 2026Bilevel Coordinated Reflection: A Game-Theoretic Approach to Multi-Agent LLM Systems2 Sep 2026
- 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?1 Sep 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces24 Aug 2026
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models11 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026Learning Latency-Aware Orchestration for Multi-Agent Systems15 Jul 2026
- 2026Serving Agentic Workflows with a Physical-Plan Compiler and Adaptive Runtime3 Jul 2026
- 2026RHO: Your Coding Agent is Secretly a Roboticist15 Jun 2026
- 2026Detect by Yourself: Self-Designing Agentic Workflows for Few-Shot Graph Anomaly Detection26 May 2026
12 newest of 34 All 34 (JSON)
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 37
- 2026Let the Abyss Stare Back Adaptive Falsification for Autonomous Scientific Discoverycited by 3
- 2026DARWIN: Dynamic Agentically Rewriting Self-Improving Networkcited by 1
- 2026Automating the Design of Embodied Agent Architecturescited by 1
- 2026AgentCo-op: Retrieval-Based Synthesis of Interoperable Multi-Agent Workflowscited by 0
- 2026Automating the Design of Embodied Agent Architectures29 Jun 2026
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry12 Jun 2026
- 2026AgentCo-op: Retrieval-Based Synthesis of Interoperable Multi-Agent Workflows19 May 2026
- 2026Let the Abyss Stare Back Adaptive Falsification for Autonomous Scientific Discovery30 Mar 2026
- 2026DARWIN: Dynamic Agentically Rewriting Self-Improving Network5 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Fly
- 2026EvoMAS: Evolutionary Generation of Multi-Agent Systems
- 2026AgentFactory: Towards Automated Agentic System Design and Optimization
- 2026EvoMAS: Learning Execution-Time Workflows for Multi-Agent Systems
- 2026Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization
- 2026OptiMAS: Automatically Optimize Multi-Agent System
- 2026Learning to Evolve: A Self-Improving Framework for Multi-Agent Systems via Textual Parameter Graph Optimization
- 2026From Atomic Actions to Standard Operating Procedures: Iterative Tool Optimization for Self-Evolving LLM Agents