mlsanityData to 14 Oct 2026

SEW: Self-Evolving Agentic Workflows for Automated Code Generation

arXiv 2505.18646 ↗First posted 24 May 2025cs.SE cs.AI cs.CLcited by 20

On the map: LLM agents and tool use → Software engineering coding agents

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) have demonstrated effectiveness in code generation tasks. To enable LLMs to address more complex coding challenges, existing research has focused on crafting multi-agent systems with agentic workflows, where complex coding tasks are decomposed into sub-tasks, assigned to specialized agents. Despite their effectiveness, current approaches heavily rely on hand-crafted agentic workflows, with both agent topologies and prompts manually designed, which limits their ability to automatically adapt to different types of coding problems. To address these limitations and enable automated workflow design, we propose Self-Evolving Workflow (SEW), a novel self-evolving framework that automatically generates and optimises multi-agent workflows. Extensive experiments on three coding benchmark datasets, including the challenging LiveCodeBench, demonstrate that our SEW can automatically design agentic workflows and optimise them through self-evolution, bringing up to 12% improvement on LiveCodeBench compared to using the backbone LLM only. Furthermore, by investigating different representation schemes of workflow, we provide insights into the optimal way to encode workflow information with text.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 33 references that are in the map. First posted on arXiv 24 May 2025.

Builds on

19 of 33 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024PyBench: Evaluating LLM Agent on various real-world coding tasks23 Jul
  2. 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solving18 May
  3. 2024AIOS Compiler: LLM as Interpreter for Natural Language Programming and Flow Programming of AI Agents11 May

Other references · 16

  1. 2021Program Synthesis with Large Language Modelscited by 3,637
  2. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  3. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  4. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  5. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  6. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  7. 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 291
  8. 2023Structured Chain-of-Thought Prompting for Code Generationcited by 138
  9. 2023Large Language Models as Evolutionary Optimizerscited by 124
  10. 2024AgentScope: A Flexible yet Robust Multi-Agent Platformcited by 121
  11. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 113
  12. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 113
4 more
  1. 2024Symbolic Learning Enables Self-Evolving Agentscited by 106
  2. 2023TaskWeaver: A Code-First Agent Frameworkcited by 86
  3. 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agentscited by 40
  4. 2024On the effectiveness of Large Language Models for GitHub Workflowscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 15.

20 papers.

Sort:

By area:

  1. 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 94
  2. 2026Code as Agent Harnesscited by 47
  3. 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 44
  4. 2026Recursive Harness Self-Improvementcited by 32
  5. 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 24
  6. 2026HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?cited by 13
  7. 2026HarnessEvolve: Learning from Reference Trajectories for Reliable Agent Self-Evolutioncited by 9
  8. 2026Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptationcited by 6
  9. 2026AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?cited by 4
  10. 2025Polymath: A Self-Optimizing Agent with Dynamic Hierarchical Workflowcited by 2
  11. 2026Self-Evolving Coding Agentscited by 2
  12. 2025GLOW: Graph-Language Co-Encoding for Agentic Workflow Performance Predictioncited by 1
8 more
  1. 2025Knowledge-Guided Multi-Agent Framework for Application-Level Software Code Generationcited by 0
  2. 2026TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answeringcited by 0
  3. 2026AgentCo-op: Retrieval-Based Synthesis of Interoperable Multi-Agent Workflowscited by 0
  4. 2026Proxifield: Decentralized Multi-Agent Communication through Semantic Proximitycited by 0
  5. 2026MoFlow: Multi-Objective Agentic Workflow Generationcited by 0
  6. 2026Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translationcited by 0
  7. 2026Joint Workflow and Prompt Optimization for User Behavior Simulationcited by 0
  8. 2026CB-Orchestrator: Adaptive Workflow Optimization for LLM Agents via Contextual Banditscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026SEMAG: Self-Evolutionary Multi-Agent Code Generation
  2. 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimization
  3. 2025EvoFlow: Evolving Diverse Agentic Workflows On The Fly
  4. 2025A Self-Improving Coding Agent
  5. 2024CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
  6. 2026CURATE: Leveraging LLM Agents to Compose, Catalog, and Deploy Reproducible Workflows
  7. 2024AutoFlow: Automated Workflow Generation for Large Language Model Agents
  8. 2024AFlow: Automating Agentic Workflow Generation