mlsanityData to 7 Oct 2026

FlowEvo: Self-Evolving Agents through the Co-Evolution of Workflows and Executable Skills

arXiv 2607.21596 ↗First posted 18 Apr 2026cs.AIcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

also in 1 more
Abstract (arXiv)

Large language model agents can adapt to complex tasks by constructing workflows at inference time, but procedures discovered in one episode are usually discarded after execution. Existing skill libraries provide reusable executable routines, but are typically assembled offline and do not grow from the agent's own workflows. We introduce FlowEvo, a training-free framework in which workflows and skills co-evolve at inference time. FlowEvo compiles successful workflows into callable skills, stores them in a persistent bank, and uses retrieved skills either through direct execution or as context for constructing new workflows. It also tracks each skill's downstream utility and suppresses skills that cause negative transfer. Using a shared GPT-4o-mini backbone, FlowEvo achieves the highest accuracy among 8 baselines on the full standard splits of ALFWorld, HumanEval, MBPP, GSM8K, and MATH-500. On ALFWorld, it reaches 85.6%, 26.4 points above the strongest baseline, while using roughly one third as many tokens. Across 10 base models spanning 7B to 671B parameters, FlowEvo outperforms ExpeL in 49 of 50 model-dataset comparisons. Code is available at https://github.com/DEFENSE-SEU/FlowEvo.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 59 of its 69 references that are in the map. First posted on arXiv 18 Apr 2026.

Builds on

59 of 69 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026ORCH: many analyses, one merge-a deterministic multi-agent orchestrator for discrete-choice reasoning with EMA-guided routing2 Feb
  2. 2025Self-Generated In-Context Examples Improve LLM Agents for Sequential Decision-Making Tasks1 May
  3. 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
  4. 2023Cognitive Architectures for Language Agents5 Sep
  5. 2023ExpeL: LLM Agents Are Experiential Learners20 Aug

Other references · 54

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2021Program Synthesis with Large Language Modelscited by 3,509
  7. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  9. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  10. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  11. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  12. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
38 more
  1. 2024Self-Rewarding Language Modelscited by 654
  2. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  3. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  4. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  5. 2024Agent Workflow Memorycited by 342
  6. 2023Large Language Models as Tool Makerscited by 293
  7. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  8. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 252
  9. 2024TextGrad: Automatic "Differentiation" via Textcited by 250
  10. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
  11. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
  12. 2024Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizingcited by 123
  13. 2023CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsetscited by 122
  14. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 113
  15. 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 91
  16. 2023CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Modelscited by 90
  17. 2023CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalizationcited by 88
  18. 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
  19. 2024TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Taskscited by 70
  20. 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
  21. 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimizationcited by 50
  22. 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 48
  23. 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 43
  24. 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 36
  25. 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 35
  26. 2026CUA-Skill: Develop Skills for Computer Using Agentcited by 32
  27. 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
  28. 2025Agentic Plan Caching: Test-Time Memory for Fast and Cost-Efficient LLM Agentscited by 23
  29. 2025DyFlow: Dynamic Workflow Framework for Agentic Reasoningcited by 22
  30. 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
  31. 2025RobustFlow: Towards Robust Agentic Workflow Generationcited by 19
  32. 2025Automatic Failure Attribution and Critical Step Prediction Method for Multi-Agent Systems Based on Causal Inferencecited by 18
  33. 2025MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary Programmingcited by 14
  34. 2025Code2MCP: Transforming Code Repositories into MCP Servicescited by 10
  35. 2025Foam-Agent: A Large Language Model-Based Multi-Agent Framework for Automating Computational Fluid Dynamics Workflowscited by 9
  36. 2026Live-Evo: Online Evolution of Agentic Memory from Continuous Feedbackcited by 8
  37. 2025DioR: Adaptive Cognitive Detection and Contextual Retrieval Optimization for Dynamic Retrieval-Augmented Generationcited by 7
  38. 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 7

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026It Takes Workflows to Evolve Better Workflows
  2. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries
  3. 2026Evoflux: Inference-Time Evolution of Executable Tool Workflows for Compact Agents
  4. 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generation
  5. 2026SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization
  6. 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
  7. 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems
  8. 2026FreeEvolve: Learning to Evolve Beyond Fixed Loops