LoongFlow: Directed Evolutionary Search via a Cognitive Plan-Execute-Summarize Paradigm
On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents
Abstract (arXiv)
The transition from static Large Language Models (LLMs) to self-improving agents is hindered by the lack of structured reasoning in traditional evolutionary approaches. Existing methods often struggle with premature convergence and inefficient exploration in high-dimensional code spaces. To address these challenges, we introduce LoongFlow, a self-evolving agent framework that achieves state-of-the-art solution quality with significantly reduced computational costs. Unlike "blind" mutation operators, LoongFlow integrates LLMs into a cognitive "Plan-Execute-Summarize" (PES) paradigm, effectively mapping the evolutionary search to a reasoning-heavy process. To sustain long-term architectural coherence, we incorporate a hybrid evolutionary memory system. By synergizing Multi-Island models with MAP-Elites and adaptive Boltzmann selection, this system theoretically balances the exploration-exploitation trade-off, maintaining diverse behavioral niches to prevent optimization stagnation. We instantiate LoongFlow with a General Agent for algorithmic discovery and an ML Agent for pipeline optimization. Extensive evaluations on the AlphaEvolve benchmark and Kaggle competitions demonstrate that LoongFlow outperforms leading baselines (e.g., OpenEvolve, ShinkaEvolve) by up to 60% in evolutionary efficiency while discovering superior solutions. LoongFlow marks a substantial step forward in autonomous scientific discovery, enabling the generation of expert-level solutions with reduced computational overhead.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 14 of its 21 references that are in the map. First posted on arXiv 30 Dec 2025.
Builds on
14 of 21 references.
References · 14
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
- 2023Large Language Models as Optimizerscited by 864
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
2 more
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2015Illuminating search spaces by mapping elitescited by 425
Built on by
Citing papers per year: 2026: 22.
22 papers.
Sort:
By area:
- 2026AVO: Agentic Variation Operators for Autonomous Evolutionary Searchcited by 24
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 22
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 17
- 2026EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discoverycited by 6
- 2026ASI-Evolve: AI Accelerates AIcited by 5
- 2026TurboEvolve: Towards Fast and Robust LLM-Driven Program Evolutioncited by 3
- 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineeringcited by 3
- 2026ContextEvolve: Multi-Agent Context Compression for Systems Code Optimizationcited by 2
- 2026Harness Engineering for LLM-Driven GPU Kernel Generationcited by 2
- 2026What is Missing from AI Post-Training AI: An Empirical Analysiscited by 2
- 2026Automated near-term quantum algorithm discovery for molecular ground statescited by 1
10 more
- 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecturecited by 0
- 2026Agentic Discovery of Exchange-Correlation Density Functionalscited by 0
- 2026Moving the Mean Toward the Known Good, Not Beyond It: What Inference-Time Interventions and Weight Consolidation Buy in Open-Ended Generationcited by 0
- 2026Strategy Accumulation and Guided Execution for Automated LLM Fine-Tuningcited by 0
- 2026Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Searchcited by 0
- 2026HeurEvo: Agentic Evolution of Hybrid Solver-Augmented Heuristics for Time-Critical Mathematical Optimizationcited by 0
- 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agentscited by 0
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agentscited by 0
- 2026Assembling Insights for Agentic Machine Learning Engineering Systemscited by 0
- 2026EvoAlloc: A Self-Evolving Resource Allocation Agent for Efficient Program Evolutioncited by 0
- 2026EvoAlloc: A Self-Evolving Resource Allocation Agent for Efficient Program Evolution8 Oct 2026
- 2026Assembling Insights for Agentic Machine Learning Engineering Systems4 Oct 2026
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agents1 Oct 2026
- 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents1 Oct 2026
- 2026HeurEvo: Agentic Evolution of Hybrid Solver-Augmented Heuristics for Time-Critical Mathematical Optimization28 Sep 2026
- 2026Strategy Accumulation and Guided Execution for Automated LLM Fine-Tuning6 Sep 2026
- 2026Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Search28 Aug 2026
- 2026Moving the Mean Toward the Known Good, Not Beyond It: What Inference-Time Interventions and Weight Consolidation Buy in Open-Ended Generation28 Aug 2026
- 2026What is Missing from AI Post-Training AI: An Empirical Analysis19 Aug 2026
- 2026Harness Engineering for LLM-Driven GPU Kernel Generation20 Jul 2026
- 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineering29 Jun 2026
- 2026EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discovery11 Jun 2026
10 more
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinement10 Jun 2026
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms7 May 2026
- 2026Agentic Discovery of Exchange-Correlation Density Functionals6 May 2026
- 2026Toward Autonomous Long-Horizon Engineering for ML Research14 Apr 2026
- 2026TurboEvolve: Towards Fast and Robust LLM-Driven Program Evolution12 Apr 2026
- 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecture8 Apr 2026
- 2026ASI-Evolve: AI Accelerates AI31 Mar 2026
- 2026Automated near-term quantum algorithm discovery for molecular ground states27 Mar 2026
- 2026AVO: Agentic Variation Operators for Autonomous Evolutionary Search25 Mar 2026
- 2026ContextEvolve: Multi-Agent Context Compression for Systems Code Optimization1 Feb 2026
- 2026AVO: Agentic Variation Operators for Autonomous Evolutionary Searchcited by 24
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 17
- 2026EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discoverycited by 6
- 2026ContextEvolve: Multi-Agent Context Compression for Systems Code Optimizationcited by 2
- 2026HeurEvo: Agentic Evolution of Hybrid Solver-Augmented Heuristics for Time-Critical Mathematical Optimizationcited by 0
- 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agentscited by 0
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agentscited by 0
- 2026Assembling Insights for Agentic Machine Learning Engineering Systemscited by 0
- 2026EvoAlloc: A Self-Evolving Resource Allocation Agent for Efficient Program Evolutioncited by 0
- 2026EvoAlloc: A Self-Evolving Resource Allocation Agent for Efficient Program Evolution8 Oct 2026
- 2026Assembling Insights for Agentic Machine Learning Engineering Systems4 Oct 2026
- 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agents1 Oct 2026
- 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents1 Oct 2026
- 2026HeurEvo: Agentic Evolution of Hybrid Solver-Augmented Heuristics for Time-Critical Mathematical Optimization28 Sep 2026
- 2026EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discovery11 Jun 2026
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms7 May 2026
- 2026Toward Autonomous Long-Horizon Engineering for ML Research14 Apr 2026
- 2026AVO: Agentic Variation Operators for Autonomous Evolutionary Search25 Mar 2026
- 2026ContextEvolve: Multi-Agent Context Compression for Systems Code Optimization1 Feb 2026
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 22
- 2026ASI-Evolve: AI Accelerates AIcited by 5
- 2026TurboEvolve: Towards Fast and Robust LLM-Driven Program Evolutioncited by 3
- 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineeringcited by 3
- 2026Harness Engineering for LLM-Driven GPU Kernel Generationcited by 2
- 2026What is Missing from AI Post-Training AI: An Empirical Analysiscited by 2
- 2026Automated near-term quantum algorithm discovery for molecular ground statescited by 1
- 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecturecited by 0
- 2026Agentic Discovery of Exchange-Correlation Density Functionalscited by 0
- 2026Moving the Mean Toward the Known Good, Not Beyond It: What Inference-Time Interventions and Weight Consolidation Buy in Open-Ended Generationcited by 0
- 2026Strategy Accumulation and Guided Execution for Automated LLM Fine-Tuningcited by 0
- 2026Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Searchcited by 0
- 2026Strategy Accumulation and Guided Execution for Automated LLM Fine-Tuning6 Sep 2026
- 2026Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Search28 Aug 2026
- 2026Moving the Mean Toward the Known Good, Not Beyond It: What Inference-Time Interventions and Weight Consolidation Buy in Open-Ended Generation28 Aug 2026
- 2026What is Missing from AI Post-Training AI: An Empirical Analysis19 Aug 2026
- 2026Harness Engineering for LLM-Driven GPU Kernel Generation20 Jul 2026
- 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineering29 Jun 2026
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinement10 Jun 2026
- 2026Agentic Discovery of Exchange-Correlation Density Functionals6 May 2026
- 2026TurboEvolve: Towards Fast and Robust LLM-Driven Program Evolution12 Apr 2026
- 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecture8 Apr 2026
- 2026ASI-Evolve: AI Accelerates AI31 Mar 2026
- 2026Automated near-term quantum algorithm discovery for molecular ground states27 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- 2025CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimization
- 2025Evolutionary thoughts: integration of large language models and evolutionary algorithms
- 2025Evolution without an Oracle: Driving Effective Evolution with LLM Judges
- 2026What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Search
- 2026AlgoEvo: Self-Evolving Agentic Search for Automated Algorithm Discovery
- 2026Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization
- 2026MAGE: Multi-Agent Self-Evolution with Co-Evolutionary Knowledge Graphs