mlsanityData to 14 Oct 2026

LoongFlow: Directed Evolutionary Search via a Cognitive Plan-Execute-Summarize Paradigm

arXiv 2512.24077 ↗First posted 30 Dec 2025cs.AIcited by 22

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

The transition from static Large Language Models (LLMs) to self-improving agents is hindered by the lack of structured reasoning in traditional evolutionary approaches. Existing methods often struggle with premature convergence and inefficient exploration in high-dimensional code spaces. To address these challenges, we introduce LoongFlow, a self-evolving agent framework that achieves state-of-the-art solution quality with significantly reduced computational costs. Unlike "blind" mutation operators, LoongFlow integrates LLMs into a cognitive "Plan-Execute-Summarize" (PES) paradigm, effectively mapping the evolutionary search to a reasoning-heavy process. To sustain long-term architectural coherence, we incorporate a hybrid evolutionary memory system. By synergizing Multi-Island models with MAP-Elites and adaptive Boltzmann selection, this system theoretically balances the exploration-exploitation trade-off, maintaining diverse behavioral niches to prevent optimization stagnation. We instantiate LoongFlow with a General Agent for algorithmic discovery and an ML Agent for pipeline optimization. Extensive evaluations on the AlphaEvolve benchmark and Kaggle competitions demonstrate that LoongFlow outperforms leading baselines (e.g., OpenEvolve, ShinkaEvolve) by up to 60% in evolutionary efficiency while discovering superior solutions. LoongFlow marks a substantial step forward in autonomous scientific discovery, enabling the generation of expert-level solutions with reduced computational overhead.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 14 of its 21 references that are in the map. First posted on arXiv 30 Dec 2025.

Builds on

14 of 21 references.

References · 14

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  8. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  9. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  10. 2023Large Language Models as Optimizerscited by 864
  11. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
  12. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
2 more
  1. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
  2. 2015Illuminating search spaces by mapping elitescited by 425

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 22.

22 papers.

Sort:

By area:

  1. 2026AVO: Agentic Variation Operators for Autonomous Evolutionary Searchcited by 24
  2. 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 22
  3. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
  4. 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 17
  5. 2026EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discoverycited by 6
  6. 2026ASI-Evolve: AI Accelerates AIcited by 5
  7. 2026TurboEvolve: Towards Fast and Robust LLM-Driven Program Evolutioncited by 3
  8. 2026Why Solve It Twice? Hierarchical Accumulation of Skills for Transfer-Efficient ML Engineeringcited by 3
  9. 2026ContextEvolve: Multi-Agent Context Compression for Systems Code Optimizationcited by 2
  10. 2026Harness Engineering for LLM-Driven GPU Kernel Generationcited by 2
  11. 2026What is Missing from AI Post-Training AI: An Empirical Analysiscited by 2
  12. 2026Automated near-term quantum algorithm discovery for molecular ground statescited by 1
10 more
  1. 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecturecited by 0
  2. 2026Agentic Discovery of Exchange-Correlation Density Functionalscited by 0
  3. 2026Moving the Mean Toward the Known Good, Not Beyond It: What Inference-Time Interventions and Weight Consolidation Buy in Open-Ended Generationcited by 0
  4. 2026Strategy Accumulation and Guided Execution for Automated LLM Fine-Tuningcited by 0
  5. 2026Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Searchcited by 0
  6. 2026HeurEvo: Agentic Evolution of Hybrid Solver-Augmented Heuristics for Time-Critical Mathematical Optimizationcited by 0
  7. 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agentscited by 0
  8. 2026Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agentscited by 0
  9. 2026Assembling Insights for Agentic Machine Learning Engineering Systemscited by 0
  10. 2026EvoAlloc: A Self-Evolving Resource Allocation Agent for Efficient Program Evolutioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
  2. 2025CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimization
  3. 2025Evolutionary thoughts: integration of large language models and evolutionary algorithms
  4. 2025Evolution without an Oracle: Driving Effective Evolution with LLM Judges
  5. 2026What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Search
  6. 2026AlgoEvo: Self-Evolving Agentic Search for Automated Algorithm Discovery
  7. 2026Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization
  8. 2026MAGE: Multi-Agent Self-Evolution with Co-Evolutionary Knowledge Graphs