From Understanding to Excelling: Template-Free Algorithm Design through Structural-Functional Co-Evolution
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have greatly accelerated the automation of algorithm generation and optimization. However, current methods such as EoH and FunSearch mainly rely on predefined templates and expert-specified functions that focus solely on the local evolution of key functionalities. Consequently, they fail to fully leverage the synergistic benefits of the overall architecture and the potential of global optimization. In this paper, we introduce an end-to-end algorithm generation and optimization framework based on LLMs. Our approach utilizes the deep semantic understanding of LLMs to convert natural language requirements or human-authored papers into code solutions, and employs a two-dimensional co-evolution strategy to optimize both functional and structural aspects. This closed-loop process spans problem analysis, code generation, and global optimization, automatically identifying key algorithm modules for multi-level joint optimization and continually enhancing performance and design innovation. Extensive experiments demonstrate that our method outperforms traditional local optimization approaches in both performance and innovation, while also exhibiting strong adaptability to unknown environments and breakthrough potential in structural design. By building on human research, our framework generates and optimizes novel algorithms that surpass those designed by human experts, broadening the applicability of LLMs for algorithm design and providing a novel solution pathway for automated algorithm development.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 15 of its 38 references that are in the map. First posted on arXiv 13 Mar 2025.
Builds on
15 of 38 references.
References · 15
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 274
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 264
- 2020AutoML-Zero: Evolving Machine Learning Algorithms From Scratchcited by 139
- 2018Automated Algorithm Selection: Survey and Perspectivescited by 112
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 69
- 2024Multi-objective Evolution of Heuristic Using Large Language Modelcited by 54
- 2023Towards Optimizing with Large Language Modelscited by 34
- 2024In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristicscited by 28
- 2024Large Language Model-Based Evolutionary Optimizer: Reasoning with elitismcited by 27
- 2024Evolve Cost-aware Acquisition Functions Using Large Language Modelscited by 17
- 2024Automating the Practice of Science -- Opportunities, Challenges, and Implicationscited by 17
- 2024Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithmscited by 12
3 more
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.