CDEoH: Category-Driven Automatic Algorithm Design With Large Language Models
Not on the map. Why?
Abstract (arXiv)
With the rapid advancement of large language models (LLMs), LLM-based heuristic search methods have demonstrated strong capabilities in automated algorithm generation. However, their evolutionary processes often suffer from instability and premature convergence. Existing approaches mainly address this issue through prompt engineering or by jointly evolving thought and code, while largely overlooking the critical role of algorithmic category diversity in maintaining evolutionary stability. To this end, we propose Category Driven Automatic Algorithm Design with Large Language Models (CDEoH), which explicitly models algorithm categories and jointly balances performance and category diversity in population management, enabling parallel exploration across multiple algorithmic paradigms. Extensive experiments on representative combinatorial optimization problems across multiple scales demonstrate that CDEoH effectively mitigates convergence toward a single evolutionary direction, significantly enhancing evolutionary stability and achieving consistently superior average performance across tasks and scales.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
21 of 44 references.
References · 21
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 876
- 2023Large Language Models as Optimizerscited by 830
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 229
- 2023Planning with Large Language Models for Code Generationcited by 179
9 more
- 2022Evolution through Large Modelscited by 131
- 2023Learning Performance-Improving Code Editscited by 103
- 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
- 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
- 2024Evolving Code with A Large Language Modelcited by 42
- 2023Fully Autonomous Programming with Large Language Modelscited by 31
- 2024Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Modelscited by 22
- 2025ARS: Automatic Routing Solver with Large Language Modelscited by 13
- 2025Multimodal LLM-assisted Evolutionary Search for Programmatic Control Policiescited by 8
Built on by
Not cited yet.