Large Language Models and Evolutionary Computation: A Critical Review of Bidirectional Interaction, Automated Algorithm Design, and Co-Adaptive Systems
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) and Evolutionary Computation (EC) are increasingly being combined to support automated optimization, algorithm design, and adaptive decision-making. This survey reviews the bidirectional interaction between these two paradigms and examines how their complementary strengths can be leveraged in hybrid intelligent systems. First, we analyze how EC can enhance LLM-based systems through prompt optimization, hyperparameter tuning, and architecture search. Second, we review how LLMs can im- prove EC by supporting metaheuristic design, surrogate reasoning, adaptive operator control, and heuristic generation. We further discuss emerging co-adaptive frameworks in which LLMs and EC interact through iterative feedback loops. Beyond summarizing recent developments, the survey provides a structured perspec- tive on interaction mechanisms, application patterns, and methodological challenges, including computational cost, reproducibility, interpretability, benchmarking, and generalization. The paper concludes by outlining open research questions and future directions for developing more robust, transparent, and scalable LLM-EC systems.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 63 of its 96 references that are in the map. First posted on arXiv 21 May 2025.
Builds on
63 of 96 references.
References · 63
- 2023A Survey of Large Language Modelscited by 2,576
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2024Large Language Models: A Surveycited by 525
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2022Prompt-aligned Gradient for Prompt Tuningcited by 341
- 2023Explainability for Large Language Models: A Surveycited by 333
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
- 2024AI Agents That Mattercited by 219
38 more
- 2024Evolutionary Optimization of Model Merging Recipescited by 208
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
- 2019The Evolved Transformercited by 180
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 135
- 2024Large Language Models to Enhance Bayesian Optimizationcited by 135
- 2023EvoPrompting: Language Models for Code-Level Neural Architecture Searchcited by 131
- 2022GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Modelscited by 127
- 2023Large Language Models as Evolutionary Optimizerscited by 124
- 2024Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Modelscited by 122
- 2024Faithful Logical Reasoning via Symbolic Chain-of-Thoughtcited by 100
- 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 97
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 90
- 2023LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimizationcited by 87
- 2023Unleashing the potential of prompt engineering for large language modelscited by 72
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 69
- 2024Multi-objective Evolution of Heuristic Using Large Language Modelcited by 54
- 2023Prompt Engineering a Prompt Engineercited by 53
- 2022TEMPERA: Test-Time Prompting via Reinforcement Learningcited by 50
- 2024A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Taskcited by 49
- 2023Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineeringcited by 43
- 2020Benchmarking in Optimization: Best Practice and Open Issuescited by 38
- 2022GPS: Genetic Prompt Search for Efficient Few-shot Learningcited by 37
- 2024PRompt Optimization in Multi-Step Tasks (PROMST): Integrating Human Feedback and Heuristic-based Samplingcited by 32
- 2021AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Modelscited by 31
- 2018IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristicscited by 28
- 2024In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristicscited by 28
- 2021IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristicscited by 24
- 2024FunBO: Discovering Acquisition Functions for Bayesian Optimization with FunSearchcited by 23
- 2021AutoBERT-Zero: Evolving BERT Backbone from Scratchcited by 21
- 2020IOHanalyzer: Detailed Performance Analyses for Iterative Optimization Heuristicscited by 20
- 2024When Large Language Models Meet Evolutionary Algorithms: Potential Enhancements and Challengescited by 20
- 2024LLM Guided Evolution -- The Automation of Models Advancing Modelscited by 20
- 2024Large Language Models as Surrogate Models in Evolutionary Algorithms: A Preliminary Studycited by 20
- 2022LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Modelscited by 14
- 2023Automatic Engineering of Long Promptscited by 14
- 2024Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithmscited by 12
- 2025Beyond the Hype: Benchmarking LLM-Evolved Heuristics for Bin Packingcited by 9
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025EvoCAD: Evolutionary CAD Code Generation with Vision Language Modelscited by 6
- 2025Behaviour Space Analysis of LLM-driven Meta-heuristic Discoverycited by 4
- 2025Experience-Guided Reflective Co-Evolution of Prompts and Heuristics for Automatic Algorithm Designcited by 4
- 2026LLaMEA-SAGE: Guiding Automated Algorithm Design with Structural Feedback from Explainable AIcited by 1
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Designcited by 1
- 2026Hyper Algorithm Design Agent: Evolving Learnable Optimizer from Zerocited by 0
- 2026Hyper Algorithm Design Agent: Evolving Learnable Optimizer from Zero28 Sep 2026
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design10 Aug 2026
- 2026LLaMEA-SAGE: Guiding Automated Algorithm Design with Structural Feedback from Explainable AI29 Jan 2026
- 2025EvoCAD: Evolutionary CAD Code Generation with Vision Language Models13 Oct 2025
- 2025Experience-Guided Reflective Co-Evolution of Prompts and Heuristics for Automatic Algorithm Design29 Sep 2025
- 2025Behaviour Space Analysis of LLM-driven Meta-heuristic Discovery4 Jul 2025