mlsanityData to 14 Oct 2026

Large Language Models and Evolutionary Computation: A Critical Review of Bidirectional Interaction, Automated Algorithm Design, and Co-Adaptive Systems

arXiv 2505.15741 ↗First posted 21 May 2025cs.NE cs.CL cs.MAcited by 6

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) and Evolutionary Computation (EC) are increasingly being combined to support automated optimization, algorithm design, and adaptive decision-making. This survey reviews the bidirectional interaction between these two paradigms and examines how their complementary strengths can be leveraged in hybrid intelligent systems. First, we analyze how EC can enhance LLM-based systems through prompt optimization, hyperparameter tuning, and architecture search. Second, we review how LLMs can im- prove EC by supporting metaheuristic design, surrogate reasoning, adaptive operator control, and heuristic generation. We further discuss emerging co-adaptive frameworks in which LLMs and EC interact through iterative feedback loops. Beyond summarizing recent developments, the survey provides a structured perspec- tive on interaction mechanisms, application patterns, and methodological challenges, including computational cost, reproducibility, interpretability, benchmarking, and generalization. The paper concludes by outlining open research questions and future directions for developing more robust, transparent, and scalable LLM-EC systems.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 63 of its 96 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

63 of 96 references.

References · 63

  1. 2023A Survey of Large Language Modelscited by 2,576
  2. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  3. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  4. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
  5. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  6. 2024Large Language Models: A Surveycited by 525
  7. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
  8. 2022Prompt-aligned Gradient for Prompt Tuningcited by 341
  9. 2023Explainability for Large Language Models: A Surveycited by 333
  10. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
  11. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
  12. 2024AI Agents That Mattercited by 219
38 more
  1. 2024Evolutionary Optimization of Model Merging Recipescited by 208
  2. 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
  3. 2019The Evolved Transformercited by 180
  4. 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
  5. 2023NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptionscited by 135
  6. 2024Large Language Models to Enhance Bayesian Optimizationcited by 135
  7. 2023EvoPrompting: Language Models for Code-Level Neural Architecture Searchcited by 131
  8. 2022GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Modelscited by 127
  9. 2023Large Language Models as Evolutionary Optimizerscited by 124
  10. 2024Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Modelscited by 122
  11. 2024Faithful Logical Reasoning via Symbolic Chain-of-Thoughtcited by 100
  12. 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 97
  13. 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 90
  14. 2023LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimizationcited by 87
  15. 2023Unleashing the potential of prompt engineering for large language modelscited by 72
  16. 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 69
  17. 2024Multi-objective Evolution of Heuristic Using Large Language Modelcited by 54
  18. 2023Prompt Engineering a Prompt Engineercited by 53
  19. 2022TEMPERA: Test-Time Prompting via Reinforcement Learningcited by 50
  20. 2024A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Taskcited by 49
  21. 2023Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineeringcited by 43
  22. 2020Benchmarking in Optimization: Best Practice and Open Issuescited by 38
  23. 2022GPS: Genetic Prompt Search for Efficient Few-shot Learningcited by 37
  24. 2024PRompt Optimization in Multi-Step Tasks (PROMST): Integrating Human Feedback and Heuristic-based Samplingcited by 32
  25. 2021AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Modelscited by 31
  26. 2018IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristicscited by 28
  27. 2024In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristicscited by 28
  28. 2021IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristicscited by 24
  29. 2024FunBO: Discovering Acquisition Functions for Bayesian Optimization with FunSearchcited by 23
  30. 2021AutoBERT-Zero: Evolving BERT Backbone from Scratchcited by 21
  31. 2020IOHanalyzer: Detailed Performance Analyses for Iterative Optimization Heuristicscited by 20
  32. 2024When Large Language Models Meet Evolutionary Algorithms: Potential Enhancements and Challengescited by 20
  33. 2024LLM Guided Evolution -- The Automation of Models Advancing Modelscited by 20
  34. 2024Large Language Models as Surrogate Models in Evolutionary Algorithms: A Preliminary Studycited by 20
  35. 2022LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Modelscited by 14
  36. 2023Automatic Engineering of Long Promptscited by 14
  37. 2024Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithmscited by 12
  38. 2025Beyond the Hype: Benchmarking LLM-Evolved Heuristics for Bin Packingcited by 9

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.