EvoSpeak: Large Language Models for Interpretable Genetic Programming-Evolved Heuristics
Not on the map. Why?
Abstract (arXiv)
Genetic programming (GP) has demonstrated strong effectiveness in evolving tree-structured heuristics for complex optimization problems. Yet, in dynamic and large-scale scenarios, the most effective heuristics are often highly complex, hindering interpretability, slowing convergence, and limiting transferability across tasks. To address these challenges, we present EvoSpeak, a novel framework that integrates GP with large language models (LLMs) to enhance the efficiency, transparency, and adaptability of heuristic evolution. EvoSpeak learns from high-quality GP heuristics, extracts knowledge, and leverages this knowledge to (i) generate warm-start populations that accelerate convergence, (ii) translate opaque GP trees into concise natural-language explanations that foster interpretability and trust, and (iii) enable knowledge transfer and preference-aware heuristic generation across related tasks. We verify the effectiveness of EvoSpeak through extensive experiments on dynamic flexible job shop scheduling (DFJSS), under both single- and multi-objective formulations. The results demonstrate that EvoSpeak produces more effective heuristics, improves evolutionary efficiency, and delivers human-readable reports that enhance usability. By coupling the symbolic reasoning power of GP with the interpretative and generative strengths of LLMs, EvoSpeak advances the development of intelligent, transparent, and user-aligned heuristics for real-world optimization problems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 63 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
16 of 63 references.
References · 16
- 2023A Survey of Large Language Modelscited by 2,537
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
- 2023Large Language Models as Evolutionary Optimizerscited by 122
- 2024Multi-objective Evolution of Heuristic Using Large Language Modelcited by 52
- 2024Evolving Code with A Large Language Modelcited by 42
- 2024Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Modelscited by 22
- 2024When Large Language Models Meet Evolutionary Algorithms: Potential Enhancements and Challengescited by 20
- 2023Evaluating the Robustness of Interpretability Methods through Explanation Invariance and Equivariancecited by 13
4 more
- 2025LLM-Driven Instance-Specific Heuristic Generation and Selectioncited by 11
- 2024Explaining Genetic Programming Trees using Large Language Modelscited by 6
- 2023Learning Interpretable Low-dimensional Representation via Physical Symmetrycited by 4
- 2024Language Model Evolutionary Algorithms for Recommender Systems: Benchmarks and Algorithm Comparisonscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving
- 2025Evolutionary thoughts: integration of large language models and evolutionary algorithms
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution
- 2026SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents
- 2026OptGraph: Large Language Models Enhanced Evolutionary Optimization Via Graph Retrieval-Augmented Generation
- 2025CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimization
- 2026Evolutionary Task Discovery: Advancing Reasoning Frontiers via Skill Composition and Complexity Scaling
- 2026GenePlan: Evolving Better Generalized PDDL Plans using Large Language Models