Automated Design of Metaheuristic Algorithms: A Survey
Not on the map. Why?
Abstract (arXiv)
Metaheuristics have gained great success in academia and practice because their search logic can be applied to any problem with available solution representation, solution quality evaluation, and certain notions of locality. Manually designing metaheuristic algorithms for solving a target problem is criticized for being laborious, error-prone, and requiring intensive specialized knowledge. This gives rise to increasing interest in automated design of metaheuristic algorithms. With computing power to fully explore potential design choices, the automated design could reach and even surpass human-level design and could make high-performance algorithms accessible to a much wider range of researchers and practitioners. This paper presents a broad picture of automated design of metaheuristic algorithms, by conducting a survey on the common grounds and representative techniques in terms of design space, design strategies, performance evaluation strategies, and target problems in this field.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 24 of its 157 references that are in the map. First posted on arXiv 12 Mar 2023.
Builds on
24 of 157 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2020Designing Network Design Spacescited by 960
- 2020Transfer Learning in Deep Reinforcement Learning: A Surveycited by 265
- 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 230
- 2018Automated Algorithm Selection: Survey and Perspectivescited by 114
- 2014ParamILS: An Automatic Algorithm Configuration Frameworkcited by 89
- 2022Discovering Evolution Strategies via Meta-Black-Box Optimizationcited by 44
- 2021Searching the Search Space of Vision Transformercited by 41
- 2019Deep Reinforcement Learning Based Parameter Control in Differential Evolutioncited by 38
- 2022A Survey of Methods for Automated Algorithm Configurationcited by 30
- 2021Learning adaptive differential evolution algorithm from optimization experiences by policy gradientcited by 26
12 more
- 2020Evolving Search Space for Neural Architecture Searchcited by 23
- 2016Evolving the Structure of Evolution Strategiescited by 11
- 2021Automated Configuration of Genetic Algorithms by Tuning for Anytime Performancecited by 9
- 2021Evolving Evolutionary Algorithms using Linear Genetic Programmingcited by 5
- 2022Evolutionary Diversity Optimisation for The Traveling Thief Problemcited by 5
- 2021Paradiseo: From a Modular Framework for Evolutionary Computation to the Automated Design of Metaheuristics ---22 Years of Paradiseo---cited by 4
- 2021Principled Design of Translation, Scale, and Rotation Invariant Variation Operators for Metaheuristicscited by 4
- 2022AutoOpt: A General Framework for Automatically Designing Metaheuristic Optimization Algorithms with Diverse Structurescited by 4
- 2022Analyzing the Impact of Undersampling on the Benchmarking and Configuration of Evolutionary Algorithmscited by 4
- 2021Evolving Continuous Optimisers from Scratchcited by 3
- 2019Instruction-Level Design of Local Optimisers using Push GPcited by 2
- 2021Towards Large Scale Automated Algorithm Design by Integrating Modular Benchmarking Frameworkscited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 3; 2026: 5.
12 papers.
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 69
- 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimizationcited by 24
- 2024Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithmscited by 12
- 2024Automated Metaheuristic Algorithm Design with Autoregressive Learningcited by 7
- 2025RedAHD: Reduction-Based End-to-End Automatic Heuristic Design with Large Language Modelscited by 4
- 2025From Performance to Understanding: A Vision for Explainable Automated Algorithm Designcited by 0
- 2025CogMCTS: A Novel Cognitive-Guided Monte Carlo Tree Search Framework for Iterative Heuristic Evolution with Large Language Modelscited by 0
- 2026READY: Reward Discovery for Meta-Black-Box Optimizationcited by 0
- 2026CliffSearch: Structured Agentic Co-Evolution over Theory and Code for Scientific Algorithm Discoverycited by 0
- 2026Teacher-Aware Evolution of Heuristic Programs from Learned Optimization Policiescited by 0
- 2026SCOPE: Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimizationcited by 0
- 2026Hyper Algorithm Design Agent: Evolving Learnable Optimizer from Zerocited by 0
- 2026Hyper Algorithm Design Agent: Evolving Learnable Optimizer from Zero28 Sep 2026
- 2026SCOPE: Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimization30 Jul 2026
- 2026Teacher-Aware Evolution of Heuristic Programs from Learned Optimization Policies11 May 2026
- 2026CliffSearch: Structured Agentic Co-Evolution over Theory and Code for Scientific Algorithm Discovery1 Apr 2026
- 2026READY: Reward Discovery for Meta-Black-Box Optimization29 Jan 2026
- 2025CogMCTS: A Novel Cognitive-Guided Monte Carlo Tree Search Framework for Iterative Heuristic Evolution with Large Language Models9 Dec 2025
- 2025From Performance to Understanding: A Vision for Explainable Automated Algorithm Design20 Nov 2025
- 2025RedAHD: Reduction-Based End-to-End Automatic Heuristic Design with Large Language Models26 May 2025
- 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimization1 Nov 2024
- 2024Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithms28 Oct 2024
- 2024A Systematic Survey on Large Language Models for Algorithm Design11 Oct 2024
- 2024Automated Metaheuristic Algorithm Design with Autoregressive Learning6 May 2024