# A Tutorial on the Design, Experimentation and Application of Metaheuristic Algorithms to Real-World Optimization Problems

arXiv: https://arxiv.org/abs/2410.03205 · HTML: https://mlsanity.com/paper/2410.03205/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 166 references that are in the map.
- First posted on arXiv 4 Oct 2024.

## Builds on (most cited first, 20 of 20)

- [Convex optimization](https://mlsanity.com/paper/2106.01946/) (2021)
- [Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI](https://mlsanity.com/paper/1910.10045/) (2019)
- [Automated Algorithm Selection: Survey and Perspectives](https://mlsanity.com/paper/1811.11597/) (2018)
- [Time for a change: a tutorial for comparing multiple classifiers through Bayesian analysis](https://mlsanity.com/paper/1606.04316/) (2016)
- [ParamILS: An Automatic Algorithm Configuration Framework](https://mlsanity.com/paper/1401.3492/) (2014)
- [Causal Interpretability for Machine Learning -- Problems, Methods and Evaluation](https://mlsanity.com/paper/2003.03934/) (2020)
- [An Easy-to-use Real-world Multi-objective Optimization Problem Suite](https://mlsanity.com/paper/2009.12867/) (2020)
- [JuMP: A Modeling Language for Mathematical Optimization](https://mlsanity.com/paper/1508.01982/) (2015)
- [PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization](https://mlsanity.com/paper/1701.00879/) (2017)
- [Pitfalls and Best Practices in Algorithm Configuration](https://mlsanity.com/paper/1705.06058/) (2017)
- [jMetalPy: a Python Framework for Multi-Objective Optimization with Metaheuristics](https://mlsanity.com/paper/1903.02915/) (2019)
- [Global sensitivity analysis for optimization with variable selection](https://mlsanity.com/paper/1811.04646/) (2018)
- [COCO: Performance Assessment](https://mlsanity.com/paper/1605.03560/) (2016)
- [Comprehensive Taxonomies of Nature- and Bio-inspired Optimization: Inspiration versus Algorithmic Behavior, Critical Analysis and Recommendations (from 2020 to 2024)](https://mlsanity.com/paper/2002.08136/) (2020)
- [A History of Metaheuristics](https://mlsanity.com/paper/1704.00853/) (2017)
- [Ockham's Razor in Memetic Computing: Three Stage Optimal Memetic Exploration](https://mlsanity.com/paper/1810.08669/) (2018)
- [Hybrid Metaheuristics for the Clustered Vehicle Routing Problem](https://mlsanity.com/paper/1404.6696/) (2014)
- [On Time Optimization of Centroidal Momentum Dynamics](https://mlsanity.com/paper/1709.09265/) (2017)
- [Genetic and Memetic Algorithm with Diversity Equilibrium based on Greedy Diversification](https://mlsanity.com/paper/1702.03594/) (2017)
- [Towards Realistic Optimization Benchmarks: A Questionnaire on the Properties of Real-World Problems](https://mlsanity.com/paper/2004.06395/) (2020)

## Built on by (most cited first, 5 of 5)

- [The Paradox of Success in Evolutionary and Bioinspired Optimization: Revisiting Critical Issues, Key Studies, and Methodological Pathways](https://mlsanity.com/paper/2501.07515/) (2025)
- [An Improved FOX Optimization Algorithm Using Adaptive Exploration and Exploitation for Global Optimization](https://mlsanity.com/paper/2504.09574/) (2025)
- [Data-Driven Differential Evolution in Tire Industry Extrusion: Leveraging Surrogate Models](https://mlsanity.com/paper/2507.11191/) (2025)
- [Oranits: Mission Assignment and Task Offloading in Open RAN-based ITS using Metaheuristic and Deep Reinforcement Learning](https://mlsanity.com/paper/2507.19712/) (2025)
- [Performance and Explainability Requirements of Evolutionary Algorithms in Real-World Physics-Informed Optimization](https://mlsanity.com/paper/2605.28164/) (2026)

## Abstract (arXiv)

In the last few years, the formulation of real-world optimization problems and their efficient solution via metaheuristic algorithms has been a catalyst for a myriad of research studies. In spite of decades of historical advancements on the design and use of metaheuristics, large difficulties still remain in regards to the understandability, algorithmic design uprightness, and performance verifiability of new technical achievements. A clear example stems from the scarce replicability of works dealing with metaheuristics used for optimization, which is often infeasible due to ambiguity and lack of detail in the presentation of the methods to be reproduced. Additionally, in many cases, there is a questionable statistical significance of their reported results. This work aims at providing the audience with a proposal of good practices which should be embraced when conducting studies about metaheuristics methods used for optimization in order to provide scientific rigor, value and transparency. To this end, we introduce a step by step methodology covering every research phase that should be followed when addressing this scientific field. Specifically, frequently overlooked yet crucial aspects and useful recommendations will be discussed in regards to the formulation of the problem, solution encoding, implementation of search operators, evaluation metrics, design of experiments, and considerations for real-world performance, among others. Finally, we will outline important considerations, challenges, and research directions for the success of newly developed optimization metaheuristics in their deployment and operation over real-world application environments.
