To Switch or not to Switch: Predicting the Benefit of Switching between Algorithms based on Trajectory Features
Not on the map. Why?
Abstract (arXiv)
Dynamic algorithm selection aims to exploit the complementarity of multiple optimization algorithms by switching between them during the search. While these kinds of dynamic algorithms have been shown to have potential to outperform their component algorithms, it is still unclear how this potential can best be realized. One promising approach is to make use of landscape features to enable a per-run trajectory-based switch. Here, the samples seen by the first algorithm are used to create a set of features which describe the landscape from the perspective of the algorithm. These features are then used to predict what algorithm to switch to. In this work, we extend this per-run trajectory-based approach to consider a wide variety of potential points at which to perform the switch. We show that using a sliding window to capture the local landscape features contains information which can be used to predict whether a switch at that point would be beneficial to future performance. By analyzing the resulting models, we identify what features are most important to these predictions. Finally, by evaluating the importance of features and comparing these values between multiple algorithms, we show clear differences in the way the second algorithm interacts with the local landscape features found before the switch.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 16 of its 39 references that are in the map. First posted on arXiv 17 Feb 2023.
Builds on
16 of 39 references.
References · 16
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2016COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Settingcited by 138
- 2018Automated Algorithm Selection: Survey and Perspectivescited by 114
- 2022Automated Dynamic Algorithm Configurationcited by 39
- 2021DACBench: A Benchmark Library for Dynamic Algorithm Configurationcited by 28
- 2021IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristicscited by 24
- 2020IOHanalyzer: Detailed Performance Analyses for Iterative Optimization Heuristicscited by 20
- 2021Tuning as a Means of Assessing the Benefits of New Ideas in Interplay with Existing Algorithmic Modulescited by 20
- 2022Per-run Algorithm Selection with Warm-starting using Trajectory-based Featurescited by 20
- 2021Towards Feature-Based Performance Regression Using Trajectory Datacited by 15
- 2020Black-Box Optimization Revisited: Improving Algorithm Selection Wizards through Massive Benchmarkingcited by 14
4 more
- 2021Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functionscited by 14
- 2019Online Selection of CMA-ES Variantscited by 11
- 2020Towards Dynamic Algorithm Selection for Numerical Black-Box Optimization: Investigating BBOB as a Use Casecited by 5
- 2022Analyzing the Impact of Undersampling on the Benchmarking and Configuration of Evolutionary Algorithmscited by 4
Built on by
Citing papers per year: 2024: 4; 2025: 3; 2026: 2.
9 papers.
- 2024On the Utility of Probing Trajectories for Algorithm-Selectioncited by 8
- 2024A Survey of Features Used for Representing Black-box Single-objective Continuous Optimizationcited by 3
- 2024Improving Algorithm-Selection and Performance-Prediction via Learning Discriminating Training Samplescited by 2
- 2024Identifying Easy Instances to Improve Efficiency of ML Pipelines for Algorithm-Selectioncited by 1
- 2026When Switching Algorithms Helps: A Theoretical Study of Online Algorithm Selectioncited by 1
- 2025Algorithm Selection with Probing Trajectories: Benchmarking the Choice of Classifier Modelcited by 0
- 2025Greedy Restart Schedules: A Baseline for Dynamic Algorithm Selection on Numerical Black-box Optimization Problemscited by 0
- 2025A Review on Single-Problem Multi-Attempt Heuristic Optimizationcited by 0
- 2026Reinforcement learning to choose optimizerscited by 0
- 2026Reinforcement learning to choose optimizers1 Sep 2026
- 2026When Switching Algorithms Helps: A Theoretical Study of Online Algorithm Selection8 Apr 2026
- 2025A Review on Single-Problem Multi-Attempt Heuristic Optimization30 Sep 2025
- 2025Greedy Restart Schedules: A Baseline for Dynamic Algorithm Selection on Numerical Black-box Optimization Problems15 Apr 2025
- 2025Algorithm Selection with Probing Trajectories: Benchmarking the Choice of Classifier Model20 Jan 2025
- 2024Identifying Easy Instances to Improve Efficiency of ML Pipelines for Algorithm-Selection24 Jun 2024
- 2024A Survey of Features Used for Representing Black-box Single-objective Continuous Optimization8 Jun 2024
- 2024Improving Algorithm-Selection and Performance-Prediction via Learning Discriminating Training Samples8 Apr 2024
- 2024On the Utility of Probing Trajectories for Algorithm-Selection23 Jan 2024