mlsanityData to 14 Oct 2026

To Switch or not to Switch: Predicting the Benefit of Switching between Algorithms based on Trajectory Features

arXiv 2302.09075 ↗First posted 17 Feb 2023cs.AI cs.LG cs.NEcited by 9

Not on the map. Why?

Abstract (arXiv)

Dynamic algorithm selection aims to exploit the complementarity of multiple optimization algorithms by switching between them during the search. While these kinds of dynamic algorithms have been shown to have potential to outperform their component algorithms, it is still unclear how this potential can best be realized. One promising approach is to make use of landscape features to enable a per-run trajectory-based switch. Here, the samples seen by the first algorithm are used to create a set of features which describe the landscape from the perspective of the algorithm. These features are then used to predict what algorithm to switch to. In this work, we extend this per-run trajectory-based approach to consider a wide variety of potential points at which to perform the switch. We show that using a sliding window to capture the local landscape features contains information which can be used to predict whether a switch at that point would be beneficial to future performance. By analyzing the resulting models, we identify what features are most important to these predictions. Finally, by evaluating the importance of features and comparing these values between multiple algorithms, we show clear differences in the way the second algorithm interacts with the local landscape features found before the switch.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 16 of its 39 references that are in the map. First posted on arXiv 17 Feb 2023.

Builds on

16 of 39 references.

References · 16

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  3. 2016COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Settingcited by 138
  4. 2018Automated Algorithm Selection: Survey and Perspectivescited by 114
  5. 2022Automated Dynamic Algorithm Configurationcited by 39
  6. 2021DACBench: A Benchmark Library for Dynamic Algorithm Configurationcited by 28
  7. 2021IOHexperimenter: Benchmarking Platform for Iterative Optimization Heuristicscited by 24
  8. 2020IOHanalyzer: Detailed Performance Analyses for Iterative Optimization Heuristicscited by 20
  9. 2021Tuning as a Means of Assessing the Benefits of New Ideas in Interplay with Existing Algorithmic Modulescited by 20
  10. 2022Per-run Algorithm Selection with Warm-starting using Trajectory-based Featurescited by 20
  11. 2021Towards Feature-Based Performance Regression Using Trajectory Datacited by 15
  12. 2020Black-Box Optimization Revisited: Improving Algorithm Selection Wizards through Massive Benchmarkingcited by 14
4 more
  1. 2021Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functionscited by 14
  2. 2019Online Selection of CMA-ES Variantscited by 11
  3. 2020Towards Dynamic Algorithm Selection for Numerical Black-Box Optimization: Investigating BBOB as a Use Casecited by 5
  4. 2022Analyzing the Impact of Undersampling on the Benchmarking and Configuration of Evolutionary Algorithmscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 3; 2026: 2.

9 papers.