On the Utility of Probing Trajectories for Algorithm-Selection
Not on the map. Why?
Abstract (arXiv)
Machine-learning approaches to algorithm-selection typically take data describing an instance as input. Input data can take the form of features derived from the instance description or fitness landscape, or can be a direct representation of the instance itself, i.e. an image or textual description. Regardless of the choice of input, there is an implicit assumption that instances that are similar will elicit similar performance from algorithm, and that a model is capable of learning this relationship. We argue that viewing algorithm-selection purely from an instance perspective can be misleading as it fails to account for how an algorithm `views' similarity between instances. We propose a novel `algorithm-centric' method for describing instances that can be used to train models for algorithm-selection: specifically, we use short probing trajectories calculated by applying a solver to an instance for a very short period of time. The approach is demonstrated to be promising, providing comparable or better results to computationally expensive landscape-based feature-based approaches. Furthermore, projecting the trajectories into a 2-dimensional space illustrates that functions that are similar from an algorithm-perspective do not necessarily correspond to the accepted categorisation of these functions from a human perspective.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 14 of its 38 references that are in the map. First posted on arXiv 23 Jan 2024.
Builds on
14 of 38 references.
References · 14
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2016COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Settingcited by 135
- 2018Automated Algorithm Selection: Survey and Perspectivescited by 111
- 2022Per-run Algorithm Selection with Warm-starting using Trajectory-based Featurescited by 20
- 2021Towards Feature-Based Performance Regression Using Trajectory Datacited by 15
- 2021Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functionscited by 14
- 2022Automated Algorithm Selection: from Feature-Based to Feature-Free Approachescited by 13
- 2023To Switch or not to Switch: Predicting the Benefit of Switching between Algorithms based on Trajectory Featurescited by 9
- 2022A Collection of Deep Learning-based Feature-Free Approaches for Characterizing Single-Objective Continuous Fitness Landscapescited by 8
- 2022Trajectory-based Algorithm Selection with Warm-startingcited by 8
- 2023DynamoRep: Trajectory-Based Population Dynamics for Classification of Black-box Optimization Problemscited by 8
- 2021Explorative Data Analysis of Time Series based AlgorithmFeatures of CMA-ES Variantscited by 6
Built on by
Citing papers per year: 2024: 4; 2025: 2; 2026: 2.
8 papers.
- 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimizationcited by 23
- 2025Landscape Features in Single-Objective Continuous Optimization: Have We Hit a Wall in Algorithm Selection Generalization?cited by 7
- 2024A Survey of Features Used for Representing Black-box Single-objective Continuous Optimizationcited by 3
- 2024Improving Algorithm-Selection and Performance-Prediction via Learning Discriminating Training Samplescited by 2
- 2024Identifying Easy Instances to Improve Efficiency of ML Pipelines for Algorithm-Selectioncited by 1
- 2025Algorithm Selection with Probing Trajectories: Benchmarking the Choice of Classifier Modelcited by 0
- 2026On the Influence of the Feature Computation Budget on Per-Instance Algorithm Selection for Black-Box Optimizationcited by 0
- 2026Reinforcement learning to choose optimizerscited by 0
- 2026Reinforcement learning to choose optimizers1 Sep 2026
- 2026On the Influence of the Feature Computation Budget on Per-Instance Algorithm Selection for Black-Box Optimization6 May 2026
- 2025Landscape Features in Single-Objective Continuous Optimization: Have We Hit a Wall in Algorithm Selection Generalization?29 Jan 2025
- 2025Algorithm Selection with Probing Trajectories: Benchmarking the Choice of Classifier Model20 Jan 2025
- 2024Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimization1 Nov 2024
- 2024Identifying Easy Instances to Improve Efficiency of ML Pipelines for Algorithm-Selection24 Jun 2024
- 2024A Survey of Features Used for Representing Black-box Single-objective Continuous Optimization8 Jun 2024
- 2024Improving Algorithm-Selection and Performance-Prediction via Learning Discriminating Training Samples8 Apr 2024