Warmstarting of Model-based Algorithm Configuration
Not on the map. Why?
Abstract (arXiv)
The performance of many hard combinatorial problem solvers depends strongly on their parameter settings, and since manual parameter tuning is both tedious and suboptimal the AI community has recently developed several algorithm configuration (AC) methods to automatically address this problem. While all existing AC methods start the configuration process of an algorithm A from scratch for each new type of benchmark instances, here we propose to exploit information about A's performance on previous benchmarks in order to warmstart its configuration on new types of benchmarks. We introduce two complementary ways in which we can exploit this information to warmstart AC methods based on a predictive model. Experiments for optimizing a very flexible modern SAT solver on twelve different instance sets show that our methods often yield substantial speedups over existing AC methods (up to 165-fold) and can also find substantially better configurations given the same compute budget.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 2; 2024: 1; 2025: 1; 2026: 3.
17 papers.
Sort:
- 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
- 2022What's Wrong with Deep Learning in Tree Search for Combinatorial Optimizationcited by 36
- 2022A Survey of Methods for Automated Algorithm Configurationcited by 29
- 2021Towards Green Automated Machine Learning: Status Quo and Future Directionscited by 25
- 2021Meta-Learning Reliable Priors in the Function Spacecited by 23
- 2022NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Researchcited by 18
- 2022Hybrid quantum ResNet for car classification and its hyperparameter optimizationcited by 17
- 2022Transfer Learning based Search Space Design for Hyperparameter Tuningcited by 13
- 2024Artificial Intelligence for Operations Research: Revolutionizing the Operations Research Processcited by 11
- 2022TransBO: Hyperparameter Optimization via Two-Phase Transfer Learningcited by 7
- 2023DIG-MILP: a Deep Instance Generator for Mixed-Integer Linear Programming with Feasibility Guaranteecited by 7
- 2021Meta-Learning for Symbolic Hyperparameter Defaultscited by 4
5 more
- 2023Tetra-AML: Automatic Machine Learning via Tensor Networkscited by 3
- 2025Towards a General Framework for Predicting and Explaining the Hardness of Graph-based Combinatorial Optimization Problems using Machine Learning and Association Rule Miningcited by 0
- 2026An Empirical Study on Ensemble-Based Transfer Learning Bayesian Optimisation with Mixed Variable Typescited by 0
- 2026A Meta-Knowledge-Augmented LLM Framework for Hyperparameter Optimization in Time-Series Forecastingcited by 0
- 2026Transfer Learning in Bayesian Optimization for Aircraft Designcited by 0
- 2026Transfer Learning in Bayesian Optimization for Aircraft Design30 Mar 2026
- 2026A Meta-Knowledge-Augmented LLM Framework for Hyperparameter Optimization in Time-Series Forecasting1 Feb 2026
- 2026An Empirical Study on Ensemble-Based Transfer Learning Bayesian Optimisation with Mixed Variable Types22 Jan 2026
- 2025Towards a General Framework for Predicting and Explaining the Hardness of Graph-based Combinatorial Optimization Problems using Machine Learning and Association Rule Mining24 Dec 2025
- 2024Artificial Intelligence for Operations Research: Revolutionizing the Operations Research Process6 Jan 2024
- 2023DIG-MILP: a Deep Instance Generator for Mixed-Integer Linear Programming with Feasibility Guarantee20 Oct 2023
- 2023Tetra-AML: Automatic Machine Learning via Tensor Networks28 Mar 2023
- 2022NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Research15 Nov 2022
- 2022TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning6 Jun 2022
- 2022Transfer Learning based Search Space Design for Hyperparameter Tuning6 Jun 2022
- 2022Hybrid quantum ResNet for car classification and its hyperparameter optimization10 May 2022
- 2022A Survey of Methods for Automated Algorithm Configuration3 Feb 2022
5 more
- 2022What's Wrong with Deep Learning in Tree Search for Combinatorial Optimization25 Jan 2022
- 2021Towards Green Automated Machine Learning: Status Quo and Future Directions10 Nov 2021
- 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges13 Jul 2021
- 2021Meta-Learning for Symbolic Hyperparameter Defaults10 Jun 2021
- 2021Meta-Learning Reliable Priors in the Function Space6 Jun 2021
- 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
- 2022What's Wrong with Deep Learning in Tree Search for Combinatorial Optimizationcited by 36
- 2022A Survey of Methods for Automated Algorithm Configurationcited by 29
- 2021Towards Green Automated Machine Learning: Status Quo and Future Directionscited by 25
- 2021Meta-Learning Reliable Priors in the Function Spacecited by 23
- 2022NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Researchcited by 18
- 2022Hybrid quantum ResNet for car classification and its hyperparameter optimizationcited by 17
- 2022Transfer Learning based Search Space Design for Hyperparameter Tuningcited by 13
- 2024Artificial Intelligence for Operations Research: Revolutionizing the Operations Research Processcited by 11
- 2022TransBO: Hyperparameter Optimization via Two-Phase Transfer Learningcited by 7
- 2023DIG-MILP: a Deep Instance Generator for Mixed-Integer Linear Programming with Feasibility Guaranteecited by 7
- 2021Meta-Learning for Symbolic Hyperparameter Defaultscited by 4
12 most cited of 17 All 17 (JSON)
- 2026Transfer Learning in Bayesian Optimization for Aircraft Design30 Mar 2026
- 2026A Meta-Knowledge-Augmented LLM Framework for Hyperparameter Optimization in Time-Series Forecasting1 Feb 2026
- 2026An Empirical Study on Ensemble-Based Transfer Learning Bayesian Optimisation with Mixed Variable Types22 Jan 2026
- 2025Towards a General Framework for Predicting and Explaining the Hardness of Graph-based Combinatorial Optimization Problems using Machine Learning and Association Rule Mining24 Dec 2025
- 2024Artificial Intelligence for Operations Research: Revolutionizing the Operations Research Process6 Jan 2024
- 2023DIG-MILP: a Deep Instance Generator for Mixed-Integer Linear Programming with Feasibility Guarantee20 Oct 2023
- 2023Tetra-AML: Automatic Machine Learning via Tensor Networks28 Mar 2023
- 2022NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Research15 Nov 2022
- 2022TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning6 Jun 2022
- 2022Transfer Learning based Search Space Design for Hyperparameter Tuning6 Jun 2022
- 2022Hybrid quantum ResNet for car classification and its hyperparameter optimization10 May 2022
- 2022A Survey of Methods for Automated Algorithm Configuration3 Feb 2022
12 newest of 17 All 17 (JSON)