mlsanityData to 14 Oct 2026

mlr3mbo: Bayesian Optimization in R

arXiv 2603.29730 ↗First posted 31 Mar 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We present mlr3mbo, a modular toolbox for Bayesian optimization in R. mlr3mbo supports single- and multi-objective optimization, multi-point proposals, batch and asynchronous parallelization, and robust error handling. While it can be used for many standard Bayesian optimization variants in applied settings, researchers can also construct custom Bayesian optimization algorithms from its flexible building blocks. In addition to an introduction to the software, its design principles, and its building blocks, the paper presents two extensive empirical evaluations on the surrogate-based benchmark suite YAHPO Gym. To identify robust default configurations for both numeric and mixed-hierarchical optimization regimes, and to gain further insights into the respective impacts of individual settings, we run a coordinate descent search over the mlr3mbo configuration space and analyze its results. Furthermore, we benchmark mlr3mbo against a wide range of established optimizers, including HEBO, SMAC3, Ax, and Optuna, and find that it performs on par with state-of-the-art.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 109 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

45 of 109 references.

References · 45

  1. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  2. 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 470
  3. 2013Gaussian Processes for Big Datacited by 383
  4. 2019Scalable Global Optimization via Local Bayesian Optimizationcited by 374
  5. 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 230
  6. 2020Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learningcited by 174
  7. 2015ranger: A Fast Implementation of Random Forests for High Dimensional Data in C++ and Rcited by 172
  8. 2023Unexpected Improvements to Expected Improvement for Bayesian Optimizationcited by 149
  9. 2021Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020cited by 148
  10. 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 145
  11. 2019Exact Gaussian Processes on a Million Data Pointscited by 119
  12. 2021HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPOcited by 112
33 more
  1. 2015Batch Bayesian Optimization via Local Penalizationcited by 104
  2. 2016Multi-Information Source Optimizationcited by 84
  3. 2019Combinatorial Bayesian Optimization using the Graph Cartesian Productcited by 79
  4. 2019Tuning Hyperparameters without Grad Students: Scalable and Robust Bayesian Optimisation with Dragonflycited by 67
  5. 2017Dealing with Integer-valued Variables in Bayesian Optimization with Gaussian Processescited by 66
  6. 2019Bayesian Optimization for Materials Design with Mixed Quantitative and Qualitative Variablescited by 66
  7. 2021YAHPO Gym -- An Efficient Multi-Objective Multi-Fidelity Benchmark for Hyperparameter Optimizationcited by 62
  8. 2019Bayesian Optimisation over Multiple Continuous and Categorical Inputscited by 56
  9. 2018Bayesian Optimization in AlphaGocited by 55
  10. 2023Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspacescited by 52
  11. 2013Confidence Intervals for Random Forests: The Jackknife and the Infinitesimal Jackknifecited by 44
  12. 2016Parallel Bayesian Global Optimization of Expensive Functionscited by 44
  13. 2022Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overviewcited by 37
  14. 2022Bayesian Optimization over Discrete and Mixed Spaces via Probabilistic Reparameterizationcited by 37
  15. 2023Bounce: Reliable High-Dimensional Bayesian Optimization for Combinatorial and Mixed Spacescited by 28
  16. 2014BayesOpt: A Bayesian Optimization Library for Nonlinear Optimization, Experimental Design and Banditscited by 18
  17. 2019Asynchronous Batch Bayesian Optimisation with Improved Local Penalisationcited by 17
  18. 2017mlrMBO: A Modular Framework for Model-Based Optimization of Expensive Black-Box Functionscited by 16
  19. 2019Towards Assessing the Impact of Bayesian Optimization's Own Hyperparameterscited by 16
  20. 2022Fair and Green Hyperparameter Optimization via Multi-objective and Multiple Information Source Bayesian Optimizationcited by 14
  21. 2020Initial Design Strategies and their Effects on Sequential Model-Based Optimizationcited by 10
  22. 2021Revisiting Bayesian Optimization in the light of the COCO benchmarkcited by 10
  23. 2020A Unifying Framework for Parallel and Distributed Processing in R using Futurescited by 9
  24. 2018Distance-distributed design for Gaussian process surrogatescited by 7
  25. 2019On Local Optimizers of Acquisition Functions in Bayesian Optimizationcited by 7
  26. 2020Combinatorial Bayesian Optimization with Random Mapping Functions to Convex Polytopescited by 6
  27. 2022Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimizationcited by 6
  28. 2024BoFire: Bayesian Optimization Framework Intended for Real Experimentscited by 6
  29. 2021Automated Benchmark-Driven Design and Explanation of Hyperparameter Optimizerscited by 4
  30. 2023NUBO: A Transparent Python Package for Bayesian Optimizationcited by 2
  31. 2024Hyperparameter Optimization in Machine Learningcited by 2
  32. 2024Derivation of Closed Form of Expected Improvement for Gaussian Process Trained on Log-Transformed Objectivecited by 2
  33. 2026Wasserstein-enabled characterization of designs and myopic decisions in Bayesian Optimizationcited by 1

Built on by

Not cited yet.