BOCK : Bayesian Optimization with Cylindrical Kernels
Not on the map. Why?
Abstract (arXiv)
A major challenge in Bayesian Optimization is the boundary issue (Swersky, 2017) where an algorithm spends too many evaluations near the boundary of its search space. In this paper, we propose BOCK, Bayesian Optimization with Cylindrical Kernels, whose basic idea is to transform the ball geometry of the search space using a cylindrical transformation. Because of the transformed geometry, the Gaussian Process-based surrogate model spends less budget searching near the boundary, while concentrating its efforts relatively more near the center of the search region, where we expect the solution to be located. We evaluate BOCK extensively, showing that it is not only more accurate and efficient, but it also scales successfully to problems with a dimensionality as high as 500. We show that the better accuracy and scalability of BOCK even allows optimizing modestly sized neural network layers, as well as neural network hyperparameters.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 10; 2023: 10; 2024: 12; 2025: 9; 2026: 5.
62 papers.
Sort:
- 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
- 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 139
- 2021Multi-Objective Bayesian Optimization over High-Dimensional Search Spacescited by 87
- 2022Recent Advances in Bayesian Optimizationcited by 74
- 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimizationcited by 69
- 2021Pre-trained Gaussian Processes for Bayesian Optimizationcited by 63
- 2021High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learningcited by 54
- 2023PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learningcited by 31
- 2021TREGO: a Trust-Region Framework for Efficient Global Optimizationcited by 28
- 2023Bayesian Optimization over High-Dimensional Combinatorial Spaces via Dictionary-based Embeddingscited by 24
- 2023A General Framework for User-Guided Bayesian Optimizationcited by 22
- 2024A survey and benchmark of high-dimensional Bayesian optimization of discrete sequencescited by 22
38 more
- 2021Bayesian Optimization over Permutation Spacescited by 17
- 2021Output Space Entropy Search Framework for Multi-Objective Bayesian Optimizationcited by 13
- 2021Revisiting Bayesian Optimization in the light of the COCO benchmarkcited by 10
- 2021A portfolio approach to massively parallel Bayesian optimizationcited by 9
- 2023OpenBox: A Python Toolkit for Generalized Black-box Optimizationcited by 9
- 2024Improving sample efficiency of high dimensional Bayesian optimization with MCMCcited by 9
- 2025We Still Don't Understand High-Dimensional Bayesian Optimizationcited by 9
- 2024Global Optimization of Gaussian Process Acquisition Functions Using a Piecewise-Linear Kernel Approximationcited by 8
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processescited by 8
- 2022Optimizing Training Trajectories in Variational Autoencoders via Latent Bayesian Optimization Approachcited by 7
- 2021Attentive Neural Processes and Batch Bayesian Optimization for Scalable Calibration of Physics-Informed Digital Twinscited by 5
- 2022Bayesian Optimization For Multi-Objective Mixed-Variable Problemscited by 5
- 2022Pre-training helps Bayesian optimization toocited by 5
- 2023Unleashing the Potential of Acquisition Functions in High-Dimensional Bayesian Optimizationcited by 5
- 2024High-dimensional Bayesian Optimization via Covariance Matrix Adaptation Strategycited by 5
- 2021Mixed Variable Bayesian Optimization with Frequency Modulated Kernelscited by 4
- 2023Pseudo-Bayesian Optimizationcited by 4
- 2024Safe Bayesian Optimization for the Control of High-Dimensional Embodied Systemscited by 4
- 2022Optimization of the Shape of a Hydrokinetic Turbine's Draft Tube and Hub Assembly Using Design-by-Morphing with Bayesian Optimizationcited by 3
- 2023A Bayesian Optimization approach for calibrating large-scale activity-based transport modelscited by 3
- 2023Designing Optimal Behavioral Experiments Using Machine Learningcited by 3
- 2023Domain Knowledge Injection in Bayesian Search for New Materialscited by 3
- 2024Regional Expected Improvement for Efficient Trust Region Selection in High-Dimensional Bayesian Optimizationcited by 3
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?cited by 3
- 2021Procrastinated Tree Search: Black-box Optimization with Delayed, Noisy, and Multi-Fidelity Feedbackcited by 2
- 2022Consolidated learning -- a domain-specific model-free optimization strategy with examples for XGBoost and MIMIC-IVcited by 2
- 2022Bayesian Optimization with Informative Covariancecited by 2
- 2023A dynamic Bayesian optimized active recommender system for curiosity-driven Human-in-the-loop automated experimentscited by 2
- 2024Expected Coordinate Improvement for High-Dimensional Bayesian Optimizationcited by 2
- 2022A model aggregation approach for high-dimensional large-scale optimizationcited by 1
- 2024High dimensional Bayesian Optimization via Condensing-Expansion Projectioncited by 1
- 2024FastBO: Fast HPO and NAS with Adaptive Fidelity Identificationcited by 1
- 2025Bayesian Optimization with Preference Exploration using a Monotonic Neural Network Ensemblecited by 1
- 2025BO4Mob: Bayesian Optimization Benchmarks for High-Dimensional Urban Mobility Problemcited by 1
- 2025Physically-Constrained Autoencoder-Assisted Bayesian Optimization for Refinement of High-Dimensional Defect-Sensitive Single Crystalline Structurecited by 1
- 2026Automated Kernel Discovery Towards Understanding High-dimensional Bayesian Optimizationcited by 1
- 2021CobBO: Coordinate Backoff Bayesian Optimization with Two-Stage Kernelscited by 0
- 2021Scaling Bayesian Optimization With Game Theorycited by 0
50 most cited of 62 All 62 (JSON)
- 2026High-dimensional Multi-objective Bayesian Optimization with Learned Variable Interactions12 Aug 2026
- 2026How Many Initial Points Does Bayesian Optimization Need?5 Jul 2026
- 2026Automated Kernel Discovery Towards Understanding High-dimensional Bayesian Optimization18 May 2026
- 2026Goal-Oriented Influence-Maximizing Data Acquisition for Learning and Optimization23 Feb 2026
- 2026High-dimensional Level Set Estimation with Trust Regions and Double Acquisition Functions12 Feb 2026
- 2025Physically-Constrained Autoencoder-Assisted Bayesian Optimization for Refinement of High-Dimensional Defect-Sensitive Single Crystalline Structure29 Dec 2025
- 2025We Still Don't Understand High-Dimensional Bayesian Optimization28 Nov 2025
- 2025BO4Mob: Bayesian Optimization Benchmarks for High-Dimensional Urban Mobility Problem21 Oct 2025
- 2025Sample-Constrained Black Box Optimization for Audio Personalization17 Jul 2025
- 2025Bayesian Optimization over Bounded Domains with the Beta Product Kernel19 Jun 2025
- 2025POCAII: Parameter Optimization with Conscious Allocation using Iterative Intelligence16 May 2025
- 2025An Adaptive Dropout Approach for High-Dimensional Bayesian Optimization15 Apr 2025
38 more
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?5 Mar 2025
- 2025Bayesian Optimization with Preference Exploration using a Monotonic Neural Network Ensemble30 Jan 2025
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processes29 Dec 2024
- 2024Safe Bayesian Optimization for the Control of High-Dimensional Embodied Systems29 Dec 2024
- 2024Regional Expected Improvement for Efficient Trust Region Selection in High-Dimensional Bayesian Optimization16 Dec 2024
- 2024Global Optimization of Gaussian Process Acquisition Functions Using a Piecewise-Linear Kernel Approximation22 Oct 2024
- 2024Swine Diet Design using Multi-objective Regionalized Bayesian Optimization19 Sep 2024
- 2024FastBO: Fast HPO and NAS with Adaptive Fidelity Identification1 Sep 2024
- 2024High dimensional Bayesian Optimization via Condensing-Expansion Projection9 Aug 2024
- 2024A survey and benchmark of high-dimensional Bayesian optimization of discrete sequences7 Jun 2024
- 2024Simulating, Fast and Slow: Learning Policies for Black-Box Optimization6 Jun 2024
- 2024Expected Coordinate Improvement for High-Dimensional Bayesian Optimization18 Apr 2024
- 2024High-dimensional Bayesian Optimization via Covariance Matrix Adaptation Strategy5 Feb 2024
- 2024Improving sample efficiency of high dimensional Bayesian optimization with MCMC5 Jan 2024
- 2023Domain Knowledge Injection in Bayesian Search for New Materials26 Nov 2023
- 2023A General Framework for User-Guided Bayesian Optimization24 Nov 2023
- 2023Pseudo-Bayesian Optimization15 Oct 2023
- 2023PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning21 Jun 2023
- 2023Designing Optimal Behavioral Experiments Using Machine Learning12 May 2023
- 2023OpenBox: A Python Toolkit for Generalized Black-box Optimization26 Apr 2023
- 2023A dynamic Bayesian optimized active recommender system for curiosity-driven Human-in-the-loop automated experiments5 Apr 2023
- 2023Bayesian Optimization over High-Dimensional Combinatorial Spaces via Dictionary-based Embeddings3 Mar 2023
- 2023Unleashing the Potential of Acquisition Functions in High-Dimensional Bayesian Optimization16 Feb 2023
- 2023A Bayesian Optimization approach for calibrating large-scale activity-based transport models7 Feb 2023
- 2022Monte Carlo Tree Descent for Black-Box Optimization1 Nov 2022
- 2022Bayesian Optimization with Informative Covariance4 Aug 2022
- 2022Optimization of the Shape of a Hydrokinetic Turbine's Draft Tube and Hub Assembly Using Design-by-Morphing with Bayesian Optimization23 Jul 2022
- 2022Pre-training helps Bayesian optimization too7 Jul 2022
- 2022Optimizing Training Trajectories in Variational Autoencoders via Latent Bayesian Optimization Approach30 Jun 2022
- 2022Recent Advances in Bayesian Optimization7 Jun 2022
- 2022A model aggregation approach for high-dimensional large-scale optimization16 May 2022
- 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimization23 Apr 2022
- 2022Bayesian Optimization For Multi-Objective Mixed-Variable Problems30 Jan 2022
- 2022Consolidated learning -- a domain-specific model-free optimization strategy with examples for XGBoost and MIMIC-IV27 Jan 2022
- 2021Bayesian Optimization over Permutation Spaces2 Dec 2021
- 2021Searching in the Forest for Local Bayesian Optimization10 Nov 2021
- 2021A portfolio approach to massively parallel Bayesian optimization18 Oct 2021
- 2021Procrastinated Tree Search: Black-box Optimization with Delayed, Noisy, and Multi-Fidelity Feedback14 Oct 2021
50 newest of 62 All 62 (JSON)
- 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
- 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 139
- 2021Multi-Objective Bayesian Optimization over High-Dimensional Search Spacescited by 87
- 2022Recent Advances in Bayesian Optimizationcited by 74
- 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimizationcited by 69
- 2021Pre-trained Gaussian Processes for Bayesian Optimizationcited by 63
- 2021High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learningcited by 54
- 2023PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learningcited by 31
- 2021TREGO: a Trust-Region Framework for Efficient Global Optimizationcited by 28
- 2023Bayesian Optimization over High-Dimensional Combinatorial Spaces via Dictionary-based Embeddingscited by 24
- 2023A General Framework for User-Guided Bayesian Optimizationcited by 22
- 2024A survey and benchmark of high-dimensional Bayesian optimization of discrete sequencescited by 22
12 most cited of 62 All 62 (JSON)
- 2026High-dimensional Multi-objective Bayesian Optimization with Learned Variable Interactions12 Aug 2026
- 2026How Many Initial Points Does Bayesian Optimization Need?5 Jul 2026
- 2026Automated Kernel Discovery Towards Understanding High-dimensional Bayesian Optimization18 May 2026
- 2026Goal-Oriented Influence-Maximizing Data Acquisition for Learning and Optimization23 Feb 2026
- 2026High-dimensional Level Set Estimation with Trust Regions and Double Acquisition Functions12 Feb 2026
- 2025Physically-Constrained Autoencoder-Assisted Bayesian Optimization for Refinement of High-Dimensional Defect-Sensitive Single Crystalline Structure29 Dec 2025
- 2025We Still Don't Understand High-Dimensional Bayesian Optimization28 Nov 2025
- 2025BO4Mob: Bayesian Optimization Benchmarks for High-Dimensional Urban Mobility Problem21 Oct 2025
- 2025Sample-Constrained Black Box Optimization for Audio Personalization17 Jul 2025
- 2025Bayesian Optimization over Bounded Domains with the Beta Product Kernel19 Jun 2025
- 2025POCAII: Parameter Optimization with Conscious Allocation using Iterative Intelligence16 May 2025
- 2025An Adaptive Dropout Approach for High-Dimensional Bayesian Optimization15 Apr 2025
12 newest of 62 All 62 (JSON)