mlsanityData to 7 Oct 2026

Bounce: Reliable High-Dimensional Bayesian Optimization for Combinatorial and Mixed Spaces

arXiv 2307.00618 ↗First posted 2 Jul 2023cs.LGcited by 27

Not on the map. Why?

Abstract (arXiv)

Impactful applications such as materials discovery, hardware design, neural architecture search, or portfolio optimization require optimizing high-dimensional black-box functions with mixed and combinatorial input spaces. While Bayesian optimization has recently made significant progress in solving such problems, an in-depth analysis reveals that the current state-of-the-art methods are not reliable. Their performances degrade substantially when the unknown optima of the function do not have a certain structure. To fill the need for a reliable algorithm for combinatorial and mixed spaces, this paper proposes Bounce that relies on a novel map of various variable types into nested embeddings of increasing dimensionality. Comprehensive experiments show that Bounce reliably achieves and often even improves upon state-of-the-art performance on a variety of high-dimensional problems.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 39 of its 85 references that are in the map. First posted on arXiv 2 Jul 2023.

Builds on

39 of 85 references.

References · 39

  1. 2018A Tutorial on Bayesian Optimizationcited by 734
  2. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
  3. 2019Scalable Global Optimization via Local Bayesian Optimizationcited by 359
  4. 2014Sketching as a Tool for Numerical Linear Algebracited by 285
  5. 2013Bayesian Optimization in a Billion Dimensions via Random Embeddingscited by 178
  6. 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 139
  7. 2020Re-Examining Linear Embeddings for High-Dimensional Bayesian Optimizationcited by 89
  8. 2020Learning Search Space Partition for Black-box Optimization using Monte Carlo Tree Searchcited by 87
  9. 2020Scalable Constrained Bayesian Optimizationcited by 84
  10. 2016Multi-Information Source Optimizationcited by 83
  11. 2019Combinatorial Bayesian Optimization using the Graph Cartesian Productcited by 78
  12. 2017Parallel and Distributed Thompson Sampling for Large-scale Accelerated Exploration of Chemical Spacecited by 76
27 more
  1. 2021A survey on high-dimensional Gaussian process modeling with application to Bayesian optimizationcited by 76
  2. 2022Recent Advances in Bayesian Optimizationcited by 74
  3. 2018Bayesian Optimization of Combinatorial Structurescited by 64
  4. 2017The reparameterization trick for acquisition functionscited by 61
  5. 2019Bayesian Optimisation over Multiple Continuous and Categorical Inputscited by 55
  6. 2021Think Global and Act Local: Bayesian Optimisation over High-Dimensional Categorical and Mixed Search Spacescited by 51
  7. 2023Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspacescited by 50
  8. 2016Parallel Bayesian Global Optimization of Expensive Functionscited by 43
  9. 2021LassoBench: A High-Dimensional Hyperparameter Optimization Benchmark Suite for Lassocited by 41
  10. 2022Monte Carlo Tree Search based Variable Selection for High Dimensional Bayesian Optimizationcited by 37
  11. 2018Practical Design Space Explorationcited by 35
  12. 2022Bayesian Optimization over Discrete and Mixed Spaces via Probabilistic Reparameterizationcited by 35
  13. 2023Are Random Decompositions all we need in High Dimensional Bayesian Optimisation?cited by 35
  14. 2020Gryffin: An algorithm for Bayesian optimization of categorical variables informed by expert knowledgecited by 30
  15. 2017On the choice of the low-dimensional domain for global optimization via random embeddingscited by 25
  16. 2023Bayesian Optimization over High-Dimensional Combinatorial Spaces via Dictionary-based Embeddingscited by 24
  17. 2014A warped kernel improving robustness in Bayesian optimization via random embeddingscited by 17
  18. 2017Bayesian Optimization Using Domain Knowledge on the ATRIAS Bipedcited by 17
  19. 2021Bayesian Optimization over Permutation Spacescited by 17
  20. 2022Tree ensemble kernels for Bayesian optimization with known constraints over mixed-feature spacescited by 14
  21. 2022BaCO: A Fast and Portable Bayesian Compiler Optimization Frameworkcited by 11
  22. 2015Low Autocorrelation Binary Sequencescited by 10
  23. 2022Skill-based Multi-objective Reinforcement Learning of Industrial Robot Tasks with Planning and Knowledge Integrationcited by 10
  24. 2022Global Optimization with Parametric Function Approximationcited by 7
  25. 2020Combinatorial Bayesian Optimization with Random Mapping Functions to Convex Polytopescited by 6
  26. 2019DeepFreak: Learning Crystallography Diffraction Patterns with Automated Machine Learningcited by 3
  27. 2022Autonomous Drug Design with Multi-Armed Banditscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 13; 2026: 10.

27 papers.

Sort:

By area:

  1. 2024A survey and benchmark of high-dimensional Bayesian optimization of discrete sequencescited by 22
  2. 2025Understanding High-Dimensional Bayesian Optimizationcited by 19
  3. 2025Return of the Latent Space COWBOYS: Re-thinking the use of VAEs for Bayesian Optimisation of Structured Spacescited by 13
  4. 2025We Still Don't Understand High-Dimensional Bayesian Optimizationcited by 9
  5. 2023High-dimensional Bayesian Optimization with Group Testingcited by 5
  6. 2026PathWise: Planning through World Model for Automated Heuristic Design via Self-Evolving LLMscited by 5
  7. 2024Optimistic Games for Combinatorial Bayesian Optimization with Application to Protein Designcited by 4
  8. 2024Regional Expected Improvement for Efficient Trust Region Selection in High-Dimensional Bayesian Optimizationcited by 3
  9. 2025CoTune: Co-evolutionary Configuration Tuningcited by 2
  10. 2026Personalized Image Generation via Human-in-the-loop Bayesian Optimizationcited by 2
  11. 2026Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation?cited by 2
  12. 2025Leveraging Axis-Aligned Subspaces for High-Dimensional Bayesian Optimization with Group Testingcited by 1
15 more
  1. 2025Bencher: Simple and Reproducible Benchmarking for Black-Box Optimizationcited by 1
  2. 2025Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systemscited by 1
  3. 2025Omnipresent Yet Overlooked: Heat Kernels in Combinatorial Bayesian Optimizationcited by 1
  4. 2025Modeling All Response Surfaces in One for Conditional Search Spacescited by 0
  5. 2025Pushing the Limits of the Reactive Affine Shaker Algorithm to Higher Dimensionscited by 0
  6. 2025Weighted Euclidean Distance Matrices over Mixed Continuous and Categorical Inputs for Gaussian Process Modelscited by 0
  7. 2025Tree-Structured Parzen Estimator Can Solve Black-Box Combinatorial Optimization More Efficientlycited by 0
  8. 2025MOCA-HESP: Meta High-dimensional Bayesian Optimization for Combinatorial and Mixed Spaces via Hyper-ellipsoid Partitioningcited by 0
  9. 2026Regime-Adaptive Bayesian Optimization via Dirichlet Process Mixtures of Gaussian Processescited by 0
  10. 2026Certificate-Guided Pruning for Stochastic Lipschitz Optimizationcited by 0
  11. 2026SMOG: Scalable Meta-Learning for Multi-Objective Bayesian Optimizationcited by 0
  12. 2026mlr3mbo: Bayesian Optimization in Rcited by 0
  13. 2026Trajectory-Aware Best-Arm Identification for Local Search Allocation in Bayesian Optimization and Beyondcited by 0
  14. 2026Converge Then Diversify: Decoupling Convergence and Diversity in Multi-Objective Bayesian Optimisationcited by 0
  15. 2026Bayesian Optimization with Fisher Information Geometry: Gradient Bounds and Trust-Region Methodscited by 0