mlsanityData to 7 Oct 2026

Weighted Euclidean Distance Matrices over Mixed Continuous and Categorical Inputs for Gaussian Process Models

arXiv 2503.02630 ↗First posted 4 Mar 2025stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Gaussian Process (GP) models are widely utilized as surrogate models in scientific and engineering fields. However, standard GP models are limited to continuous variables due to the difficulties in establishing correlation structures for categorical variables. To overcome this limitati on, we introduce WEighted Euclidean distance matrices Gaussian Process (WEGP). WEGP constructs the kernel function for each categorical input by estimating the Euclidean distance matrix (EDM) among all categorical choices of this input. The EDM is represented as a linear combination of several predefined base EDMs, each scaled by a positive weight. The weights, along with other kernel hyperparameters, are inferred using a fully Bayesian framework. We analyze the predictive performance of WEGP theoretically. Numerical experiments validate the accuracy of our GP model, and by WEGP, into Bayesian Optimization (BO), we achieve superior performance on both synthetic and real-world optimization problems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 4 Mar 2025.

Builds on

25 of 52 references.

References · 25

  1. 2021Convex optimizationcited by 2,479
  2. 2018A Tutorial on Bayesian Optimizationcited by 734
  3. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
  4. 2018Neural Architecture Search with Bayesian Optimisation and Optimal Transportcited by 192
  5. 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 139
  6. 2015Batch Bayesian Optimization via Local Penalizationcited by 103
  7. 2019ChemBO: Bayesian Optimization of Small Organic Molecules with Synthesizable Recommendationscited by 77
  8. 2017Parallel and Distributed Thompson Sampling for Large-scale Accelerated Exploration of Chemical Spacecited by 76
  9. 2017Dealing with Integer-valued Variables in Bayesian Optimization with Gaussian Processescited by 65
  10. 2018Bayesian Optimization of Combinatorial Structurescited by 64
  11. 2021Think Global and Act Local: Bayesian Optimisation over High-Dimensional Categorical and Mixed Search Spacescited by 51
  12. 2021Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spacescited by 45
13 more
  1. 2018A Latent Variable Approach to Gaussian Process Modeling with Qualitative and Quantitative Factorscited by 30
  2. 2019Mixed-Variable Bayesian Optimizationcited by 29
  3. 2020Optimal Transport Kernels for Sequential and Parallel Neural Architecture Searchcited by 29
  4. 2023Bounce: Reliable High-Dimensional Bayesian Optimization for Combinatorial and Mixed Spacescited by 27
  5. 2023Bayesian Optimization over High-Dimensional Combinatorial Spaces via Dictionary-based Embeddingscited by 24
  6. 2021Latent Map Gaussian Processes for Mixed Variable Metamodelingcited by 23
  7. 2019Knowing The What But Not The Where in Bayesian Optimizationcited by 20
  8. 2022A mixed-categorical correlation kernel for Gaussian processcited by 19
  9. 2023Framework and Benchmarks for Combinatorial and Mixed-variable Bayesian Optimizationcited by 15
  10. 2020Black-box Mixed-Variable Optimisation using a Surrogate Model that Satisfies Integer Constraintscited by 9
  11. 2020Uncertainty Quantification for Bayesian Optimizationcited by 7
  12. 2023Batch Bayesian Optimization for Replicable Experimental Designcited by 7
  13. 2021Measuring the robustness of Gaussian processes to kernel choicecited by 6

Built on by

Not cited yet.