mlsanityData to 7 Oct 2026

High-dimensional mixed-categorical Gaussian processes with application to multidisciplinary design optimization for a green aircraft

arXiv 2311.06130 ↗First posted 10 Nov 2023math.OC cs.AI stat.MLcited by 8

Not on the map. Why?

Abstract (arXiv)

Recently, there has been a growing interest in mixed-categorical metamodels based on Gaussian Process (GP) for Bayesian optimization. In this context, different approaches can be used to build the mixed-categorical GP. Many of these approaches involve a high number of hyperparameters; in fact, the more general and precise the strategy used to build the GP, the greater the number of hyperparameters to estimate. This paper introduces an innovative dimension reduction algorithm that relies on partial least squares regression to reduce the number of hyperparameters used to build a mixed-variable GP. Our goal is to generalize classical dimension reduction techniques commonly used within GP (for continuous inputs) to handle mixed-categorical inputs. The good potential of the proposed method is demonstrated in both structural and multidisciplinary application contexts. The targeted applications include the analysis of a cantilever beam as well as the optimization of a green aircraft, resulting in a significant 439-kilogram reduction in fuel consumption during a single mission.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 19 of its 73 references that are in the map. First posted on arXiv 10 Nov 2023.

Builds on

19 of 73 references.

References · 19

  1. 2015Scalable Bayesian Optimization Using Deep Neural Networkscited by 284
  2. 2020pymoo: Multi-objective Optimization in Pythoncited by 196
  3. 2017Dealing with Integer-valued Variables in Bayesian Optimization with Gaussian Processescited by 65
  4. 2017Batched High-dimensional Bayesian Optimization via Structural Kernel Learningcited by 51
  5. 2013Active Learning of Linear Embeddings for Gaussian Processescited by 34
  6. 2021TREGO: a Trust-Region Framework for Efficient Global Optimizationcited by 28
  7. 2023SMT 2.0: A Surrogate Modeling Toolbox with a focus on Hierarchical and Mixed Variables Gaussian Processescited by 27
  8. 2021Latent Map Gaussian Processes for Mixed Variable Metamodelingcited by 23
  9. 2018Group kernels for Gaussian process metamodels with categorical inputscited by 22
  10. 2022A mixed-categorical correlation kernel for Gaussian processcited by 19
  11. 2017Gradient-enhanced kriging for high-dimensional problemscited by 15
  12. 2018Efficient global optimization of constrained mixed variable problemscited by 11
7 more
  1. 2020Upper Trust Bound Feasibility Criterion for Mixed Constrained Bayesian Optimization with Application to Aircraft Designcited by 11
  2. 2021Deep Gaussian Process Emulation using Stochastic Imputationcited by 11
  3. 2021Revisiting Bayesian Optimization in the light of the COCO benchmarkcited by 10
  4. 2018Global sensitivity analysis for optimization with variable selectioncited by 9
  5. 2022A general mathematical framework for constrained mixed-variable blackbox optimization problems with meta and categorical variablescited by 8
  6. 2021A comparison of mixed-variables Bayesian optimization approachescited by 6
  7. 2020Multioutput Gaussian Processes with Functional Data: A Study on Coastal Flood Hazard Assessmentcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 2.

8 papers.