# A Bayesian approach to constrained single- and multi-objective optimization

arXiv: https://arxiv.org/abs/1510.00503 · HTML: https://mlsanity.com/paper/1510.00503/

## Key facts

- Cited by 23 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Oct 2015.

## Built on by (most cited first, 23 of 23)

- [A survey on multi-objective hyperparameter optimization algorithms for Machine Learning](https://mlsanity.com/paper/2111.13755/) (2021)
- [Fair and Green Hyperparameter Optimization via Multi-objective and Multiple Information Source Bayesian Optimization](https://mlsanity.com/paper/2205.08835/) (2022)
- [Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization](https://mlsanity.com/paper/2110.06980/) (2021)
- [Revisiting Bayesian Optimization in the light of the COCO benchmark](https://mlsanity.com/paper/2103.16649/) (2021)
- [Reasoning BO: Enhancing Bayesian Optimization with Long-Context Reasoning Power of LLMs](https://mlsanity.com/paper/2505.12833/) (2025)
- [Leveraging Trust for Joint Multi-Objective and Multi-Fidelity Optimization](https://mlsanity.com/paper/2112.13901/) (2021)
- [Adaptive Token Merging for Efficient Transformer Semantic Communication at the Edge](https://mlsanity.com/paper/2509.09955/) (2025)
- [Constrained Causal Bayesian Optimization](https://mlsanity.com/paper/2305.20011/) (2023)
- [Constrained Multi-objective Bayesian Optimization through Optimistic Constraints Estimation](https://mlsanity.com/paper/2411.03641/) (2024)
- [PF2ES: Parallel Feasible Pareto Frontier Entropy Search for Multi-Objective Bayesian Optimization](https://mlsanity.com/paper/2204.05411/) (2022)
- [Preference-Aware Constrained Multi-Objective Bayesian Optimization](https://mlsanity.com/paper/2303.13034/) (2023)
- [Regularized infill criteria for multi-objective Bayesian optimization with application to aircraft design](https://mlsanity.com/paper/2504.08671/) (2025)
- [Gaussian process interpolation with conformal prediction: methods and comparative analysis](https://mlsanity.com/paper/2407.08271/) (2024)
- [Relaxed Gaussian process interpolation: a goal-oriented approach to Bayesian optimization](https://mlsanity.com/paper/2206.03034/) (2022)
- [Bi-objective Ranking and Selection Using Stochastic Kriging](https://mlsanity.com/paper/2209.03919/) (2022)
- [Bayesian multi-objective optimization for stochastic simulators: an extension of the Pareto Active Learning method](https://mlsanity.com/paper/2207.03842/) (2022)
- [Constrained multi-objective optimization of process design parameters in settings with scarce data: an application to adhesive bonding](https://mlsanity.com/paper/2112.08760/) (2021)
- [ATM-R: An Adaptive Tradeoff Model with Reference Points for Constrained Multiobjective Evolutionary Optimization](https://mlsanity.com/paper/2301.03317/) (2023)
- [Bayesian optimization for stable properties amid processing fluctuations in sputter deposition](https://mlsanity.com/paper/2405.03092/) (2024)
- [Non-linear Multi-objective Optimization with Probabilistic Branch and Bound](https://mlsanity.com/paper/2506.04554/) (2025)
- [An Efficient Application of Goal Programming to Tackle Multiobjective Problems with Recurring Fitness Landscapes](https://mlsanity.com/paper/2508.08297/) (2025)
- [Goal-Oriented Lower-Tail Calibration of Gaussian Processes for Bayesian Optimization](https://mlsanity.com/paper/2605.20145/) (2026)
- [Portfolio-Based Constrained Multi-Objective Bayesian Optimization for Materials Design](https://mlsanity.com/paper/2609.19550/) (2026)

## Abstract (arXiv)

This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to evaluate. As a consequence, the number of evaluations that can be used to carry out the optimization is very limited, as in complex industrial design optimization problems. The method we propose to overcome this difficulty has its roots in both the Bayesian and the multi-objective optimization literatures. More specifically, an extended domination rule is used to handle objectives and constraints in a unified way, and a corresponding expected hyper-volume improvement sampling criterion is proposed. This new criterion is naturally adapted to the search of a feasible point when none is available, and reduces to existing Bayesian sampling criteria---the classical Expected Improvement (EI) criterion and some of its constrained/multi-objective extensions---as soon as at least one feasible point is available. The calculation and optimization of the criterion are performed using Sequential Monte Carlo techniques. In particular, an algorithm similar to the subset simulation method, which is well known in the field of structural reliability, is used to estimate the criterion. The method, which we call BMOO (for Bayesian Multi-Objective Optimization), is compared to state-of-the-art algorithms for single- and multi-objective constrained optimization.