# Integrals over Gaussians under Linear Domain Constraints

arXiv: https://arxiv.org/abs/1910.09328 · HTML: https://mlsanity.com/paper/1910.09328/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Oct 2019.

## Built on by (most cited first, 15 of 15)

- [Towards Practical Preferential Bayesian Optimization with Skew Gaussian Processes](https://mlsanity.com/paper/2302.01513/) (2023)
- [Evaluating State-of-the-Art Classification Models Against Bayes Optimality](https://mlsanity.com/paper/2106.03357/) (2021)
- [Practical estimation of the optimal classification error with soft labels and calibration](https://mlsanity.com/paper/2505.20761/) (2025)
- [Robust Entropy Search for Safe Efficient Bayesian Optimization](https://mlsanity.com/paper/2405.19059/) (2024)
- [Reversibility of elliptical slice sampling revisited](https://mlsanity.com/paper/2301.02426/) (2023)
- [Learning Correlated Reward Models: Statistical Barriers and Opportunities](https://mlsanity.com/paper/2510.15839/) (2025)
- [Bayesian Optimization for Min Max Optimization](https://mlsanity.com/paper/2107.13772/) (2021)
- [Choice functions based multi-objective Bayesian optimisation](https://mlsanity.com/paper/2110.08217/) (2021)
- [Efficiently Computable Safety Bounds for Gaussian Processes in Active Learning](https://mlsanity.com/paper/2402.18260/) (2024)
- [Batched Bayesian optimization by maximizing the probability of including the optimum](https://mlsanity.com/paper/2410.06333/) (2024)
- [A Fast, Robust Elliptical Slice Sampling Implementation for Linearly Truncated Multivariate Normal Distributions](https://mlsanity.com/paper/2407.10449/) (2024)
- [Knowledge Gradient for Preference Learning](https://mlsanity.com/paper/2601.22335/) (2026)
- [Sampling Constrained Continuous Probability Distributions: A Review](https://mlsanity.com/paper/2209.12403/) (2022)
- [Copula-Based Density Estimation Models for Multivariate Zero-Inflated Continuous Data](https://mlsanity.com/paper/2304.00537/) (2023)
- [Functional Risk Minimization](https://mlsanity.com/paper/2412.21149/) (2024)

## Abstract (arXiv)

Integrals of linearly constrained multivariate Gaussian densities are a frequent problem in machine learning and statistics, arising in tasks like generalized linear models and Bayesian optimization. Yet they are notoriously hard to compute, and to further complicate matters, the numerical values of such integrals may be very small. We present an efficient black-box algorithm that exploits geometry for the estimation of integrals over a small, truncated Gaussian volume, and to simulate therefrom. Our algorithm uses the Holmes-Diaconis-Ross (HDR) method combined with an analytic version of elliptical slice sampling (ESS). Adapted to the linear setting, ESS allows for rejection-free sampling, because intersections of ellipses and domain boundaries have closed-form solutions. The key idea of HDR is to decompose the integral into easier-to-compute conditional probabilities by using a sequence of nested domains. Remarkably, it allows for direct computation of the logarithm of the integral value and thus enables the computation of extremely small probability masses. We demonstrate the effectiveness of our tailored combination of HDR and ESS on high-dimensional integrals and on entropy search for Bayesian optimization.