# A Similarity Measure of Gaussian Process Predictive Distributions

arXiv: https://arxiv.org/abs/2101.08061 · HTML: https://mlsanity.com/paper/2101.08061/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 8 of its 24 references that are in the map.
- First posted on arXiv 20 Jan 2021.

## Builds on (most cited first, 8 of 8)

- [Deep Neural Networks as Gaussian Processes](https://mlsanity.com/paper/1711.00165/) (2017)
- [Predictive Entropy Search for Multi-objective Bayesian Optimization](https://mlsanity.com/paper/1511.05467/) (2015)
- [Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints](https://mlsanity.com/paper/1609.01051/) (2016)
- [Parallel Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints](https://mlsanity.com/paper/2004.00601/) (2020)
- [A Machine Consciousness architecture based on Deep Learning and Gaussian Processes](https://mlsanity.com/paper/2002.00509/) (2020)
- [Bayesian optimization of the PC algorithm for learning Gaussian Bayesian networks](https://mlsanity.com/paper/1806.11015/) (2018)
- [Suggesting Cooking Recipes Through Simulation and Bayesian Optimization](https://mlsanity.com/paper/1811.03868/) (2018)
- [An Artificial Consciousness Model and its relations with Philosophy of Mind](https://mlsanity.com/paper/2011.14475/) (2020)

## Built on by (most cited first, 2 of 2)

- [Many Objective Bayesian Optimization](https://mlsanity.com/paper/2107.04126/) (2021)
- [Measuring Time-Series Dataset Similarity using Wasserstein Distance](https://mlsanity.com/paper/2507.22189/) (2025)

## Abstract (arXiv)

Some scenarios require the computation of a predictive distribution of a new value evaluated on an objective function conditioned on previous observations. We are interested on using a model that makes valid assumptions on the objective function whose values we are trying to predict. Some of these assumptions may be smoothness or stationarity. Gaussian process (GPs) are probabilistic models that can be interpreted as flexible distributions over functions. They encode the assumptions through covariance functions, making hypotheses about new data through a predictive distribution by being fitted to old observations. We can face the case where several GPs are used to model different objective functions. GPs are non-parametric models whose complexity is cubic on the number of observations. A measure that represents how similar is one GP predictive distribution with respect to another would be useful to stop using one GP when they are modelling functions of the same input space. We are really inferring that two objective functions are correlated, so one GP is enough to model both of them by performing a transformation of the prediction of the other function in case of inverse correlation. We show empirical evidence in a set of synthetic and benchmark experiments that GPs predictive distributions can be compared and that one of them is enough to predict two correlated functions in the same input space. This similarity metric could be extremely useful used to discard objectives in Bayesian many-objective optimization.