# Aggregating Dependent Gaussian Experts in Local Approximation

arXiv: https://arxiv.org/abs/2010.08873 · HTML: https://mlsanity.com/paper/2010.08873/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 Oct 2020.

## Built on by (most cited first, 3 of 3)

- [Gaussian Experts Selection using Graphical Models](https://mlsanity.com/paper/2102.01496/) (2021)
- [Gaussian Graphical Models as an Ensemble Method for Distributed Gaussian Processes](https://mlsanity.com/paper/2202.03287/) (2022)
- [Entry Dependent Expert Selection in Distributed Gaussian Processes Using Multilabel Classification](https://mlsanity.com/paper/2211.09940/) (2022)

## Abstract (arXiv)

Distributed Gaussian processes (DGPs) are prominent local approximation methods to scale Gaussian processes (GPs) to large datasets. Instead of a global estimation, they train local experts by dividing the training set into subsets, thus reducing the time complexity. This strategy is based on the conditional independence assumption, which basically means that there is a perfect diversity between the local experts. In practice, however, this assumption is often violated, and the aggregation of experts leads to sub-optimal and inconsistent solutions. In this paper, we propose a novel approach for aggregating the Gaussian experts by detecting strong violations of conditional independence. The dependency between experts is determined by using a Gaussian graphical model, which yields the precision matrix. The precision matrix encodes conditional dependencies between experts and is used to detect strongly dependent experts and construct an improved aggregation. Using both synthetic and real datasets, our experimental evaluations illustrate that our new method outperforms other state-of-the-art (SOTA) DGP approaches while being substantially more time-efficient than SOTA approaches, which build on independent experts.