# Gaussian Process Subspace Regression for Model Reduction

arXiv: https://arxiv.org/abs/2107.04668 · HTML: https://mlsanity.com/paper/2107.04668/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 6 of its 51 references that are in the map.
- First posted on arXiv 9 Jul 2021.

## Builds on (most cited first, 6 of 6)

- [Local Gaussian process approximation for large computer experiments](https://mlsanity.com/paper/1303.0383/) (2013)
- [Fr'echet Regression for Random Objects with Euclidean Predictors](https://mlsanity.com/paper/1608.03012/) (2016)
- [Extrinsic Gaussian processes for regression and classification on manifolds](https://mlsanity.com/paper/1706.08757/) (2017)
- [Function-on-function kriging, with applications to 3D printing of aortic tissues](https://mlsanity.com/paper/1910.01754/) (2019)
- [Intrinsic Gaussian processes on complex constrained domains](https://mlsanity.com/paper/1801.01061/) (2018)
- [Normal-bundle Bootstrap](https://mlsanity.com/paper/2007.13869/) (2020)

## Built on by (most cited first, 1 of 1)

- [Regression Trees on Grassmann Manifold for Adapting Reduced-Order Models](https://mlsanity.com/paper/2206.11324/) (2022)

## Abstract (arXiv)

Subspace-valued functions arise in a wide range of problems, including parametric reduced order modeling (PROM). In PROM, each parameter point can be associated with a subspace, which is used for Petrov-Galerkin projections of large system matrices. Previous efforts to approximate such functions use interpolations on manifolds, which can be inaccurate and slow. To tackle this, we propose a novel Bayesian nonparametric model for subspace prediction: the Gaussian Process Subspace regression (GPS) model. This method is extrinsic and intrinsic at the same time: with multivariate Gaussian distributions on the Euclidean space, it induces a joint probability model on the Grassmann manifold, the set of fixed-dimensional subspaces. The GPS adopts a simple yet general correlation structure, and a principled approach for model selection. Its predictive distribution admits an analytical form, which allows for efficient subspace prediction over the parameter space. For PROM, the GPS provides a probabilistic prediction at a new parameter point that retains the accuracy of local reduced models, at a computational complexity that does not depend on system dimension, and thus is suitable for online computation. We give four numerical examples to compare our method to subspace interpolation, as well as two methods that interpolate local reduced models. Overall, GPS is the most data efficient, more computationally efficient than subspace interpolation, and gives smooth predictions with uncertainty quantification.
