# Student-t Processes as Alternatives to Gaussian Processes

arXiv: https://arxiv.org/abs/1402.4306 · HTML: https://mlsanity.com/paper/1402.4306/

## Key facts

- Cited by 45 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Feb 2014.

## Built on by (most cited first, 30 of 45)

- [Priors in Bayesian Deep Learning: A Review](https://mlsanity.com/paper/2105.06868/) (2021)
- [PFNs4BO: In-Context Learning for Bayesian Optimization](https://mlsanity.com/paper/2305.17535/) (2023)
- [Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI](https://mlsanity.com/paper/2402.00809/) (2024)
- [Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks](https://mlsanity.com/paper/2307.11807/) (2023)
- [Non-smooth Bayesian Optimization in Tuning Problems](https://mlsanity.com/paper/2109.07563/) (2021)
- [Sparse Variational Student-t Processes](https://mlsanity.com/paper/2312.05568/) (2023)
- [Robust Gaussian Processes via Relevance Pursuit](https://mlsanity.com/paper/2410.24222/) (2024)
- [Deep Stochastic Processes via Functional Markov Transition Operators](https://mlsanity.com/paper/2305.15574/) (2023)
- [Robust Estimation of Causal Heteroscedastic Noise Models](https://mlsanity.com/paper/2312.10102/) (2023)
- [Scale Mixtures of Neural Network Gaussian Processes](https://mlsanity.com/paper/2107.01408/) (2021)
- [MARS: Meta-Learning as Score Matching in the Function Space](https://mlsanity.com/paper/2210.13319/) (2022)
- [Identifiable Feature Learning for Spatial Data with Nonlinear ICA](https://mlsanity.com/paper/2311.16849/) (2023)
- [Partially Observed Exchangeable Modeling](https://mlsanity.com/paper/2102.06083/) (2021)
- [Bayesian Learning via Q-Exponential Process](https://mlsanity.com/paper/2210.07987/) (2022)
- [Enhanced Bayesian Optimization via Preferential Modeling of Abstract Properties](https://mlsanity.com/paper/2402.17343/) (2024)
- [Student-t processes as infinite-width limits of posterior Bayesian neural networks](https://mlsanity.com/paper/2502.04247/) (2025)
- [Explaining Inference Queries with Bayesian Optimization](https://mlsanity.com/paper/2102.05308/) (2021)
- [Non-Gaussian Process Regression](https://mlsanity.com/paper/2209.03117/) (2022)
- [Sparse Variational Student-t Processes for Heavy-tailed Modeling](https://mlsanity.com/paper/2408.06699/) (2024)
- [LatentFlow: A General Framework for Conditioning Stochastic Processes](https://mlsanity.com/paper/2607.12922/) (2026)
- [An Empirical Analysis of the Advantages of Finite- v.s. Infinite-Width Bayesian Neural Networks](https://mlsanity.com/paper/2211.09184/) (2022)
- [Bayesian inference with finitely wide neural networks](https://mlsanity.com/paper/2303.02859/) (2023)
- [Variational Elliptical Processes](https://mlsanity.com/paper/2311.12566/) (2023)
- [Gearing Gaussian process modeling and sequential design towards stochastic simulators](https://mlsanity.com/paper/2412.07306/) (2024)
- [Robust Bayesian Optimisation with Unbounded Corruptions](https://mlsanity.com/paper/2511.15315/) (2025)
- [GGMPs: Generalized Gaussian Mixture Processes](https://mlsanity.com/paper/2603.10442/) (2026)
- [One-parameter family of acquisition functions for efficient global optimization](https://mlsanity.com/paper/2104.12363/) (2021)
- [Scale invariant process regression: Towards Bayesian ML with minimal assumptions](https://mlsanity.com/paper/2208.10461/) (2022)
- [Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holes](https://mlsanity.com/paper/2303.14291/) (2023)
- [Online Student-t Processes with an Overall-local Scale Structure for Modelling Non-stationary Data](https://mlsanity.com/paper/2311.00564/) (2023)

## Abstract (arXiv)

We investigate the Student-t process as an alternative to the Gaussian process as a nonparametric prior over functions. We derive closed form expressions for the marginal likelihood and predictive distribution of a Student-t process, by integrating away an inverse Wishart process prior over the covariance kernel of a Gaussian process model. We show surprising equivalences between different hierarchical Gaussian process models leading to Student-t processes, and derive a new sampling scheme for the inverse Wishart process, which helps elucidate these equivalences. Overall, we show that a Student-t process can retain the attractive properties of a Gaussian process -- a nonparametric representation, analytic marginal and predictive distributions, and easy model selection through covariance kernels -- but has enhanced flexibility, and predictive covariances that, unlike a Gaussian process, explicitly depend on the values of training observations. We verify empirically that a Student-t process is especially useful in situations where there are changes in covariance structure, or in applications like Bayesian optimization, where accurate predictive covariances are critical for good performance. These advantages come at no additional computational cost over Gaussian processes.
