MCMC for Variationally Sparse Gaussian Processes
Not on the map. Why?
Abstract (arXiv)
Gaussian process (GP) models form a core part of probabilistic machine learning. Considerable research effort has been made into attacking three issues with GP models: how to compute efficiently when the number of data is large; how to approximate the posterior when the likelihood is not Gaussian and how to estimate covariance function parameter posteriors. This paper simultaneously addresses these, using a variational approximation to the posterior which is sparse in support of the function but otherwise free-form. The result is a Hybrid Monte-Carlo sampling scheme which allows for a non-Gaussian approximation over the function values and covariance parameters simultaneously, with efficient computations based on inducing-point sparse GPs. Code to replicate each experiment in this paper will be available shortly.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 10; 2023: 6; 2024: 5; 2025: 8; 2026: 4.
44 papers.
Sort:
- 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
- 2021Connections and Equivalences between the Nystr"om Method and Sparse Variational Gaussian Processescited by 17
- 2021Variational multiple shooting for Bayesian ODEs with Gaussian processescited by 15
- 2022Safe Active Learning for Multi-Output Gaussian Processescited by 13
- 2021SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processescited by 9
- 2022Bayesian Calibration of Imperfect Computer Models using Physics-Informed Priorscited by 9
- 2023Fully Bayesian Autoencoders with Latent Sparse Gaussian Processescited by 9
- 2024Improving sample efficiency of high dimensional Bayesian optimization with MCMCcited by 9
- 2022Variational Nearest Neighbor Gaussian Processcited by 8
- 2021Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processescited by 7
- 2023Free-Form Variational Inference for Gaussian Process State-Space Modelscited by 7
- 2021Hierarchical Inducing Point Gaussian Process for Inter-domain Observationscited by 6
32 more
- 2022Semi-Parametric Inducing Point Networks and Neural Processescited by 6
- 2023Learning Energy Conserving Dynamics Efficiently with Hamiltonian Gaussian Processescited by 6
- 2025Koopman-Equivariant Gaussian Processescited by 6
- 2021Input Dependent Sparse Gaussian Processescited by 5
- 2022Gaussian Processes for Missing Value Imputationcited by 5
- 2022Sparse Gaussian Process Hyperparameters: Optimize or Integrate?cited by 4
- 2023Actually Sparse Variational Gaussian Processescited by 4
- 2024Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equationscited by 4
- 2021Calibrated simplex-mapping classificationcited by 3
- 2025Neighbour-Driven Gaussian Process Variational Autoencoders for Scalable Structured Latent Modellingcited by 3
- 2025Transformer with Koopman-Enhanced Graph Convolutional Network for Spatiotemporal Dynamics Forecastingcited by 3
- 2023Gradient and Uncertainty Enhanced Sequential Sampling for Global Fitcited by 2
- 2025Recurrent Memory for Online Interdomain Gaussian Processescited by 2
- 2021On MCMC for variationally sparse Gaussian processes: A pseudo-marginal approachcited by 1
- 2021Nonlinear Hawkes Process with Gaussian Process Self Effectscited by 1
- 2021Geometry-Aware Hierarchical Bayesian Learning on Manifoldscited by 1
- 2022Modelling calibration uncertainty in networks of environmental sensorscited by 1
- 2022Learning Physics between Digital Twins with Low-Fidelity Models and Physics-Informed Gaussian Processescited by 1
- 2023Spherical Inducing Features for Orthogonally-Decoupled Gaussian Processescited by 1
- 2024Hyperbolic Secant representation of the logistic function: Application to probabilistic Multiple Instance Learning for CT intracranial hemorrhage detectioncited by 1
- 2025Flow-Induced Diagonal Gaussian Processescited by 1
- 2026Safe Reinforcement Learning via Recovery-based Shielding with Gaussian Process Dynamics Modelscited by 1
- 2022A Bayesian Approach To Graph Partitioningcited by 0
- 2022Virgo: Scalable Unsupervised Classification of Cosmological Shock Wavescited by 0
- 2024Active Learning of Molecular Data for Task-Specific Objectivescited by 0
- 2024Gearing Gaussian process modeling and sequential design towards stochastic simulatorscited by 0
- 2025Adaptive Replication Strategies in Trust-Region-Based Bayesian Optimization of Stochastic Functionscited by 0
- 2025Surrogate Graph Partitioning for Spatial Predictioncited by 0
- 2025Fast Riemannian-manifold Hamiltonian Monte Carlo for hierarchical Gaussian-process modelscited by 0
- 2026Simplex-to-Euclidean Bijection for Conjugate and Calibrated Multiclass Gaussian Process Classificationcited by 0
- 2026Inverse-Free Sparse Variational Gaussian Processescited by 0
- 2026Sequential sparse Gaussian process quantile regressioncited by 0
- 2026Sequential sparse Gaussian process quantile regression30 Jun 2026
- 2026Inverse-Free Sparse Variational Gaussian Processes1 Apr 2026
- 2026Simplex-to-Euclidean Bijection for Conjugate and Calibrated Multiclass Gaussian Process Classification17 Mar 2026
- 2026Safe Reinforcement Learning via Recovery-based Shielding with Gaussian Process Dynamics Models12 Feb 2026
- 2025Fast Riemannian-manifold Hamiltonian Monte Carlo for hierarchical Gaussian-process models9 Nov 2025
- 2025Surrogate Graph Partitioning for Spatial Prediction9 Oct 2025
- 2025Flow-Induced Diagonal Gaussian Processes21 Sep 2025
- 2025Transformer with Koopman-Enhanced Graph Convolutional Network for Spatiotemporal Dynamics Forecasting5 Jul 2025
- 2025Neighbour-Driven Gaussian Process Variational Autoencoders for Scalable Structured Latent Modelling22 May 2025
- 2025Adaptive Replication Strategies in Trust-Region-Based Bayesian Optimization of Stochastic Functions29 Apr 2025
- 2025Recurrent Memory for Online Interdomain Gaussian Processes12 Feb 2025
- 2025Koopman-Equivariant Gaussian Processes10 Feb 2025
32 more
- 2024Gearing Gaussian process modeling and sequential design towards stochastic simulators10 Dec 2024
- 2024Active Learning of Molecular Data for Task-Specific Objectives20 Aug 2024
- 2024Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equations12 Aug 2024
- 2024Hyperbolic Secant representation of the logistic function: Application to probabilistic Multiple Instance Learning for CT intracranial hemorrhage detection21 Mar 2024
- 2024Improving sample efficiency of high dimensional Bayesian optimization with MCMC5 Jan 2024
- 2023Gradient and Uncertainty Enhanced Sequential Sampling for Global Fit29 Sep 2023
- 2023Spherical Inducing Features for Orthogonally-Decoupled Gaussian Processes27 Apr 2023
- 2023Actually Sparse Variational Gaussian Processes11 Apr 2023
- 2023Learning Energy Conserving Dynamics Efficiently with Hamiltonian Gaussian Processes3 Mar 2023
- 2023Free-Form Variational Inference for Gaussian Process State-Space Models20 Feb 2023
- 2023Fully Bayesian Autoencoders with Latent Sparse Gaussian Processes9 Feb 2023
- 2022Sparse Gaussian Process Hyperparameters: Optimize or Integrate?4 Nov 2022
- 2022Virgo: Scalable Unsupervised Classification of Cosmological Shock Waves14 Aug 2022
- 2022Learning Physics between Digital Twins with Low-Fidelity Models and Physics-Informed Gaussian Processes16 Jun 2022
- 2022Semi-Parametric Inducing Point Networks and Neural Processes24 May 2022
- 2022Modelling calibration uncertainty in networks of environmental sensors4 May 2022
- 2022A Bayesian Approach To Graph Partitioning24 Apr 2022
- 2022Gaussian Processes for Missing Value Imputation10 Apr 2022
- 2022Safe Active Learning for Multi-Output Gaussian Processes28 Mar 2022
- 2022Variational Nearest Neighbor Gaussian Process3 Feb 2022
- 2022Bayesian Calibration of Imperfect Computer Models using Physics-Informed Priors17 Jan 2022
- 2021Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processes8 Nov 2021
- 2021Geometry-Aware Hierarchical Bayesian Learning on Manifolds30 Oct 2021
- 2021Input Dependent Sparse Gaussian Processes15 Jul 2021
- 2021Variational multiple shooting for Bayesian ODEs with Gaussian processes21 Jun 2021
- 2021SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processes12 Jun 2021
- 2021Connections and Equivalences between the Nystr"om Method and Sparse Variational Gaussian Processes2 Jun 2021
- 2021Nonlinear Hawkes Process with Gaussian Process Self Effects20 May 2021
- 2021On MCMC for variationally sparse Gaussian processes: A pseudo-marginal approach4 Mar 2021
- 2021Calibrated simplex-mapping classification4 Mar 2021
- 2021Hierarchical Inducing Point Gaussian Process for Inter-domain Observations28 Feb 2021
- 2021The Promises and Pitfalls of Deep Kernel Learning24 Feb 2021
- 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
- 2021Connections and Equivalences between the Nystr"om Method and Sparse Variational Gaussian Processescited by 17
- 2021Variational multiple shooting for Bayesian ODEs with Gaussian processescited by 15
- 2022Safe Active Learning for Multi-Output Gaussian Processescited by 13
- 2021SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processescited by 9
- 2022Bayesian Calibration of Imperfect Computer Models using Physics-Informed Priorscited by 9
- 2023Fully Bayesian Autoencoders with Latent Sparse Gaussian Processescited by 9
- 2024Improving sample efficiency of high dimensional Bayesian optimization with MCMCcited by 9
- 2022Variational Nearest Neighbor Gaussian Processcited by 8
- 2021Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processescited by 7
- 2023Free-Form Variational Inference for Gaussian Process State-Space Modelscited by 7
- 2021Hierarchical Inducing Point Gaussian Process for Inter-domain Observationscited by 6
12 most cited of 44 All 44 (JSON)
- 2026Sequential sparse Gaussian process quantile regression30 Jun 2026
- 2026Inverse-Free Sparse Variational Gaussian Processes1 Apr 2026
- 2026Simplex-to-Euclidean Bijection for Conjugate and Calibrated Multiclass Gaussian Process Classification17 Mar 2026
- 2026Safe Reinforcement Learning via Recovery-based Shielding with Gaussian Process Dynamics Models12 Feb 2026
- 2025Fast Riemannian-manifold Hamiltonian Monte Carlo for hierarchical Gaussian-process models9 Nov 2025
- 2025Surrogate Graph Partitioning for Spatial Prediction9 Oct 2025
- 2025Flow-Induced Diagonal Gaussian Processes21 Sep 2025
- 2025Transformer with Koopman-Enhanced Graph Convolutional Network for Spatiotemporal Dynamics Forecasting5 Jul 2025
- 2025Neighbour-Driven Gaussian Process Variational Autoencoders for Scalable Structured Latent Modelling22 May 2025
- 2025Adaptive Replication Strategies in Trust-Region-Based Bayesian Optimization of Stochastic Functions29 Apr 2025
- 2025Recurrent Memory for Online Interdomain Gaussian Processes12 Feb 2025
- 2025Koopman-Equivariant Gaussian Processes10 Feb 2025
12 newest of 44 All 44 (JSON)