Constant-Time Predictive Distributions for Gaussian Processes
Not on the map. Why?
Abstract (arXiv)
One of the most compelling features of Gaussian process (GP) regression is its ability to provide well-calibrated posterior distributions. Recent advances in inducing point methods have sped up GP marginal likelihood and posterior mean computations, leaving posterior covariance estimation and sampling as the remaining computational bottlenecks. In this paper we address these shortcomings by using the Lanczos algorithm to rapidly approximate the predictive covariance matrix. Our approach, which we refer to as LOVE (LanczOs Variance Estimates), substantially improves time and space complexity. In our experiments, LOVE computes covariances up to 2,000 times faster and draws samples 18,000 times faster than existing methods, all without sacrificing accuracy.
Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 6; 2023: 5; 2024: 10; 2025: 9; 2026: 5.
48 papers.
Sort:
- 2021Bayesian Algorithm Execution: Estimating Computable Properties of Black-box Functions Using Mutual Informationcited by 33
- 2021Fast Adaptation with Linearized Neural Networkscited by 32
- 2021Bayesian Optimization with High-Dimensional Outputscited by 32
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 24
- 2021Preconditioning for Scalable Gaussian Process Hyperparameter Optimizationcited by 23
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2021Tighter Bounds on the Log Marginal Likelihood of Gaussian Process Regression Using Conjugate Gradientscited by 20
- 2021Kernel Interpolation for Scalable Online Gaussian Processescited by 18
- 2021Bias-Free Scalable Gaussian Processes via Randomized Truncationscited by 16
- 2021Trust Your Robots! Predictive Uncertainty Estimation of Neural Networks with Sparse Gaussian Processescited by 12
- 2021When are Iterative Gaussian Processes Reliably Accurate?cited by 12
- 2023Large-Scale Gaussian Processes via Alternating Projectioncited by 11
36 more
- 2022Low-Precision Arithmetic for Fast Gaussian Processescited by 10
- 2023Tuning Legged Locomotion Controllers via Safe Bayesian Optimizationcited by 9
- 2024Computation-Aware Gaussian Processes: Model Selection And Linear-Time Inferencecited by 9
- 2025Robust and Conjugate Spatio-Temporal Gaussian Processescited by 9
- 2023Iterative Methods for Vecchia-Laplace Approximations for Latent Gaussian Process Modelscited by 6
- 2024Effective Bayesian Causal Inference via Structural Marginalisation and Autoregressive Orderscited by 6
- 2021Faster Kernel Interpolation for Gaussian Processescited by 5
- 2021Sensitivity Prewarping for Local Surrogate Modelingcited by 4
- 2024Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Datacited by 4
- 2023Integrated Variational Fourier Features for Fast Spatial Modelling with Gaussian Processescited by 3
- 2024Rate-Informed Discovery via Bayesian Adaptive Multifidelity Samplingcited by 3
- 2022Multi-armed bandits for resource efficient, online optimization of language model pre-training: the use case of dynamic maskingcited by 2
- 2022Sparse Kernel Gaussian Processes through Iterative Charted Refinement (ICR)cited by 2
- 2024Scaling up Probabilistic PDE Simulators with Structured Volumetric Informationcited by 2
- 2024Contraction rates for conjugate gradient and Lanczos approximate posteriors in Gaussian process regressioncited by 2
- 2024AUGUR, A flexible and efficient optimization algorithm for identification of optimal adsorption sitescited by 2
- 2024Batched Energy-Entropy acquisition for Bayesian Optimizationcited by 2
- 2025HiGP: A high-performance Python package for Gaussian Processcited by 2
- 2022Neural Fields for Fast and Scalable Interpolation of Geophysical Ocean Variablescited by 1
- 2024Gradients of Functions of Large Matricescited by 1
- 2025nuGPR: GPU-Accelerated Gaussian Process Regression with Iterative Algorithms and Low-Rank Approximationscited by 1
- 2026Adaptive Candidate Point Thompson Sampling for High-Dimensional Bayesian Optimizationcited by 1
- 2021Barely Biased Learning for Gaussian Process Regressioncited by 0
- 2022GPU-Accelerated Policy Optimization via Batch Automatic Differentiation of Gaussian Processes for Real-World Controlcited by 0
- 2023Large-scale magnetic field maps using structured kernel interpolation for Gaussian process regressioncited by 0
- 2024Exploiting Hankel-Toeplitz Structures for Fast Computation of Kernel Precision Matricescited by 0
- 2025GPRat: Gaussian Process Regression with Asynchronous Taskscited by 0
- 2025Scalable Krylov Subspace Methods for Generalized Mixed-Effects Models with Crossed Random Effectscited by 0
- 2025Scalable Deep Basis Kernel Gaussian Processescited by 0
- 2025Taking the GP Out of the Loopcited by 0
- 2025Vecchia-Inducing-Points Full-Scale Approximations for Gaussian Processescited by 0
- 2025DTI-GP: Bayesian operations for drug-target interactions using deep kernel Gaussian processescited by 0
- 2026Lightweight Gaussian Process Inference in C++ on Metal and CUDAcited by 0
- 2026SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learningcited by 0
- 2026A green solvent screening tool for emerging materials via uncertainty aware, transformer enhanced transfer learningcited by 0
- 2026Finding the Needle in a Haystack: Test-Time Analog Circuit Representation Adaptation for Bayesian Optimizationcited by 0
- 2026Finding the Needle in a Haystack: Test-Time Analog Circuit Representation Adaptation for Bayesian Optimization13 Aug 2026
- 2026A green solvent screening tool for emerging materials via uncertainty aware, transformer enhanced transfer learning11 Jun 2026
- 2026SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning26 May 2026
- 2026Lightweight Gaussian Process Inference in C++ on Metal and CUDA18 May 2026
- 2026Adaptive Candidate Point Thompson Sampling for High-Dimensional Bayesian Optimization10 Apr 2026
- 2025DTI-GP: Bayesian operations for drug-target interactions using deep kernel Gaussian processes31 Dec 2025
- 2025nuGPR: GPU-Accelerated Gaussian Process Regression with Iterative Algorithms and Low-Rank Approximations14 Oct 2025
- 2025Vecchia-Inducing-Points Full-Scale Approximations for Gaussian Processes7 Jul 2025
- 2025Taking the GP Out of the Loop15 Jun 2025
- 2025Scalable Deep Basis Kernel Gaussian Processes24 May 2025
- 2025Scalable Krylov Subspace Methods for Generalized Mixed-Effects Models with Crossed Random Effects14 May 2025
- 2025GPRat: Gaussian Process Regression with Asynchronous Tasks30 Apr 2025
36 more
- 2025HiGP: A high-performance Python package for Gaussian Process4 Mar 2025
- 2025Robust and Conjugate Spatio-Temporal Gaussian Processes4 Feb 2025
- 2024Rate-Informed Discovery via Bayesian Adaptive Multifidelity Sampling26 Nov 2024
- 2024Computation-Aware Gaussian Processes: Model Selection And Linear-Time Inference1 Nov 2024
- 2024Batched Energy-Entropy acquisition for Bayesian Optimization11 Oct 2024
- 2024AUGUR, A flexible and efficient optimization algorithm for identification of optimal adsorption sites24 Sep 2024
- 2024Exploiting Hankel-Toeplitz Structures for Fast Computation of Kernel Precision Matrices5 Aug 2024
- 2024Contraction rates for conjugate gradient and Lanczos approximate posteriors in Gaussian process regression18 Jun 2024
- 2024Scaling up Probabilistic PDE Simulators with Structured Volumetric Information7 Jun 2024
- 2024Gradients of Functions of Large Matrices27 May 2024
- 2024Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data23 May 2024
- 2024Effective Bayesian Causal Inference via Structural Marginalisation and Autoregressive Orders22 Feb 2024
- 2023Large-Scale Gaussian Processes via Alternating Projection26 Oct 2023
- 2023Large-scale magnetic field maps using structured kernel interpolation for Gaussian process regression25 Oct 2023
- 2023Iterative Methods for Vecchia-Laplace Approximations for Latent Gaussian Process Models18 Oct 2023
- 2023Integrated Variational Fourier Features for Fast Spatial Modelling with Gaussian Processes27 Aug 2023
- 2023Tuning Legged Locomotion Controllers via Safe Bayesian Optimization12 Jun 2023
- 2022Neural Fields for Fast and Scalable Interpolation of Geophysical Ocean Variables18 Nov 2022
- 2022Low-Precision Arithmetic for Fast Gaussian Processes14 Jul 2022
- 2022Sparse Kernel Gaussian Processes through Iterative Charted Refinement (ICR)21 Jun 2022
- 2022Posterior and Computational Uncertainty in Gaussian Processes30 May 2022
- 2022Multi-armed bandits for resource efficient, online optimization of language model pre-training: the use case of dynamic masking24 Mar 2022
- 2022GPU-Accelerated Policy Optimization via Batch Automatic Differentiation of Gaussian Processes for Real-World Control28 Feb 2022
- 2021When are Iterative Gaussian Processes Reliably Accurate?31 Dec 2021
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-making28 Oct 2021
- 2021Trust Your Robots! Predictive Uncertainty Estimation of Neural Networks with Sparse Gaussian Processes20 Sep 2021
- 2021Barely Biased Learning for Gaussian Process Regression20 Sep 2021
- 2021Preconditioning for Scalable Gaussian Process Hyperparameter Optimization1 Jul 2021
- 2021Bayesian Optimization with High-Dimensional Outputs24 Jun 2021
- 2021Bayesian Algorithm Execution: Estimating Computable Properties of Black-box Functions Using Mutual Information19 Apr 2021
- 2021Kernel Interpolation for Scalable Online Gaussian Processes2 Mar 2021
- 2021Fast Adaptation with Linearized Neural Networks2 Mar 2021
- 2021Tighter Bounds on the Log Marginal Likelihood of Gaussian Process Regression Using Conjugate Gradients16 Feb 2021
- 2021Bias-Free Scalable Gaussian Processes via Randomized Truncations12 Feb 2021
- 2021Faster Kernel Interpolation for Gaussian Processes28 Jan 2021
- 2021Sensitivity Prewarping for Local Surrogate Modeling15 Jan 2021
- 2021Bayesian Algorithm Execution: Estimating Computable Properties of Black-box Functions Using Mutual Informationcited by 33
- 2021Fast Adaptation with Linearized Neural Networkscited by 32
- 2021Bayesian Optimization with High-Dimensional Outputscited by 32
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 24
- 2021Preconditioning for Scalable Gaussian Process Hyperparameter Optimizationcited by 23
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2021Tighter Bounds on the Log Marginal Likelihood of Gaussian Process Regression Using Conjugate Gradientscited by 20
- 2021Kernel Interpolation for Scalable Online Gaussian Processescited by 18
- 2021Bias-Free Scalable Gaussian Processes via Randomized Truncationscited by 16
- 2021Trust Your Robots! Predictive Uncertainty Estimation of Neural Networks with Sparse Gaussian Processescited by 12
- 2021When are Iterative Gaussian Processes Reliably Accurate?cited by 12
- 2023Large-Scale Gaussian Processes via Alternating Projectioncited by 11
12 most cited of 48 All 48 (JSON)
- 2026Finding the Needle in a Haystack: Test-Time Analog Circuit Representation Adaptation for Bayesian Optimization13 Aug 2026
- 2026A green solvent screening tool for emerging materials via uncertainty aware, transformer enhanced transfer learning11 Jun 2026
- 2026SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning26 May 2026
- 2026Lightweight Gaussian Process Inference in C++ on Metal and CUDA18 May 2026
- 2026Adaptive Candidate Point Thompson Sampling for High-Dimensional Bayesian Optimization10 Apr 2026
- 2025DTI-GP: Bayesian operations for drug-target interactions using deep kernel Gaussian processes31 Dec 2025
- 2025nuGPR: GPU-Accelerated Gaussian Process Regression with Iterative Algorithms and Low-Rank Approximations14 Oct 2025
- 2025Vecchia-Inducing-Points Full-Scale Approximations for Gaussian Processes7 Jul 2025
- 2025Taking the GP Out of the Loop15 Jun 2025
- 2025Scalable Deep Basis Kernel Gaussian Processes24 May 2025
- 2025Scalable Krylov Subspace Methods for Generalized Mixed-Effects Models with Crossed Random Effects14 May 2025
- 2025GPRat: Gaussian Process Regression with Asynchronous Tasks30 Apr 2025
12 newest of 48 All 48 (JSON)