Gaussian Processes for Big Data
Not on the map. Why?
Abstract (arXiv)
We introduce stochastic variational inference for Gaussian process models. This enables the application of Gaussian process (GP) models to data sets containing millions of data points. We show how GPs can be vari- ationally decomposed to depend on a set of globally relevant inducing variables which factorize the model in the necessary manner to perform variational inference. Our ap- proach is readily extended to models with non-Gaussian likelihoods and latent variable models based around Gaussian processes. We demonstrate the approach on a simple toy problem and two real world data sets.
Key facts. Cited by 377 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 71; 2022: 77; 2023: 63; 2024: 59; 2025: 64; 2026: 42.
377 papers.
Sort:
By area:
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
- 2021The Bayesian Learning Rulecited by 95
- 2022Local Latent Space Bayesian Optimization over Structured Inputscited by 78
- 2020Active Preference-Based Gaussian Process Regression for Reward Learningcited by 70
- 2024Variational Bayesian Last Layerscited by 67
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flowscited by 56
- 2022Bayesian Model Selection, the Marginal Likelihood, and Generalizationcited by 56
- 2021Optimal Order Simple Regret for Gaussian Process Banditscited by 52
- 2022GAUCHE: A Library for Gaussian Processes in Chemistrycited by 40
- 2021Spatio-Temporal Variational Gaussian Processescited by 32
- 2023Inducing Point Allocation for Sparse Gaussian Processes in High-Throughput Bayesian Optimisationcited by 32
38 more
- 2022Discovering Many Diverse Solutions with Bayesian Optimizationcited by 29
- 2023Sampling from Gaussian Process Posteriors using Stochastic Gradient Descentcited by 27
- 2021Deep Neural Networks as Point Estimates for Deep Gaussian Processescited by 26
- 2021Sequential Deconfounding for Causal Inference with Unobserved Confounderscited by 24
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2021Preconditioning for Scalable Gaussian Process Hyperparameter Optimizationcited by 22
- 2023Calibrating Transformers via Sparse Gaussian Processescited by 21
- 2022AutoIP: A United Framework to Integrate Physics into Gaussian Processescited by 20
- 2022Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learningcited by 20
- 2022Multi-Fidelity Cost-Aware Bayesian Optimizationcited by 20
- 2021Vector-valued Gaussian Processes on Riemannian Manifolds via Gauge Independent Projected Kernelscited by 19
- 2021Dual Parameterization of Sparse Variational Gaussian Processescited by 19
- 2021Kernel Interpolation for Scalable Online Gaussian Processescited by 18
- 2021BOiLS: Bayesian Optimisation for Logic Synthesiscited by 18
- 2022Theoretical characterization of uncertainty in high-dimensional linear classificationcited by 18
- 2022Improved Convergence Rates for Sparse Approximation Methods in Kernel-Based Learningcited by 18
- 2022Sampling-based inference for large linear models, with application to linearised Laplacecited by 18
- 2024Operator Learning with Gaussian Processescited by 18
- 2021Connections and Equivalences between the Nystr"om Method and Sparse Variational Gaussian Processescited by 17
- 2023Variational Linearized Laplace Approximation for Bayesian Deep Learningcited by 17
- 2023Data-Driven Design for Metamaterials and Multiscale Systems: A Reviewcited by 17
- 2022Markovian Gaussian Process Variational Autoencoderscited by 16
- 2023The Memory Perturbation Equation: Understanding Model's Sensitivity to Datacited by 16
- 2023Stochastic Gradient Descent for Gaussian Processes Done Rightcited by 16
- 2021Bias-Free Scalable Gaussian Processes via Randomized Truncationscited by 15
- 2021Variational multiple shooting for Bayesian ODEs with Gaussian processescited by 15
- 2021Scaling Gaussian Processes with Derivative Information Using Variational Inferencecited by 15
- 2022Statistical Deep Learning for Spatial and Spatio-Temporal Datacited by 15
- 2023Tanimoto Random Features for Scalable Molecular Machine Learningcited by 15
- 2021Large-Scale Learning with Fourier Features and Tensor Decompositionscited by 14
- 2022Environmental Sensor Placement with Convolutional Gaussian Neural Processescited by 14
- 2023Robust and Conjugate Gaussian Process Regressioncited by 14
- 2021Grey-box models for wave loading predictioncited by 13
- 2021Deep Gaussian Processes: A Surveycited by 13
- 2021Function-space Inference with Sparse Implicit Processescited by 13
- 2022Partitioned Variational Inference: A Framework for Probabilistic Federated Learningcited by 13
- 2022Safe Active Learning for Multi-Output Gaussian Processescited by 13
50 most cited of 377 All 377 (JSON)
- 2026Feature Space Adaptation for Effortless Gaussian Process Flows8 Oct 2026
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection27 Sep 2026
- 2026Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices24 Sep 2026
- 2026Triply-Scalable Equivariant Gaussian Process Modeling17 Sep 2026
- 2026A General Kernel Framework for Non-CND Distance Measures Using |D|-Dimensional Sparse Landmark Embeddings16 Sep 2026
- 2026A Ground-Truth Framework for Uncertainty Disentanglement with Posterior Risk6 Aug 2026
- 2026Transfer Learning Architectures for Scalable Multi-Fidelity Bayesian Optimization26 Jul 2026
- 2026Koopman operator theory: fundamentals, control, and applications2 Jul 2026
- 2026Sequential sparse Gaussian process quantile regression30 Jun 2026
- 2026Active Quantum Kernel Acquisition for Gaussian Process Regression27 Jun 2026
- 2026Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability22 Jun 2026
- 2026Scalable Bayesian Additive Models for Stellar Flare Detection via Amortized Gaussian Process Inference and Hidden Markov Models21 Jun 2026
38 more
- 2026Gaussian Process Latent Factor Regression for Low-Data, High-Dimensional Output Problems4 Jun 2026
- 2026On the Uncertainty Quantification Ability of Tabular Foundation Models31 May 2026
- 2026SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning26 May 2026
- 2026Interdomain Attention: Beyond Token-Level Key-Value Memory23 May 2026
- 2026Conditioning Gaussian Processes on Almost Anything20 May 2026
- 2026DeRegiME: Deep Regime Mixtures for Probabilistic Forecasting under Distribution Shift19 May 2026
- 2026Concepts Worth Having: Refining VLM-Guided Concept Bottleneck Models with Minimal Annotations13 May 2026
- 2026Generative Modeling of Approximately Periodic Time Series by a Posterior-Weighted Gaussian Process13 May 2026
- 2026Efficient Conditioning Why Pseudo Observation Batch Bayesian Optimization Works When It Does not12 May 2026
- 2026Elicitation-Augmented Bayesian Optimization12 May 2026
- 2026Scalable Gaussian process inference via neural feature maps11 May 2026
- 2026Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding8 May 2026
- 2026Transformed Latent Variable Multi-Output Gaussian Processes6 May 2026
- 2026Deep Kernel Learning for Stratifying Glaucoma Trajectories1 May 2026
- 2026Black-Box Optimization From Small Offline Datasets via Meta Learning with Synthetic Tasks14 Apr 2026
- 2026Inverse-Free Sparse Variational Gaussian Processes1 Apr 2026
- 2026mlr3mbo: Bayesian Optimization in R31 Mar 2026
- 2026STN-GPR: A Singularity Tensor Network Framework for Efficient Option Pricing27 Mar 2026
- 2026Stepwise Variational Inference with Vine Copulas24 Mar 2026
- 2026Bayesian Scattering: A Principled Baseline for Uncertainty on Image Data21 Mar 2026
- 2026Simplex-to-Euclidean Bijection for Conjugate and Calibrated Multiclass Gaussian Process Classification17 Mar 2026
- 2026Data-efficient Bayesian-guided design selection from large candidate sets: Application to hyperelastic stochastic metamaterials16 Mar 2026
- 2026Scalable Gaussian process modeling of parametrized spatio-temporal fields27 Feb 2026
- 2026Regular Fourier Features for Nonstationary Gaussian Processes26 Feb 2026
- 2026Generative Bayesian Computation as a Scalable Alternative to Gaussian Process Surrogates24 Feb 2026
- 2026Activation-Space Uncertainty Quantification for Pretrained Networks16 Feb 2026
- 2026Probabilistic Wind Power Forecasting with Tree-Based Machine Learning and Weather Ensembles13 Feb 2026
- 2026Empirical Gaussian Processes12 Feb 2026
- 2026Joint Parameter and State-Space Bayesian Optimization: Using Process Expertise to Accelerate Manufacturing Optimization4 Feb 2026
- 2026Scalable Random Wavelet Features: Efficient Non-Stationary Kernel Approximation with Convergence Guarantees1 Feb 2026
- 2025Uncertainty-Aware Flow Field Reconstruction Using SVGP Kolmogorov-Arnold Networks27 Dec 2025
- 2025Efficient Level-Crossing Probability Calculation for Gaussian Process Modeled Data13 Dec 2025
- 2025All Emulators are Wrong, Many are Useful, and Some are More Useful Than Others: A Reproducible Comparison of Computer Model Surrogates9 Dec 2025
- 2025gp2Scale: A Class of Compactly Supported Non-Stationary Kernels and Distributed Computing for Exact Gaussian Processes on 10 Million Data Points5 Dec 2025
- 2025Uncertainty Quantification for Scientific Machine Learning using Sparse Variational Gaussian Process Kolmogorov-Arnold Networks (SVGP KAN)4 Dec 2025
- 2025Tensor Network Based Feature Learning Model2 Dec 2025
- 2025Scalable and Interpretable Scientific Discovery via Sparse Variational Gaussian Process Kolmogorov-Arnold Networks (SVGP KAN)29 Nov 2025
- 2025We Still Don't Understand High-Dimensional Bayesian Optimization28 Nov 2025
50 newest of 377 All 377 (JSON)
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2022Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoderscited by 99
- 2021The Bayesian Learning Rulecited by 95
- 2022Local Latent Space Bayesian Optimization over Structured Inputscited by 78
- 2024Variational Bayesian Last Layerscited by 67
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flowscited by 56
- 2022Bayesian Model Selection, the Marginal Likelihood, and Generalizationcited by 56
- 2021Optimal Order Simple Regret for Gaussian Process Banditscited by 52
- 2022GAUCHE: A Library for Gaussian Processes in Chemistrycited by 40
- 2021Spatio-Temporal Variational Gaussian Processescited by 32
- 2023Inducing Point Allocation for Sparse Gaussian Processes in High-Throughput Bayesian Optimisationcited by 32
- 2022Discovering Many Diverse Solutions with Bayesian Optimizationcited by 29
12 most cited of 375 All 375 (JSON)
- 2026Feature Space Adaptation for Effortless Gaussian Process Flows8 Oct 2026
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection27 Sep 2026
- 2026Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices24 Sep 2026
- 2026Triply-Scalable Equivariant Gaussian Process Modeling17 Sep 2026
- 2026A General Kernel Framework for Non-CND Distance Measures Using |D|-Dimensional Sparse Landmark Embeddings16 Sep 2026
- 2026A Ground-Truth Framework for Uncertainty Disentanglement with Posterior Risk6 Aug 2026
- 2026Transfer Learning Architectures for Scalable Multi-Fidelity Bayesian Optimization26 Jul 2026
- 2026Koopman operator theory: fundamentals, control, and applications2 Jul 2026
- 2026Sequential sparse Gaussian process quantile regression30 Jun 2026
- 2026Active Quantum Kernel Acquisition for Gaussian Process Regression27 Jun 2026
- 2026Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability22 Jun 2026
- 2026Scalable Bayesian Additive Models for Stellar Flare Detection via Amortized Gaussian Process Inference and Hidden Markov Models21 Jun 2026
12 newest of 375 All 375 (JSON)