Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP)
Not on the map. Why?
Abstract (arXiv)
We introduce a new structured kernel interpolation (SKI) framework, which generalises and unifies inducing point methods for scalable Gaussian processes (GPs). SKI methods produce kernel approximations for fast computations through kernel interpolation. The SKI framework clarifies how the quality of an inducing point approach depends on the number of inducing (aka interpolation) points, interpolation strategy, and GP covariance kernel. SKI also provides a mechanism to create new scalable kernel methods, through choosing different kernel interpolation strategies. Using SKI, with local cubic kernel interpolation, we introduce KISS-GP, which is 1) more scalable than inducing point alternatives, 2) naturally enables Kronecker and Toeplitz algebra for substantial additional gains in scalability, without requiring any grid data, and 3) can be used for fast and expressive kernel learning. KISS-GP costs O(n) time and storage for GP inference. We evaluate KISS-GP for kernel matrix approximation, kernel learning, and natural sound modelling.
Key facts. Cited by 175 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Mar 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 36; 2022: 33; 2023: 32; 2024: 30; 2025: 19; 2026: 24.
175 papers.
Sort:
By area:
- 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2021Causal Inference for Time series Analysis: Problems, Methods and Evaluationcited by 42
- 2021Spatio-Temporal Variational Gaussian Processescited by 32
- 2023Sparse Cholesky Factorization for Solving Nonlinear PDEs via Gaussian Processescited by 31
- 2023GPLaSDI: Gaussian Process-based Interpretable Latent Space Dynamics Identification through Deep Autoencodercited by 29
- 2021Valid prediction intervals for regression problemscited by 28
- 2023Sampling from Gaussian Process Posteriors using Stochastic Gradient Descentcited by 27
- 2024Compute Better Spent: Replacing Dense Layers with Structured Matricescited by 24
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2021Preconditioning for Scalable Gaussian Process Hyperparameter Optimizationcited by 22
38 more
- 2022Integrating Random Effects in Deep Neural Networkscited by 22
- 2021Kernel Interpolation for Scalable Online Gaussian Processescited by 18
- 2021Local approximate Gaussian process regression for data-driven constitutive laws: Development and comparison with neural networkscited by 17
- 2021Diverse Video Generation using a Gaussian Process Triggercited by 17
- 2021High-Dimensional Gaussian Process Inference with Derivativescited by 16
- 2021Scaling Gaussian Processes with Derivative Information Using Variational Inferencecited by 15
- 2023Gaussian Process Port-Hamiltonian Systems: Bayesian Learning with Physics Priorcited by 15
- 2023Solving High Frequency and Multi-Scale PDEs with Gaussian Processescited by 14
- 2023Toward Large Kernel Modelscited by 12
- 2021Scalable Gaussian Processes for Data-Driven Design using Big Data with Categorical Factorscited by 11
- 2024The Role of Predictive Uncertainty and Diversity in Embodied AI and Robot Learningcited by 11
- 2022Kernel Packet: An Exact and Scalable Algorithm for Gaussian Process Regression with Mat'ern Correlationscited by 10
- 2022Scalable First-Order Bayesian Optimization via Structured Automatic Differentiationcited by 10
- 2025Uncertainty Quantification for Hallucination Detection in Large Language Models: Foundations, Methodology, and Future Directionscited by 10
- 2021SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processescited by 9
- 2022Exact Gaussian Processes for Massive Datasets via Non-Stationary Sparsity-Discovering Kernelscited by 9
- 2023Kernel Regression with Infinite-Width Neural Networks on Millions of Examplescited by 9
- 2024Scaling Gaussian Processes for Learning Curve Prediction via Latent Kronecker Structurecited by 9
- 2025Robust and Conjugate Spatio-Temporal Gaussian Processescited by 9
- 2021The Fast Kernel Transformcited by 8
- 2021Scalable Variational Gaussian Processes via Harmonic Kernel Decompositioncited by 8
- 2022Variational Nearest Neighbor Gaussian Processcited by 8
- 2022Scalable Gaussian-process regression and variable selection using Vecchia approximationscited by 8
- 2023Learning Regions of Interest for Bayesian Optimization with Adaptive Level-Set Estimationcited by 8
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processescited by 8
- 2021Combining Pseudo-Point and State Space Approximations for Sum-Separable Gaussian Processescited by 7
- 2023Free-Form Variational Inference for Gaussian Process State-Space Modelscited by 7
- 2023CoLA: Exploiting Compositional Structure for Automatic and Efficient Numerical Linear Algebracited by 7
- 2024A prediction rigidity formalism for low-cost uncertainties in trained neural networkscited by 7
- 2024DKL-KAN: Scalable Deep Kernel Learning using Kolmogorov-Arnold Networkscited by 7
- 2024Toward Efficient Kernel-Based Solvers for Nonlinear PDEscited by 7
- 2021Hierarchical Inducing Point Gaussian Process for Inter-domain Observationscited by 6
- 2022Semi-Parametric Inducing Point Networks and Neural Processescited by 6
- 2023Random Smoothing Regularization in Kernel Gradient Descent Learningcited by 6
- 2023Quantized Fourier and Polynomial Features for more Expressive Tensor Network Modelscited by 6
- 2021Gauss-Legendre Features for Gaussian Process Regressioncited by 5
- 2021Faster Kernel Interpolation for Gaussian Processescited by 5
- 2021Recent Advances in Data-Driven Wireless Communication Using Gaussian Processes: A Comprehensive Surveycited by 5
50 most cited of 175 All 175 (JSON)
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection27 Sep 2026
- 2026Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices24 Sep 2026
- 2026Finding the Needle in a Haystack: Test-Time Analog Circuit Representation Adaptation for Bayesian Optimization13 Aug 2026
- 2026Spatio-Temporal Gaussian Process for Building Terrain-Incorporating Wind Power Curves30 Jun 2026
- 2026Geometry-Aware Post-Hoc Uncertainty Quantification in Operator Learning16 Jun 2026
- 2026GraphGP: Scalable Gaussian Processes with Vecchia's Approximation9 Jun 2026
- 2026SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning26 May 2026
- 2026Characterizing the Representational Capacity of Neural Processes22 May 2026
- 2026Conditioning Gaussian Processes on Almost Anything20 May 2026
- 2026Lightweight Gaussian Process Inference in C++ on Metal and CUDA18 May 2026
- 2026Scalable Gaussian process inference via neural feature maps11 May 2026
- 2026Permutation-preserving Functions and Neural Vecchia Covariance Kernels6 May 2026
38 more
- 2026Transformed Latent Variable Multi-Output Gaussian Processes6 May 2026
- 2026Differentiable Kernel Ridge Regression for Deep Learning Pipelines4 May 2026
- 2026STN-GPR: A Singularity Tensor Network Framework for Efficient Option Pricing27 Mar 2026
- 2026Kronecker-Structured Nonparametric Spatiotemporal Point Processes24 Mar 2026
- 2026Multifidelity-Augmented Gaussian Process Inputs for Surrogate Modeling from Scarce Data23 Mar 2026
- 2026Wasserstein-type Gaussian Process Regressions for Input Measurement Uncertainty18 Mar 2026
- 2026Simplex-to-Euclidean Bijection for Conjugate and Calibrated Multiclass Gaussian Process Classification17 Mar 2026
- 2026Scalable Gaussian process modeling of parametrized spatio-temporal fields27 Feb 2026
- 2026Compact Circulant Layers with Spectral Priors25 Feb 2026
- 2026Bayesian Quadrature18 Feb 2026
- 2026Richer Bayesian Last Layers with Subsampled NTK Features1 Feb 2026
- 2026Scalable Random Wavelet Features: Efficient Non-Stationary Kernel Approximation with Convergence Guarantees1 Feb 2026
- 2025gp2Scale: A Class of Compactly Supported Non-Stationary Kernels and Distributed Computing for Exact Gaussian Processes on 10 Million Data Points5 Dec 2025
- 2025Torch-Uncertainty: A Deep Learning Framework for Uncertainty Quantification13 Nov 2025
- 2025Bayesian neural networks with interpretable priors from Mercer kernels27 Oct 2025
- 2025Tensor Gaussian Processes: Efficient Solvers for Nonlinear PDEs15 Oct 2025
- 2025nuGPR: GPU-Accelerated Gaussian Process Regression with Iterative Algorithms and Low-Rank Approximations14 Oct 2025
- 2025Uncertainty Quantification for Hallucination Detection in Large Language Models: Foundations, Methodology, and Future Directions14 Oct 2025
- 2025Unbiased Stochastic Optimization for Gaussian Processes on Finite Dimensional RKHS28 Aug 2025
- 2025Vecchia-Inducing-Points Full-Scale Approximations for Gaussian Processes7 Jul 2025
- 2025Sparse Gaussian Processes: Structured Approximations and Power-EP Revisited3 Jul 2025
- 2025From Local Interactions to Global Operators: Scalable Gaussian Process Operator for Physical Systems18 Jun 2025
- 2025Scalable Gaussian Processes with Latent Kronecker Structure7 Jun 2025
- 2025Scalable Deep Basis Kernel Gaussian Processes24 May 2025
- 2025Turbocharging Gaussian Process Inference with Approximate Sketch-and-Project19 May 2025
- 2025Sparse Techniques for Regression in Deep Gaussian Processes16 May 2025
- 2025Scaling Gaussian Process Regression with Full Derivative Observations14 May 2025
- 2025Preconditioned Additive Gaussian Processes with Fourier Acceleration1 Apr 2025
- 2025From Deep Additive Kernel Learning to Last-Layer Bayesian Neural Networks via Induced Prior Approximation14 Feb 2025
- 2025New Bounds for Sparse Variational Gaussian Processes12 Feb 2025
- 2025Robust and Conjugate Spatio-Temporal Gaussian Processes4 Feb 2025
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processes29 Dec 2024
- 2024Predictive Probability Density Mapping for Search and Rescue Using An Agent-Based Approach with Sparse Data17 Dec 2024
- 2024Rate-Informed Discovery via Bayesian Adaptive Multifidelity Sampling26 Nov 2024
- 2024Fast training of large kernel models with delayed projections25 Nov 2024
- 2024Compactly-supported nonstationary kernels for computing exact Gaussian processes on big data7 Nov 2024
- 2024Gaussian Derivative Change-point Detection for Early Warnings of Industrial System Failures29 Oct 2024
- 2024High-Dimensional Gaussian Process Regression with Soft Kernel Interpolation28 Oct 2024
50 newest of 175 All 175 (JSON)
- 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2021Causal Inference for Time series Analysis: Problems, Methods and Evaluationcited by 42
- 2021Spatio-Temporal Variational Gaussian Processescited by 32
- 2023Sparse Cholesky Factorization for Solving Nonlinear PDEs via Gaussian Processescited by 31
- 2023GPLaSDI: Gaussian Process-based Interpretable Latent Space Dynamics Identification through Deep Autoencodercited by 29
- 2021Valid prediction intervals for regression problemscited by 28
- 2023Sampling from Gaussian Process Posteriors using Stochastic Gradient Descentcited by 27
- 2024Compute Better Spent: Replacing Dense Layers with Structured Matricescited by 24
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2021Preconditioning for Scalable Gaussian Process Hyperparameter Optimizationcited by 22
12 most cited of 174 All 174 (JSON)
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection27 Sep 2026
- 2026Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices24 Sep 2026
- 2026Finding the Needle in a Haystack: Test-Time Analog Circuit Representation Adaptation for Bayesian Optimization13 Aug 2026
- 2026Spatio-Temporal Gaussian Process for Building Terrain-Incorporating Wind Power Curves30 Jun 2026
- 2026Geometry-Aware Post-Hoc Uncertainty Quantification in Operator Learning16 Jun 2026
- 2026GraphGP: Scalable Gaussian Processes with Vecchia's Approximation9 Jun 2026
- 2026SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning26 May 2026
- 2026Characterizing the Representational Capacity of Neural Processes22 May 2026
- 2026Conditioning Gaussian Processes on Almost Anything20 May 2026
- 2026Lightweight Gaussian Process Inference in C++ on Metal and CUDA18 May 2026
- 2026Scalable Gaussian process inference via neural feature maps11 May 2026
- 2026Permutation-preserving Functions and Neural Vecchia Covariance Kernels6 May 2026
12 newest of 174 All 174 (JSON)