Convolutional Gaussian Processes
Not on the map. Why?
Abstract (arXiv)
We present a practical way of introducing convolutional structure into Gaussian processes, making them more suited to high-dimensional inputs like images. The main contribution of our work is the construction of an inter-domain inducing point approximation that is well-tailored to the convolutional kernel. This allows us to gain the generalisation benefit of a convolutional kernel, together with fast but accurate posterior inference. We investigate several variations of the convolutional kernel, and apply it to MNIST and CIFAR-10, which have both been known to be challenging for Gaussian processes. We also show how the marginal likelihood can be used to find an optimal weighting between convolutional and RBF kernels to further improve performance. We hope that this illustration of the usefulness of a marginal likelihood will help automate discovering architectures in larger models.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 14; 2023: 7; 2024: 4; 2025: 3; 2026: 3.
44 papers.
Sort:
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
- 2021Pre-trained Gaussian Processes for Bayesian Optimizationcited by 63
- 2021Deep Neural Networks as Point Estimates for Deep Gaussian Processescited by 26
- 2022Sample-Then-Optimize Batch Neural Thompson Samplingcited by 25
- 2022Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learningcited by 20
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimizationcited by 16
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structurecited by 15
- 2023A spectrum of physics-informed Gaussian processes for regression in engineeringcited by 13
- 2021GPflux: A Library for Deep Gaussian Processescited by 12
- 2022Globally Gated Deep Linear Networkscited by 12
- 2021Scalable Variational Gaussian Processes via Harmonic Kernel Decompositioncited by 8
32 more
- 2022Efficient Transformed Gaussian Processes for Non-Stationary Dependent Multi-class Classificationcited by 7
- 2021Transferring model structure in Bayesian transfer learning for Gaussian process regressioncited by 5
- 2022Learning Interacting Dynamical Systems with Latent Gaussian Process ODEscited by 5
- 2022Revisiting Active Sets for Gaussian Process Decoderscited by 5
- 2022Sparse Gaussian Process Hyperparameters: Optimize or Integrate?cited by 4
- 2023Actually Sparse Variational Gaussian Processescited by 4
- 2024Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equationscited by 4
- 2021Correlated Weights in Infinite Limits of Deep Convolutional Neural Networkscited by 3
- 2022Quasi-Bayesian Nonparametric Density Estimation via Autoregressive Predictive Updatescited by 3
- 2023Convolutional Deep Kernel Machinescited by 3
- 2024Uncertainty Quantification on Graph Learning: A Surveycited by 3
- 2024Regularized Multi-output Gaussian Convolution Process with Domain Adaptationcited by 3
- 2025Tighter sparse variational Gaussian processescited by 3
- 2025The Catechol Benchmark: Time-series Solvent Selection Data for Few-shot Machine Learningcited by 3
- 2021Convolutional Normalizing Flows for Deep Gaussian Processescited by 2
- 2022Unsupervised Restoration of Weather-affected Images using Deep Gaussian Process-based CycleGANcited by 2
- 2022Incorporating Prior Knowledge into Neural Networks through an Implicit Composite Kernelcited by 2
- 2023Physics-enhanced Gaussian Process Variational Autoencodercited by 2
- 2023Hybrid Modeling Design Patternscited by 2
- 2021Evolving-Graph Gaussian Processescited by 1
- 2021Modular Gaussian Processes for Transfer Learningcited by 1
- 2021Geometry-Aware Hierarchical Bayesian Learning on Manifoldscited by 1
- 2022Distributional Gaussian Processes Layers for Out-of-Distribution Detectioncited by 1
- 2023Gaussian process deconvolutioncited by 1
- 2023Beyond Intuition, a Framework for Applying GPs to Real-World Datacited by 1
- 2025Flow-Induced Diagonal Gaussian Processescited by 1
- 2022Integrated Gradient attribution for Gaussian Processes with non-Gaussian likelihoodscited by 0
- 2022Modeling Disagreement in Automatic Data Labelling for Semi-Supervised Learning in Clinical Natural Language Processingcited by 0
- 2024Gaussian Process Model with Tensorial Inputs and Its Application to the Design of 3D Printed Antennascited by 0
- 2026Inverse-Free Sparse Variational Gaussian Processescited by 0
- 2026Scalable Gaussian process inference via neural feature mapscited by 0
- 2026Additive Nonparametric Regression with Spatial and Network Objectscited by 0
- 2026Additive Nonparametric Regression with Spatial and Network Objects22 Sep 2026
- 2026Scalable Gaussian process inference via neural feature maps11 May 2026
- 2026Inverse-Free Sparse Variational Gaussian Processes1 Apr 2026
- 2025Flow-Induced Diagonal Gaussian Processes21 Sep 2025
- 2025The Catechol Benchmark: Time-series Solvent Selection Data for Few-shot Machine Learning9 Jun 2025
- 2025Tighter sparse variational Gaussian processes7 Feb 2025
- 2024Regularized Multi-output Gaussian Convolution Process with Domain Adaptation4 Sep 2024
- 2024Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equations12 Aug 2024
- 2024Gaussian Process Model with Tensorial Inputs and Its Application to the Design of 3D Printed Antennas19 Jul 2024
- 2024Uncertainty Quantification on Graph Learning: A Survey23 Apr 2024
- 2023Hybrid Modeling Design Patterns29 Dec 2023
- 2023A spectrum of physics-informed Gaussian processes for regression in engineering19 Sep 2023
32 more
- 2023Convolutional Deep Kernel Machines18 Sep 2023
- 2023Beyond Intuition, a Framework for Applying GPs to Real-World Data6 Jul 2023
- 2023Physics-enhanced Gaussian Process Variational Autoencoder15 May 2023
- 2023Gaussian process deconvolution8 May 2023
- 2023Actually Sparse Variational Gaussian Processes11 Apr 2023
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimization11 Nov 2022
- 2022Sparse Gaussian Process Hyperparameters: Optimize or Integrate?4 Nov 2022
- 2022Globally Gated Deep Linear Networks31 Oct 2022
- 2022Sample-Then-Optimize Batch Neural Thompson Sampling13 Oct 2022
- 2022Revisiting Active Sets for Gaussian Process Decoders10 Sep 2022
- 2022Distributional Gaussian Processes Layers for Out-of-Distribution Detection27 Jun 2022
- 2022Quasi-Bayesian Nonparametric Density Estimation via Autoregressive Predictive Updates13 Jun 2022
- 2022Efficient Transformed Gaussian Processes for Non-Stationary Dependent Multi-class Classification30 May 2022
- 2022Modeling Disagreement in Automatic Data Labelling for Semi-Supervised Learning in Clinical Natural Language Processing29 May 2022
- 2022Integrated Gradient attribution for Gaussian Processes with non-Gaussian likelihoods25 May 2022
- 2022Learning Interacting Dynamical Systems with Latent Gaussian Process ODEs24 May 2022
- 2022Incorporating Prior Knowledge into Neural Networks through an Implicit Composite Kernel15 May 2022
- 2022Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learning12 May 2022
- 2022Unsupervised Restoration of Weather-affected Images using Deep Gaussian Process-based CycleGAN23 Apr 2022
- 2021Geometry-Aware Hierarchical Bayesian Learning on Manifolds30 Oct 2021
- 2021Modular Gaussian Processes for Transfer Learning26 Oct 2021
- 2021Pre-trained Gaussian Processes for Bayesian Optimization16 Sep 2021
- 2021Evolving-Graph Gaussian Processes29 Jun 2021
- 2021Scalable Variational Gaussian Processes via Harmonic Kernel Decomposition10 Jun 2021
- 2021Priors in Bayesian Deep Learning: A Review14 May 2021
- 2021Deep Neural Networks as Point Estimates for Deep Gaussian Processes10 May 2021
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structure23 Apr 2021
- 2021Convolutional Normalizing Flows for Deep Gaussian Processes17 Apr 2021
- 2021GPflux: A Library for Deep Gaussian Processes12 Apr 2021
- 2021The Promises and Pitfalls of Deep Kernel Learning24 Feb 2021
- 2021Transferring model structure in Bayesian transfer learning for Gaussian process regression18 Jan 2021
- 2021Correlated Weights in Infinite Limits of Deep Convolutional Neural Networks11 Jan 2021
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
- 2021Pre-trained Gaussian Processes for Bayesian Optimizationcited by 63
- 2021Deep Neural Networks as Point Estimates for Deep Gaussian Processescited by 26
- 2022Sample-Then-Optimize Batch Neural Thompson Samplingcited by 25
- 2022Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learningcited by 20
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimizationcited by 16
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structurecited by 15
- 2023A spectrum of physics-informed Gaussian processes for regression in engineeringcited by 13
- 2021GPflux: A Library for Deep Gaussian Processescited by 12
- 2022Globally Gated Deep Linear Networkscited by 12
- 2021Scalable Variational Gaussian Processes via Harmonic Kernel Decompositioncited by 8
12 most cited of 44 All 44 (JSON)
- 2026Additive Nonparametric Regression with Spatial and Network Objects22 Sep 2026
- 2026Scalable Gaussian process inference via neural feature maps11 May 2026
- 2026Inverse-Free Sparse Variational Gaussian Processes1 Apr 2026
- 2025Flow-Induced Diagonal Gaussian Processes21 Sep 2025
- 2025The Catechol Benchmark: Time-series Solvent Selection Data for Few-shot Machine Learning9 Jun 2025
- 2025Tighter sparse variational Gaussian processes7 Feb 2025
- 2024Regularized Multi-output Gaussian Convolution Process with Domain Adaptation4 Sep 2024
- 2024Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equations12 Aug 2024
- 2024Gaussian Process Model with Tensorial Inputs and Its Application to the Design of 3D Printed Antennas19 Jul 2024
- 2024Uncertainty Quantification on Graph Learning: A Survey23 Apr 2024
- 2023Hybrid Modeling Design Patterns29 Dec 2023
- 2023A spectrum of physics-informed Gaussian processes for regression in engineering19 Sep 2023
12 newest of 44 All 44 (JSON)