Non-Stationary Spectral Kernels
Not on the map. Why?
Abstract (arXiv)
We propose non-stationary spectral kernels for Gaussian process regression. We propose to model the spectral density of a non-stationary kernel function as a mixture of input-dependent Gaussian process frequency density surfaces. We solve the generalised Fourier transform with such a model, and present a family of non-stationary and non-monotonic kernels that can learn input-dependent and potentially long-range, non-monotonic covariances between inputs. We derive efficient inference using model whitening and marginalized posterior, and show with case studies that these kernels are necessary when modelling even rather simple time series, image or geospatial data with non-stationary characteristics.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 6; 2023: 3; 2024: 4; 2025: 5; 2026: 6.
38 papers.
Sort:
- 2023Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorialcited by 27
- 2021On Learning the Transformer Kernelcited by 14
- 2021Neural Spectral Marked Point Processescited by 10
- 2024Kernel Neural Operators (KNOs) for Scalable, Memory-efficient, Geometrically-flexible Operator Learningcited by 10
- 2022Exact Gaussian Processes for Massive Datasets via Non-Stationary Sparsity-Discovering Kernelscited by 9
- 2021Adaptive Inducing Points Selection For Gaussian Processescited by 8
- 2022Nonstationary multi-output Gaussian processes via harmonizable spectral mixturescited by 8
- 2021A Robust Asymmetric Kernel Function for Bayesian Optimization, with Application to Image Defect Detection in Manufacturing Systemscited by 6
- 2021Recent Advances in Data-Driven Wireless Communication Using Gaussian Processes: A Comprehensive Surveycited by 5
- 2021Mixed Variable Bayesian Optimization with Frequency Modulated Kernelscited by 4
- 2021Marginalising over Stationary Kernels with Bayesian Quadraturecited by 4
- 2022Online Estimation of the Koopman Operator Using Fourier Featurescited by 4
26 more
- 2023Hierarchical-Hyperplane Kernels for Actively Learning Gaussian Process Models of Nonstationary Systemscited by 4
- 2021The Minecraft Kernel: Modelling correlated Gaussian Processes in the Fourier domaincited by 3
- 2021A Temporal Kernel Approach for Deep Learning with Continuous-time Informationcited by 3
- 2021Learning High-Dimensional Distributions with Latent Neural Fokker-Planck Kernelscited by 2
- 2021Accurate Remaining Useful Life Prediction with Uncertainty Quantification: a Deep Learning and Nonstationary Gaussian Process Approachcited by 2
- 2022Bayesian Complementary Kernelized Learning for Multidimensional Spatiotemporal Datacited by 2
- 2022Uncertainty Disentanglement with Non-stationary Heteroscedastic Gaussian Processes for Active Learningcited by 2
- 2022Bayesian Convolutional Deep Sets with Task-Dependent Stationary Priorcited by 2
- 2023On the Identifiability and Interpretability of Gaussian Process Modelscited by 2
- 2024Nonstationary Sparse Spectral Permanental Processcited by 2
- 2025Probabilistic Wind Power Modelling via Heteroscedastic Non-Stationary Gaussian Processescited by 1
- 2025STACI: Spatio-Temporal Aleatoric Conformal Inferencecited by 1
- 2026Scalable Random Wavelet Features: Efficient Non-Stationary Kernel Approximation with Convergence Guaranteescited by 1
- 2021Stochastic Collapsed Variational Inference for Structured Gaussian Process Regression Networkcited by 0
- 2021Wasserstein-Splitting Gaussian Process Regression for Heterogeneous Online Bayesian Inferencecited by 0
- 2021Remaining useful life prediction with uncertainty quantification: development of a highly accurate model for rotating machinerycited by 0
- 2024A New Reliable & Parsimonious Learning Strategy Comprising Two Layers of Gaussian Processes, to Address Inhomogeneous Empirical Correlation Structurescited by 0
- 2024Stein Random Feature Regressioncited by 0
- 2025Multi-View Oriented GPLVM: Expressiveness and Efficiencycited by 0
- 2025Scalable Deep Basis Kernel Gaussian Processescited by 0
- 2025Bayesian Optimization over Bounded Domains with the Beta Product Kernelcited by 0
- 2026Regular Fourier Features for Nonstationary Gaussian Processescited by 0
- 2026Bernstein-Schur Kernels: Random Features by Sketched Modulation and Radial Randomizationcited by 0
- 2026Hierarchical Bayesian Quadraturecited by 0
- 2026ALAS: Additive Learnable Alpha-Stable Kernels for Flexible Bayesian Optimizationcited by 0
- 2026Why not to use the Gaussian kernelcited by 0
- 2026Why not to use the Gaussian kernel27 Aug 2026
- 2026Hierarchical Bayesian Quadrature12 Jul 2026
- 2026ALAS: Additive Learnable Alpha-Stable Kernels for Flexible Bayesian Optimization30 Jun 2026
- 2026Bernstein-Schur Kernels: Random Features by Sketched Modulation and Radial Randomization8 Jun 2026
- 2026Regular Fourier Features for Nonstationary Gaussian Processes26 Feb 2026
- 2026Scalable Random Wavelet Features: Efficient Non-Stationary Kernel Approximation with Convergence Guarantees1 Feb 2026
- 2025Bayesian Optimization over Bounded Domains with the Beta Product Kernel19 Jun 2025
- 2025STACI: Spatio-Temporal Aleatoric Conformal Inference27 May 2025
- 2025Scalable Deep Basis Kernel Gaussian Processes24 May 2025
- 2025Probabilistic Wind Power Modelling via Heteroscedastic Non-Stationary Gaussian Processes13 May 2025
- 2025Multi-View Oriented GPLVM: Expressiveness and Efficiency12 Feb 2025
- 2024Nonstationary Sparse Spectral Permanental Process4 Oct 2024
26 more
- 2024Kernel Neural Operators (KNOs) for Scalable, Memory-efficient, Geometrically-flexible Operator Learning30 Jun 2024
- 2024Stein Random Feature Regression1 Jun 2024
- 2024A New Reliable & Parsimonious Learning Strategy Comprising Two Layers of Gaussian Processes, to Address Inhomogeneous Empirical Correlation Structures18 Apr 2024
- 2023On the Identifiability and Interpretability of Gaussian Process Models25 Oct 2023
- 2023Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial7 May 2023
- 2023Hierarchical-Hyperplane Kernels for Actively Learning Gaussian Process Models of Nonstationary Systems17 Mar 2023
- 2022Online Estimation of the Koopman Operator Using Fourier Features3 Dec 2022
- 2022Bayesian Convolutional Deep Sets with Task-Dependent Stationary Prior22 Oct 2022
- 2022Uncertainty Disentanglement with Non-stationary Heteroscedastic Gaussian Processes for Active Learning20 Oct 2022
- 2022Bayesian Complementary Kernelized Learning for Multidimensional Spatiotemporal Data21 Aug 2022
- 2022Exact Gaussian Processes for Massive Datasets via Non-Stationary Sparsity-Discovering Kernels18 May 2022
- 2022Nonstationary multi-output Gaussian processes via harmonizable spectral mixtures18 Feb 2022
- 2021On Learning the Transformer Kernel15 Oct 2021
- 2021Accurate Remaining Useful Life Prediction with Uncertainty Quantification: a Deep Learning and Nonstationary Gaussian Process Approach23 Sep 2021
- 2021Remaining useful life prediction with uncertainty quantification: development of a highly accurate model for rotating machinery23 Sep 2021
- 2021A Robust Asymmetric Kernel Function for Bayesian Optimization, with Application to Image Defect Detection in Manufacturing Systems22 Sep 2021
- 2021Wasserstein-Splitting Gaussian Process Regression for Heterogeneous Online Bayesian Inference26 Jul 2021
- 2021Adaptive Inducing Points Selection For Gaussian Processes21 Jul 2021
- 2021Neural Spectral Marked Point Processes20 Jun 2021
- 2021Marginalising over Stationary Kernels with Bayesian Quadrature14 Jun 2021
- 2021Stochastic Collapsed Variational Inference for Structured Gaussian Process Regression Network1 Jun 2021
- 2021Learning High-Dimensional Distributions with Latent Neural Fokker-Planck Kernels10 May 2021
- 2021A Temporal Kernel Approach for Deep Learning with Continuous-time Information28 Mar 2021
- 2021Recent Advances in Data-Driven Wireless Communication Using Gaussian Processes: A Comprehensive Survey18 Mar 2021
- 2021The Minecraft Kernel: Modelling correlated Gaussian Processes in the Fourier domain11 Mar 2021
- 2021Mixed Variable Bayesian Optimization with Frequency Modulated Kernels25 Feb 2021
- 2023Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorialcited by 27
- 2021On Learning the Transformer Kernelcited by 14
- 2021Neural Spectral Marked Point Processescited by 10
- 2024Kernel Neural Operators (KNOs) for Scalable, Memory-efficient, Geometrically-flexible Operator Learningcited by 10
- 2022Exact Gaussian Processes for Massive Datasets via Non-Stationary Sparsity-Discovering Kernelscited by 9
- 2021Adaptive Inducing Points Selection For Gaussian Processescited by 8
- 2022Nonstationary multi-output Gaussian processes via harmonizable spectral mixturescited by 8
- 2021A Robust Asymmetric Kernel Function for Bayesian Optimization, with Application to Image Defect Detection in Manufacturing Systemscited by 6
- 2021Recent Advances in Data-Driven Wireless Communication Using Gaussian Processes: A Comprehensive Surveycited by 5
- 2021Mixed Variable Bayesian Optimization with Frequency Modulated Kernelscited by 4
- 2021Marginalising over Stationary Kernels with Bayesian Quadraturecited by 4
- 2022Online Estimation of the Koopman Operator Using Fourier Featurescited by 4
12 most cited of 38 All 38 (JSON)
- 2026Why not to use the Gaussian kernel27 Aug 2026
- 2026Hierarchical Bayesian Quadrature12 Jul 2026
- 2026ALAS: Additive Learnable Alpha-Stable Kernels for Flexible Bayesian Optimization30 Jun 2026
- 2026Bernstein-Schur Kernels: Random Features by Sketched Modulation and Radial Randomization8 Jun 2026
- 2026Regular Fourier Features for Nonstationary Gaussian Processes26 Feb 2026
- 2026Scalable Random Wavelet Features: Efficient Non-Stationary Kernel Approximation with Convergence Guarantees1 Feb 2026
- 2025Bayesian Optimization over Bounded Domains with the Beta Product Kernel19 Jun 2025
- 2025STACI: Spatio-Temporal Aleatoric Conformal Inference27 May 2025
- 2025Scalable Deep Basis Kernel Gaussian Processes24 May 2025
- 2025Probabilistic Wind Power Modelling via Heteroscedastic Non-Stationary Gaussian Processes13 May 2025
- 2025Multi-View Oriented GPLVM: Expressiveness and Efficiency12 Feb 2025
- 2024Nonstationary Sparse Spectral Permanental Process4 Oct 2024
12 newest of 38 All 38 (JSON)