A la Carte - Learning Fast Kernels
Not on the map. Why?
Abstract (arXiv)
Kernel methods have great promise for learning rich statistical representations of large modern datasets. However, compared to neural networks, kernel methods have been perceived as lacking in scalability and flexibility. We introduce a family of fast, flexible, lightly parametrized and general purpose kernel learning methods, derived from Fastfood basis function expansions. We provide mechanisms to learn the properties of groups of spectral frequencies in these expansions, which require only O(mlogd) time and O(m) memory, for m basis functions and d input dimensions. We show that the proposed methods can learn a wide class of kernels, outperforming the alternatives in accuracy, speed, and memory consumption.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Dec 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 3; 2024: 2; 2025: 2; 2026: 2.
18 papers.
Sort:
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2022Overcoming the Spectral Bias of Neural Value Approximationcited by 18
- 2021On Learning the Transformer Kernelcited by 14
- 2023Large-Scale Gaussian Processes via Alternating Projectioncited by 11
- 2022Low-Precision Arithmetic for Fast Gaussian Processescited by 10
- 2024Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Featurescited by 7
- 2023Collapsed Inference for Bayesian Deep Learningcited by 6
- 2023Bayesian Non-linear Latent Variable Modeling via Random Fourier Featurescited by 4
- 2021GP-ConvCNP: Better Generalization for Convolutional Conditional Neural Processes on Time Series Datacited by 3
- 2021Gaussian Process Inference Using Mini-batch Stochastic Gradient Descent: Convergence Guarantees and Empirical Benefitscited by 3
- 2024Spectraformer: A Unified Random Feature Framework for Transformercited by 3
- 2026Spectral methods: crucial for machine learning, natural for quantum computers?cited by 3
6 more
- 2021MetaKernel: Learning Variational Random Features with Limited Labelscited by 2
- 2021StreaMRAK a Streaming Multi-Resolution Adaptive Kernel Algorithmcited by 0
- 2022RFFNet: Large-Scale Interpretable Kernel Methods via Random Fourier Featurescited by 0
- 2025Scalable Deep Basis Kernel Gaussian Processescited by 0
- 2025Unbiased Stochastic Optimization for Gaussian Processes on Finite Dimensional RKHScited by 0
- 2026Long Range Frequency Tuning for QMLcited by 0
- 2026Spectral methods: crucial for machine learning, natural for quantum computers?25 Mar 2026
- 2026Long Range Frequency Tuning for QML26 Feb 2026
- 2025Unbiased Stochastic Optimization for Gaussian Processes on Finite Dimensional RKHS28 Aug 2025
- 2025Scalable Deep Basis Kernel Gaussian Processes24 May 2025
- 2024Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Features30 Jun 2024
- 2024Spectraformer: A Unified Random Feature Framework for Transformer24 May 2024
- 2023Large-Scale Gaussian Processes via Alternating Projection26 Oct 2023
- 2023Collapsed Inference for Bayesian Deep Learning16 Jun 2023
- 2023Bayesian Non-linear Latent Variable Modeling via Random Fourier Features14 Jun 2023
- 2022RFFNet: Large-Scale Interpretable Kernel Methods via Random Fourier Features11 Nov 2022
- 2022Low-Precision Arithmetic for Fast Gaussian Processes14 Jul 2022
- 2022Overcoming the Spectral Bias of Neural Value Approximation9 Jun 2022
6 more
- 2022Posterior and Computational Uncertainty in Gaussian Processes30 May 2022
- 2021Gaussian Process Inference Using Mini-batch Stochastic Gradient Descent: Convergence Guarantees and Empirical Benefits19 Nov 2021
- 2021On Learning the Transformer Kernel15 Oct 2021
- 2021StreaMRAK a Streaming Multi-Resolution Adaptive Kernel Algorithm23 Aug 2021
- 2021GP-ConvCNP: Better Generalization for Convolutional Conditional Neural Processes on Time Series Data9 Jun 2021
- 2021MetaKernel: Learning Variational Random Features with Limited Labels8 May 2021
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2022Overcoming the Spectral Bias of Neural Value Approximationcited by 18
- 2021On Learning the Transformer Kernelcited by 14
- 2023Large-Scale Gaussian Processes via Alternating Projectioncited by 11
- 2022Low-Precision Arithmetic for Fast Gaussian Processescited by 10
- 2024Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Featurescited by 7
- 2023Collapsed Inference for Bayesian Deep Learningcited by 6
- 2023Bayesian Non-linear Latent Variable Modeling via Random Fourier Featurescited by 4
- 2021GP-ConvCNP: Better Generalization for Convolutional Conditional Neural Processes on Time Series Datacited by 3
- 2021Gaussian Process Inference Using Mini-batch Stochastic Gradient Descent: Convergence Guarantees and Empirical Benefitscited by 3
- 2024Spectraformer: A Unified Random Feature Framework for Transformercited by 3
- 2026Spectral methods: crucial for machine learning, natural for quantum computers?cited by 3
12 most cited of 18 All 18 (JSON)
- 2026Spectral methods: crucial for machine learning, natural for quantum computers?25 Mar 2026
- 2026Long Range Frequency Tuning for QML26 Feb 2026
- 2025Unbiased Stochastic Optimization for Gaussian Processes on Finite Dimensional RKHS28 Aug 2025
- 2025Scalable Deep Basis Kernel Gaussian Processes24 May 2025
- 2024Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Features30 Jun 2024
- 2024Spectraformer: A Unified Random Feature Framework for Transformer24 May 2024
- 2023Large-Scale Gaussian Processes via Alternating Projection26 Oct 2023
- 2023Collapsed Inference for Bayesian Deep Learning16 Jun 2023
- 2023Bayesian Non-linear Latent Variable Modeling via Random Fourier Features14 Jun 2023
- 2022RFFNet: Large-Scale Interpretable Kernel Methods via Random Fourier Features11 Nov 2022
- 2022Low-Precision Arithmetic for Fast Gaussian Processes14 Jul 2022
- 2022Overcoming the Spectral Bias of Neural Value Approximation9 Jun 2022
12 newest of 18 All 18 (JSON)