But How Does It Work in Theory? Linear SVM with Random Features
Not on the map. Why?
Abstract (arXiv)
We prove that, under low noise assumptions, the support vector machine with Nll m random features (RFSVM) can achieve the learning rate faster than O(1/√m) on a training set with m samples when an optimized feature map is used. Our work extends the previous fast rate analysis of random features method from least square loss to 0-1 loss. We also show that the reweighted feature selection method, which approximates the optimized feature map, helps improve the performance of RFSVM in experiments on a synthetic data set.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 5; 2024: 7; 2025: 4; 2026: 2.
28 papers.
Sort:
- 2021Learnable Fourier Features for Multi-Dimensional Spatial Positional Encodingcited by 93
- 2023Error Bounds for Learning with Vector-Valued Random Featurescited by 23
- 2024Operator Learning Using Random Features: A Tool for Scientific Computingcited by 21
- 2022Learning new physics efficiently with nonparametric methodscited by 20
- 2022Chefs' Random Tables: Non-Trigonometric Random Featurescited by 20
- 2021Learning with Density Matrices and Random Featurescited by 17
- 2021On Learning the Transformer Kernelcited by 14
- 2023Random Fourier Signature Featurescited by 9
- 2021Quantization Algorithms for Random Fourier Featurescited by 7
- 2024Solving Partial Differential Equations with Random Feature Modelscited by 6
- 2021Exponential Error Convergence in Data Classification with Optimized Random Features: Acceleration by Quantum Machine Learningcited by 4
- 2023FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Featurescited by 4
16 more
- 2024Optimal Kernel Quantile Learning with Random Featurescited by 4
- 2025Random Feature Representation Boostingcited by 4
- 2025Tensor Sketch: Fast and Scalable Polynomial Kernel Approximationcited by 4
- 2025Computational Efficiency under Covariate Shift in Kernel Ridge Regressioncited by 4
- 2021Sharp Analysis of Random Fourier Features in Classificationcited by 3
- 2022On Average-Case Error Bounds for Kernel-Based Bayesian Quadraturecited by 3
- 2024RandNet-Parareal: a time-parallel PDE solver using Random Neural Networkscited by 3
- 2022On The Relative Error of Random Fourier Features for Preserving Kernel Distancecited by 2
- 2024Differentially Private Random Feature Modelcited by 2
- 2023Error Estimation for Random Fourier Featurescited by 1
- 2024Learning Expressive Random Feature Models via Parametrized Activationscited by 1
- 2025On the Generalization Properties of Learning the Random Feature Models with Learnable Activation Functionscited by 1
- 2026Manifold Random Featurescited by 1
- 2023Snacks: a fast large-scale kernel SVM solvercited by 0
- 2024Kernel Approximation using Analog In-Memory Computingcited by 0
- 2026Improving TensorSketch Using Complex Random Variablescited by 0
- 2026Improving TensorSketch Using Complex Random Variables11 Aug 2026
- 2026Manifold Random Features3 Feb 2026
- 2025On the Generalization Properties of Learning the Random Feature Models with Learnable Activation Functions17 Oct 2025
- 2025Computational Efficiency under Covariate Shift in Kernel Ridge Regression20 May 2025
- 2025Tensor Sketch: Fast and Scalable Polynomial Kernel Approximation13 May 2025
- 2025Random Feature Representation Boosting30 Jan 2025
- 2024Solving Partial Differential Equations with Random Feature Models31 Dec 2024
- 2024Differentially Private Random Feature Model6 Dec 2024
- 2024Learning Expressive Random Feature Models via Parametrized Activations29 Nov 2024
- 2024RandNet-Parareal: a time-parallel PDE solver using Random Neural Networks9 Nov 2024
- 2024Kernel Approximation using Analog In-Memory Computing5 Nov 2024
- 2024Optimal Kernel Quantile Learning with Random Features24 Aug 2024
16 more
- 2024Operator Learning Using Random Features: A Tool for Scientific Computing12 Aug 2024
- 2023Random Fourier Signature Features20 Nov 2023
- 2023Error Bounds for Learning with Vector-Valued Random Features26 May 2023
- 2023Snacks: a fast large-scale kernel SVM solver17 Apr 2023
- 2023Error Estimation for Random Fourier Features22 Feb 2023
- 2023FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features1 Feb 2023
- 2022On The Relative Error of Random Fourier Features for Preserving Kernel Distance1 Oct 2022
- 2022Chefs' Random Tables: Non-Trigonometric Random Features30 May 2022
- 2022Learning new physics efficiently with nonparametric methods5 Apr 2022
- 2022On Average-Case Error Bounds for Kernel-Based Bayesian Quadrature22 Feb 2022
- 2021On Learning the Transformer Kernel15 Oct 2021
- 2021Sharp Analysis of Random Fourier Features in Classification22 Sep 2021
- 2021Exponential Error Convergence in Data Classification with Optimized Random Features: Acceleration by Quantum Machine Learning16 Jun 2021
- 2021Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding5 Jun 2021
- 2021Quantization Algorithms for Random Fourier Features25 Feb 2021
- 2021Learning with Density Matrices and Random Features8 Feb 2021
- 2021Learnable Fourier Features for Multi-Dimensional Spatial Positional Encodingcited by 93
- 2023Error Bounds for Learning with Vector-Valued Random Featurescited by 23
- 2024Operator Learning Using Random Features: A Tool for Scientific Computingcited by 21
- 2022Learning new physics efficiently with nonparametric methodscited by 20
- 2022Chefs' Random Tables: Non-Trigonometric Random Featurescited by 20
- 2021Learning with Density Matrices and Random Featurescited by 17
- 2021On Learning the Transformer Kernelcited by 14
- 2023Random Fourier Signature Featurescited by 9
- 2021Quantization Algorithms for Random Fourier Featurescited by 7
- 2024Solving Partial Differential Equations with Random Feature Modelscited by 6
- 2021Exponential Error Convergence in Data Classification with Optimized Random Features: Acceleration by Quantum Machine Learningcited by 4
- 2023FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Featurescited by 4
12 most cited of 28 All 28 (JSON)
- 2026Improving TensorSketch Using Complex Random Variables11 Aug 2026
- 2026Manifold Random Features3 Feb 2026
- 2025On the Generalization Properties of Learning the Random Feature Models with Learnable Activation Functions17 Oct 2025
- 2025Computational Efficiency under Covariate Shift in Kernel Ridge Regression20 May 2025
- 2025Tensor Sketch: Fast and Scalable Polynomial Kernel Approximation13 May 2025
- 2025Random Feature Representation Boosting30 Jan 2025
- 2024Solving Partial Differential Equations with Random Feature Models31 Dec 2024
- 2024Differentially Private Random Feature Model6 Dec 2024
- 2024Learning Expressive Random Feature Models via Parametrized Activations29 Nov 2024
- 2024RandNet-Parareal: a time-parallel PDE solver using Random Neural Networks9 Nov 2024
- 2024Kernel Approximation using Analog In-Memory Computing5 Nov 2024
- 2024Optimal Kernel Quantile Learning with Random Features24 Aug 2024
12 newest of 28 All 28 (JSON)