Random features for Grassmannian kernel approximation with bounded rank-one projections
Not on the map. Why?
Abstract (arXiv)
We propose a family of random feature maps for scalable kernel machines on low-dimensional subspaces, ie on the Grassmannian manifold. Such representations are useful when data classes or clusters are well described by the span of a few samples. Classical Grassmannian kernels, including the projection and Binet-Cauchy kernels, require full Gram matrices, which leads to prohibitive computational and memory costs for large high-dimensional subspace datasets. We address this limitation using random features based on rank-one projections of subspace projection matrices followed by bounded non-linear transforms, either periodic or binary, to control the resulting distributions. We show that inner products in the random feature space approximate well-defined rotation-invariant Grassmannian kernels that depend only on the principal angles between subspaces. When the number of features is sufficiently large relative to the intrinsic subspace dimension, the approximation holds uniformly over all fixed-dimensional subspaces with high probability. For periodic transforms, the approximated kernel has a closed-form expression with tunable behaviour between inverse Binet-Cauchy and Gaussian-type regimes. Binary transforms yield compact one-bit subspace features, although no closed-form kernel is known. Structured rank-one projections based on randomised fast Fourier transforms further reduce computation without sacrificing practical accuracy. Experiments on synthetic data and ETH-80 classification tasks show that these features accurately preserve Grassmannian geometry while reducing computation, memory, and storage. Rank-one embeddings therefore provide a practical and scalable alternative to classical Grassmannian kernels.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 57 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
20 of 57 references.
References · 20
- 2020Random Features for Kernel Approximation: A Survey on Algorithms, Theory, and Beyondcited by 109
- 2015Practical and Optimal LSH for Angular Distancecited by 106
- 2016Orthogonal Random Featurescited by 91
- 2014Kernel Methods on Riemannian Manifolds with Gaussian RBF Kernelscited by 30
- 2013Exact and Stable Covariance Estimation from Quadratic Sampling via Convex Programmingcited by 20
- 2013ROP: Matrix recovery via rank-one projectionscited by 18
- 2018Exact Reconstruction of Euclidean Distance Geometry Problem Using Low-rank Matrix Completioncited by 18
- 2015Random Projections through multiple optical scattering: Approximating kernels at the speed of lightcited by 16
- 2017Restricted Isometry Property of Gaussian Random Projection for Finite Set of Subspacescited by 16
- 2014Expanding the Family of Grassmannian Kernels: An Embedding Perspectivecited by 6
- 2016Structured adaptive and random spinners for fast machine learning computationscited by 6
- 2023Learning to Reconstruct Signals From Binary Measurementscited by 5
8 more
- 2014Subspace Learning From Bitscited by 3
- 2015Representation and Coding of Signal Geometrycited by 2
- 2024Subspace Tracking with Dynamical Models on the Grassmanniancited by 2
- 2016TripleSpin - a generic compact paradigm for fast machine learning computationscited by 1
- 2021Subspace Change-Point Detection via Low-Rank Matrix Factorisationcited by 1
- 2022Signal processing with optical quadratic random sketchescited by 1
- 2023Compressive Recovery of Sparse Precision Matricescited by 1
- 2025Random Features for Grassmannian Kernelscited by 1
Built on by
Not cited yet.