# Efficient Principal Subspace Projection of Streaming Data Through Fast Similarity Matching

arXiv: https://arxiv.org/abs/1808.02083 · HTML: https://mlsanity.com/paper/1808.02083/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Aug 2018.

## Built on by (most cited first, 1 of 1)

- [A Neural Network with Local Learning Rules for Minor Subspace Analysis](https://mlsanity.com/paper/2102.05501/) (2021)

## Abstract (arXiv)

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a time and must be processed online. Here, we introduce a computationally efficient version of similarity matching, a framework for online dimensionality reduction that incrementally estimates the top K-dimensional principal subspace of streamed data while keeping in memory only the last sample and the current iterate. To assess the performance of our approach, we construct and make public a test suite containing both a synthetic data generator and the infrastructure to test online dimensionality reduction algorithms on real datasets, as well as performant implementations of our algorithm and competing algorithms with similar aims. Among the algorithms considered we find our approach to be competitive, performing among the best on both synthetic and real data.
