# Improving STDP-based Visual Feature Learning with Whitening

arXiv: https://arxiv.org/abs/2002.10177 · HTML: https://mlsanity.com/paper/2002.10177/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Feb 2020.

## Built on by (most cited first, 5 of 5)

- [Paired Competing Neurons Improving STDP Supervised Local Learning In Spiking Neural Networks](https://mlsanity.com/paper/2308.02194/) (2023)
- [Neuronal Competition Groups with Supervised STDP for Spike-Based Classification](https://mlsanity.com/paper/2410.17066/) (2024)
- [A Faster Approach to Spiking Deep Convolutional Neural Networks](https://mlsanity.com/paper/2210.17442/) (2022)
- [Spyker: High-performance Library for Spiking Deep Neural Networks](https://mlsanity.com/paper/2301.13659/) (2023)
- [Image Classification Using CNN-QNN Hybrid Model with Optimized Correlated Features](https://mlsanity.com/paper/2608.04379/) (2026)

## Abstract (arXiv)

In recent years, spiking neural networks (SNNs) emerge as an alternative to deep neural networks (DNNs). SNNs present a higher computational efficiency using low-power neuromorphic hardware and require less labeled data for training using local and unsupervised learning rules such as spike timing-dependent plasticity (STDP). SNN have proven their effectiveness in image classification on simple datasets such as MNIST. However, to process natural images, a pre-processing step is required. Difference-of-Gaussians (DoG) filtering is typically used together with on-center/off-center coding, but it results in a loss of information that is detrimental to the classification performance. In this paper, we propose to use whitening as a pre-processing step before learning features with STDP. Experiments on CIFAR-10 show that whitening allows STDP to learn visual features that are closer to the ones learned with standard neural networks, with a significantly increased classification performance as compared to DoG filtering. We also propose an approximation of whitening as convolution kernels that is computationally cheaper to learn and more suited to be implemented on neuromorphic hardware. Experiments on CIFAR-10 show that it performs similarly to regular whitening. Cross-dataset experiments on CIFAR-10 and STL-10 also show that it is fairly stable across datasets, making it possible to learn a single whitening transformation to process different datasets.