mlsanityData to 7 Oct 2026

A frugal Spiking Neural Network for unsupervised classification of continuous multivariate temporal data

arXiv 2408.12608 ↗First posted 8 Aug 2024cs.NE cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

As neural interfaces become more advanced, there has been an increase in the volume and complexity of neural data recordings. These interfaces capture rich information about neural dynamics that call for efficient, real-time processing algorithms to spontaneously extract and interpret patterns of neural dynamics. Moreover, being able to do so in a fully unsupervised manner is critical as patterns in vast streams of neural data might not be easily identifiable by the human eye. Formal Deep Neural Networks (DNNs) have come a long way in performing pattern recognition tasks for various static and sequential pattern recognition applications. However, these networks usually require large labeled datasets for training and have high power consumption preventing their future embedding in active brain implants. An alternative aimed at addressing these issues are Spiking Neural Networks (SNNs) which are neuromorphic and use more biologically plausible neurons with evolving membrane potentials. In this context, we introduce here a frugal single-layer SNN designed for fully unsupervised identification and classification of multivariate temporal patterns in continuous data with a sequential approach. We show that, with only a handful number of neurons, this strategy is efficient to recognize highly overlapping multivariate temporal patterns, first on simulated data, and then on Mel Cepstral representations of speech sounds and finally on multichannel neural data. This approach relies on several biologically inspired plasticity rules, including Spike-timing-dependent plasticity (STDP), Short-term plasticity (STP) and intrinsic plasticity (IP). These results pave the way towards highly frugal SNNs for fully unsupervised and online-compatible learning of complex multivariate temporal patterns for future embedding in dedicated very-low power hardware.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 72 references that are in the map. First posted on arXiv 8 Aug 2024.

Builds on

11 of 72 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  3. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
  4. 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 399
  5. 2018Deep Learning in Spiking Neural Networkscited by 258
  6. 2016Training Deep Spiking Neural Networks using Backpropagationcited by 203
  7. 2018Long short-term memory and learning-to-learn in networks of spiking neuronscited by 179
  8. 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 178
  9. 2023DenRAM: Neuromorphic Dendritic Architecture with RRAM for Efficient Temporal Processing with Delayscited by 16
  10. 2022Braille Letter Reading: A Benchmark for Spatio-Temporal Pattern Recognition on Neuromorphic Hardwarecited by 8
  11. 2016A Spiking Network that Learns to Extract Spike Signatures from Speech Signalscited by 3

Built on by

Not cited yet.