SIT: A Bionic and Non-Linear Neuron for Spiking Neural Network
Not on the map. Why?
Abstract (arXiv)
Spiking Neural Networks (SNNs) have piqued researchers' interest because of their capacity to process temporal information and low power consumption. However, current state-of-the-art methods limited their biological plausibility and performance because their neurons are generally built on the simple Leaky-Integrate-and-Fire (LIF) model. Due to the high level of dynamic complexity, modern neuron models have seldom been implemented in SNN practice. In this study, we adopt the Phase Plane Analysis (PPA) technique, a technique often utilized in neurodynamics field, to integrate a recent neuron model, namely, the Izhikevich neuron. Based on the findings in the advancement of neuroscience, the Izhikevich neuron model can be biologically plausible while maintaining comparable computational cost with LIF neurons. By utilizing the adopted PPA, we have accomplished putting neurons built with the modified Izhikevich model into SNN practice, dubbed as the Standardized Izhikevich Tonic (SIT) neuron. For performance, we evaluate the suggested technique for image classification tasks in self-built LIF-and-SIT-consisted SNNs, named Hybrid Neural Network (HNN) on static MNIST, Fashion-MNIST, CIFAR-10 datasets and neuromorphic N-MNIST, CIFAR10-DVS, and DVS128 Gesture datasets. The experimental results indicate that the suggested method achieves comparable accuracy while exhibiting more biologically realistic behaviors on nearly all test datasets, demonstrating the efficiency of this novel strategy in bridging the gap between neurodynamics and SNN practice.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 51 references that are in the map. First posted on arXiv 30 Mar 2022.
Builds on
21 of 51 references.
References · 21
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Layer Normalizationcited by 5,579
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2018Group Normalizationcited by 1,514
- 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 399
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
- 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 308
- 2018SLAYER: Spike Layer Error Reassignment in Timecited by 257
- 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 222
- 2016Training Deep Spiking Neural Networks using Backpropagationcited by 203
- 2020RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Networkcited by 141
- 2019Enabling Spike-based Backpropagation for Training Deep Neural Network Architecturescited by 119
9 more
- 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 74
- 2018BindsNET: A machine learning-oriented spiking neural networks library in Pythoncited by 42
- 2021Pruning of Deep Spiking Neural Networks through Gradient Rewiringcited by 41
- 2020Exploiting Neuron and Synapse Filter Dynamics in Spatial Temporal Learning of Deep Spiking Neural Networkcited by 36
- 2019Spike-Train Level Backpropagation for Training Deep Recurrent Spiking Neural Networkscited by 32
- 2018Hybrid Macro/Micro Level Backpropagation for Training Deep Spiking Neural Networkscited by 30
- 2022Rate Coding or Direct Coding: Which One is Better for Accurate, Robust, and Energy-efficient Spiking Neural Networks?cited by 24
- 2019Spike-timing-dependent plasticity with axonal delay tunes networks of Izhikevich neurons to the edge of synchronization transition with scale-free avalanchescited by 1
- 2019NatCSNN: A Convolutional Spiking Neural Network for recognition of objects extracted from natural imagescited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 1.
2 papers.