BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks
Not on the map. Why?
Abstract (arXiv)
Our brain consists of biological neurons encoding information through accurate spike timing, yet both the architecture and learning rules of our brain remain largely unknown. Comparing to the recent development of backpropagation-based (BP-based) methods that are able to train spiking neural networks (SNNs) with high accuracy, biologically plausible methods are still in their infancy. In this work, we wish to answer the question of whether it is possible to attain comparable accuracy of SNNs trained by BP-based rules with bio-plausible mechanisms. We propose a new bio-plausible learning framework, consisting of two components: a new architecture, and its supporting learning rules. With two types of cells and four types of synaptic connections, the proposed local microcircuit architecture can compute and propagate error signals through local feedback connections and support training of multi-layers SNNs with a globally defined spiking error function. Under our microcircuit architecture, we employ the Spike-Timing-Dependent-Plasticity (STDP) rule operating in local compartments to update synaptic weights and achieve supervised learning in a biologically plausible manner. Finally, We interpret the proposed framework from an optimization point of view and show the equivalence between it and the BP-based rules under a special circumstance. Our experiments show that the proposed framework demonstrates learning accuracy comparable to BP-based rules and may provide new insights on how learning is orchestrated in biological systems.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 18 of its 55 references that are in the map. First posted on arXiv 14 Nov 2021.
Builds on
18 of 55 references.
References · 18
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
- 2014Deep Learning in Neural Networks: An Overviewcited by 770
- 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 406
- 2018SLAYER: Spike Layer Error Reassignment in Timecited by 266
- 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 182
- 2019Spiking-YOLO: Spiking Neural Network for Energy-Efficient Object Detectioncited by 177
- 2020Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networkscited by 100
- 2018Dendritic cortical microcircuits approximate the backpropagation algorithmcited by 97
- 2019Defending Neural Backdoors via Generative Distribution Modelingcited by 84
- 2019Spiking Neural Networks and Online Learning: An Overview and Perspectivescited by 41
- 2018A Biologically Plausible Supervised Learning Method for Spiking Neural Networks Using the Symmetric STDP Rulecited by 36
6 more
- 2020Unifying Activation- and Timing-based Learning Rules for Spiking Neural Networkscited by 28
- 2019Biologically plausible deep learning -- but how far can we go with shallow networks?cited by 25
- 2021Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networkscited by 14
- 2017The brain as an efficient and robust adaptive learnercited by 11
- 2018STDP Learning of Image Patches with Convolutional Spiking Neural Networkscited by 8
- 2016Unsupervised Regenerative Learning of Hierarchical Features in Spiking Deep Networks for Object Recognitioncited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 1.
3 papers.