Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors
Not on the map. Why?
Abstract (arXiv)
Mixed-signal analog/digital circuits emulate spiking neurons and synapses with extremely high energy efficiency, an approach known as "neuromorphic engineering". However, analog circuits are sensitive to process-induced variation among transistors in a chip ("device mismatch"). For neuromorphic implementation of Spiking Neural Networks (SNNs), mismatch causes parameter variation between identically-configured neurons and synapses. Each chip exhibits a different distribution of neural parameters, causing deployed networks to respond differently between chips. Current solutions to mitigate mismatch based on per-chip calibration or on-chip learning entail increased design complexity, area and cost, making deployment of neuromorphic devices expensive and difficult. Here we present a supervised learning approach that produces SNNs with high robustness to mismatch and other common sources of noise. Our method trains SNNs to perform temporal classification tasks by mimicking a pre-trained dynamical system, using a local learning rule from non-linear control theory. We demonstrate our method on two tasks requiring memory, and measure the robustness of our approach to several forms of noise and mismatch. We show that our approach is more robust than common alternatives for training SNNs. Our method provides robust deployment of pre-trained networks on mixed-signal neuromorphic hardware, without requiring per-device training or calibration.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 21 of its 65 references that are in the map. First posted on arXiv 12 Feb 2021.
Builds on
21 of 65 references.
References · 21
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
- 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 342
- 2016EIE: Efficient Inference Engine on Compressed Deep Neural Networkcited by 291
- 2016Training Deep Spiking Neural Networks using Backpropagationcited by 203
- 2015A Simple Way to Initialize Recurrent Networks of Rectified Linear Unitscited by 130
- 2019Weight Agnostic Neural Networkscited by 71
- 2018Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of neoHebbian Three-Factor Learning Rulescited by 64
- 2020Event-Based Backpropagation can compute Exact Gradients for Spiking Neural Networkscited by 59
- 2017A scalable multi-core architecture with heterogeneous memory structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs)cited by 51
- 2016Neuromorphic Deep Learning Machinescited by 38
- 2019A Review of Deep Learning with Special Emphasis on Architectures, Applications and Recent Trendscited by 26
- 2018Efficient keyword spotting using dilated convolutions and gatingcited by 21
9 more
- 2018Demonstrating Advantages of Neuromorphic Computation: A Pilot Studycited by 14
- 2016Supervised Learning in Spiking Neural Networks with FORCE Trainingcited by 13
- 2017Predicting non-linear dynamics by stable local learning in a recurrent spiking neural networkcited by 12
- 2017The brain as an efficient and robust adaptive learnercited by 11
- 2019The importance of space and time in neuromorphic cognitive agentscited by 7
- 2017Learning to represent signals spike by spikecited by 6
- 2018An Accelerated LIF Neuronal Network Array for a Large Scale Mixed-Signal Neuromorphic Architecturecited by 5
- 2013Neuromorphic Learning towards Nano Second Precisioncited by 1
- 2020Implementing efficient balanced networks with mixed-signal spike-based learning circuitscited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 2; 2024: 1; 2025: 0; 2026: 1.
7 papers.
- 2021Network insensitivity to parameter noise via adversarial regularizationcited by 5
- 2022Closed-form control with spike coding networkscited by 4
- 2023Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processorscited by 4
- 2024Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardwarecited by 3
- 2021Spatiotemporal Pattern Recognition in Single Mixed-Signal VLSI Neurons with Heterogeneous Dynamic Synapsescited by 0
- 2023Membrane Potential Distribution Adjustment and Parametric Surrogate Gradient in Spiking Neural Networkscited by 0
- 2026Practical Bayesian Inference for Speech SNNs: Uncertainty and Loss-Landscape Smoothingcited by 0
- 2026Practical Bayesian Inference for Speech SNNs: Uncertainty and Loss-Landscape Smoothing9 Apr 2026
- 2024Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardware2 May 2024
- 2023Membrane Potential Distribution Adjustment and Parametric Surrogate Gradient in Spiking Neural Networks26 Apr 2023
- 2023Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processors14 Mar 2023
- 2022Closed-form control with spike coding networks25 Dec 2022
- 2021Spatiotemporal Pattern Recognition in Single Mixed-Signal VLSI Neurons with Heterogeneous Dynamic Synapses10 Jun 2021
- 2021Network insensitivity to parameter noise via adversarial regularization9 Jun 2021