Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computing
Not on the map. Why?
Abstract (arXiv)
Deep networks are now able to achieve human-level performance on a broad spectrum of recognition tasks. Independently, neuromorphic computing has now demonstrated unprecedented energy-efficiency through a new chip architecture based on spiking neurons, low precision synapses, and a scalable communication network. Here, we demonstrate that neuromorphic computing, despite its novel architectural primitives, can implement deep convolution networks that i) approach state-of-the-art classification accuracy across 8 standard datasets, encompassing vision and speech, ii) perform inference while preserving the hardware's underlying energy-efficiency and high throughput, running on the aforementioned datasets at between 1200 and 2600 frames per second and using between 25 and 275 mW (effectively > 6000 frames / sec / W) and iii) can be specified and trained using backpropagation with the same ease-of-use as contemporary deep learning. For the first time, the algorithmic power of deep learning can be merged with the efficiency of neuromorphic processors, bringing the promise of embedded, intelligent, brain-inspired computing one step closer.
Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 12; 2023: 15; 2024: 9; 2025: 10; 2026: 4.
68 papers.
Sort:
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 192
- 2022Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representationcited by 89
- 2021Sparse Spiking Gradient Descentcited by 41
- 2023Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networkscited by 37
- 2024Convolutional Differentiable Logic Gate Networkscited by 37
- 2023A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentationcited by 33
- 2021A Long Short-Term Memory for AI Applications in Spike-based Neuromorphic Hardwarecited by 32
- 2022Spiking Graph Convolutional Networkscited by 26
- 2022Efficient recurrent architectures through activity sparsity and sparse back-propagation through timecited by 26
- 2021The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardwarecited by 19
38 more
- 2021AI Accelerator Survey and Trendscited by 17
- 2021Silicon Photonic Architecture for Training Deep Neural Networks with Direct Feedback Alignmentcited by 17
- 2021Spatio-Temporal Pruning and Quantization for Low-latency Spiking Neural Networkscited by 16
- 2021Adversarial Attacks on Spiking Convolutional Neural Networks for Event-based Visioncited by 14
- 2024Take A Shortcut Back: Mitigating the Gradient Vanishing for Training Spiking Neural Networkscited by 14
- 2024Is artificial consciousness achievable? Lessons from the human braincited by 11
- 2021Keys to Accurate Feature Extraction Using Residual Spiking Neural Networkscited by 10
- 2024Enhancing Adversarial Robustness in SNNs with Sparse Gradientscited by 9
- 2023Differentiable graph-structured models for inverse design of lattice materialscited by 8
- 2023Quantum-limited stochastic optical neural networks operating at a few quanta per activationcited by 8
- 2021Spike time displacement based error backpropagation in convolutional spiking neural networkscited by 6
- 2024Toward Large-scale Spiking Neural Networks: A Comprehensive Survey and Future Directionscited by 6
- 2022Visual Odometry with Neuromorphic Resonator Networkscited by 5
- 2021Bias-Variance Tradeoffs in Single-Sample Binary Gradient Estimatorscited by 4
- 2022EXODUS: Stable and Efficient Training of Spiking Neural Networkscited by 4
- 2023DeblurSR: Event-Based Motion Deblurring Under the Spiking Representationcited by 4
- 2023Addressing the speed-accuracy simulation trade-off for adaptive spiking neuronscited by 4
- 2021Efficient Training of Spiking Neural Networks with Temporally-Truncated Local Backpropagation through Timecited by 3
- 2022Stabilizing Spiking Neuron Trainingcited by 3
- 2022Spiking Approximations of the MaxPooling Operation in Deep SNNscited by 3
- 2022Intelligence Processing Units Accelerate Neuromorphic Learningcited by 3
- 2023DeepFire2: A Convolutional Spiking Neural Network Accelerator on FPGAscited by 3
- 2023Synaptic motor adaptation: A three-factor learning rule for adaptive robotic control in spiking neural networkscited by 3
- 2024Few-Shot Transfer Learning for Individualized Braking Intent Detection on Neuromorphic Hardwarecited by 3
- 2021BioGrad: Biologically Plausible Gradient-Based Learning for Spiking Neural Networkscited by 2
- 2023Ternary Quantization: A Surveycited by 2
- 2023Corticomorphic Hybrid CNN-SNN Architecture for EEG-based Low-footprint Low-latency Auditory Attention Detectioncited by 2
- 2025SpikeFit: Towards Optimal Deployment of Spiking Networks on Neuromorphic Hardwarecited by 2
- 2021Spiking neural networks trained via proxycited by 1
- 2021Arch-Net: Model Distillation for Architecture Agnostic Model Deploymentcited by 1
- 2022Including STDP to eligibility propagation in multi-layer recurrent spiking neural networkscited by 1
- 2022S3NN: Time Step Reduction of Spiking Surrogate Gradients for Training Energy Efficient Single-Step Spiking Neural Networkscited by 1
- 2023Spike-based computation using classical recurrent neural networkscited by 1
- 2024Spiking Music: Audio Compression with Event Based Auto-encoderscited by 1
- 2024Fractional-order spike-timing-dependent gradient descent for multi-layer spiking neural networkscited by 1
- 2025Memristor-Based Neural Network Accelerators for Space Applications: Enhancing Performance with Temporal Averaging and SIRENscited by 1
- 2021ItNet: iterative neural networks with small graphs for accurate, efficient and anytime semantic segmentationcited by 0
- 2021DTNN: Energy-efficient Inference with Dendrite Tree Inspired Neural Networks for Edge Vision Applicationscited by 0
50 most cited of 68 All 68 (JSON)
- 2026Learnable Burst Quantization for Expressive and Efficient Spiking Neural Networks28 Apr 2026
- 2026Robust Spiking Neural Networks Against Adversarial Attacks24 Feb 2026
- 2026Signal-Adaptive Trust Regions for Gradient-Free Optimization of Recurrent Spiking Neural Networks29 Jan 2026
- 2026Emerging Threats and Countermeasures in Neuromorphic Systems: A Survey23 Jan 2026
- 2025Stabilizing Direct Training of Spiking Neural Networks: Membrane Potential Initialization and Threshold-robust Surrogate Gradient11 Nov 2025
- 2025SpikeFit: Towards Optimal Deployment of Spiking Networks on Neuromorphic Hardware17 Oct 2025
- 2025Memristor-Based Neural Network Accelerators for Space Applications: Enhancing Performance with Temporal Averaging and SIRENs2 Sep 2025
- 2025Guidance and Control Neural Network Acceleration using Memristors2 Sep 2025
- 2025A Self-Ensemble Inspired Approach for Effective Training of Binary-Weight Spiking Neural Networks18 Aug 2025
- 2025Temporal Regularization Training: Unleashing the Potential of Spiking Neural Networks24 Jun 2025
- 2025A Scalable Hybrid Training Approach for Recurrent Spiking Neural Networks17 Jun 2025
- 2025Energy-Efficient Deep Reinforcement Learning with Spiking Transformers20 May 2025
38 more
- 2025Threshold Modulation for Online Test-Time Adaptation of Spiking Neural Networks8 May 2025
- 2025Precision Neural Network Quantization via Learnable Adaptive Modules24 Apr 2025
- 2024Convolutional Differentiable Logic Gate Networks7 Nov 2024
- 2024Fractional-order spike-timing-dependent gradient descent for multi-layer spiking neural networks20 Oct 2024
- 2024Toward Large-scale Spiking Neural Networks: A Comprehensive Survey and Future Directions19 Aug 2024
- 2024Few-Shot Transfer Learning for Individualized Braking Intent Detection on Neuromorphic Hardware21 Jul 2024
- 2024A Differentiable Approach to Multi-scale Brain Modeling28 Jun 2024
- 2024Enhancing Adversarial Robustness in SNNs with Sparse Gradients30 May 2024
- 2024Is artificial consciousness achievable? Lessons from the human brain18 Apr 2024
- 2024Spiking Music: Audio Compression with Event Based Auto-encoders2 Feb 2024
- 2024Take A Shortcut Back: Mitigating the Gradient Vanishing for Training Spiking Neural Networks9 Jan 2024
- 2023Addressing the speed-accuracy simulation trade-off for adaptive spiking neurons19 Nov 2023
- 2023Stabilizing RNN Gradients through Pre-training23 Aug 2023
- 2023Quantum-limited stochastic optical neural networks operating at a few quanta per activation28 Jul 2023
- 2023A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation24 Jul 2023
- 2023Corticomorphic Hybrid CNN-SNN Architecture for EEG-based Low-footprint Low-latency Auditory Attention Detection13 Jul 2023
- 2023Spike-based computation using classical recurrent neural networks6 Jun 2023
- 2023Synaptic motor adaptation: A three-factor learning rule for adaptive robotic control in spiking neural networks2 Jun 2023
- 2023A method for the ethical analysis of brain-inspired AI18 May 2023
- 2023DeepFire2: A Convolutional Spiking Neural Network Accelerator on FPGAs9 May 2023
- 2023Membrane Potential Distribution Adjustment and Parametric Surrogate Gradient in Spiking Neural Networks26 Apr 2023
- 2023Differentiable graph-structured models for inverse design of lattice materials11 Apr 2023
- 2023DeblurSR: Event-Based Motion Deblurring Under the Spiking Representation15 Mar 2023
- 2023Ternary Quantization: A Survey2 Mar 2023
- 2023Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks28 Feb 2023
- 2023Spiking Synaptic Penalty: Appropriate Penalty Term for Energy-Efficient Spiking Neural Networks3 Feb 2023
- 2022Intelligence Processing Units Accelerate Neuromorphic Learning19 Nov 2022
- 2022Visual Odometry with Neuromorphic Resonator Networks5 Sep 2022
- 2022Efficient recurrent architectures through activity sparsity and sparse back-propagation through time13 Jun 2022
- 2022EXODUS: Stable and Efficient Training of Spiking Neural Networks20 May 2022
- 2022Spiking Approximations of the MaxPooling Operation in Deep SNNs14 May 2022
- 2022Spiking Graph Convolutional Networks5 May 2022
- 2022Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation1 May 2022
- 2022Fault-Tolerant Neural Networks from Biological Error Correction Codes25 Feb 2022
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting24 Feb 2022
- 2022Stabilizing Spiking Neuron Training1 Feb 2022
- 2022S3NN: Time Step Reduction of Spiking Surrogate Gradients for Training Energy Efficient Single-Step Spiking Neural Networks26 Jan 2022
- 2022Including STDP to eligibility propagation in multi-layer recurrent spiking neural networks5 Jan 2022
50 newest of 68 All 68 (JSON)
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 192
- 2022Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representationcited by 89
- 2021Sparse Spiking Gradient Descentcited by 41
- 2023Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networkscited by 37
- 2024Convolutional Differentiable Logic Gate Networkscited by 37
- 2023A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentationcited by 33
- 2021A Long Short-Term Memory for AI Applications in Spike-based Neuromorphic Hardwarecited by 32
- 2022Spiking Graph Convolutional Networkscited by 26
- 2022Efficient recurrent architectures through activity sparsity and sparse back-propagation through timecited by 26
- 2021The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardwarecited by 19
12 most cited of 68 All 68 (JSON)
- 2026Learnable Burst Quantization for Expressive and Efficient Spiking Neural Networks28 Apr 2026
- 2026Robust Spiking Neural Networks Against Adversarial Attacks24 Feb 2026
- 2026Signal-Adaptive Trust Regions for Gradient-Free Optimization of Recurrent Spiking Neural Networks29 Jan 2026
- 2026Emerging Threats and Countermeasures in Neuromorphic Systems: A Survey23 Jan 2026
- 2025Stabilizing Direct Training of Spiking Neural Networks: Membrane Potential Initialization and Threshold-robust Surrogate Gradient11 Nov 2025
- 2025SpikeFit: Towards Optimal Deployment of Spiking Networks on Neuromorphic Hardware17 Oct 2025
- 2025Memristor-Based Neural Network Accelerators for Space Applications: Enhancing Performance with Temporal Averaging and SIRENs2 Sep 2025
- 2025Guidance and Control Neural Network Acceleration using Memristors2 Sep 2025
- 2025A Self-Ensemble Inspired Approach for Effective Training of Binary-Weight Spiking Neural Networks18 Aug 2025
- 2025Temporal Regularization Training: Unleashing the Potential of Spiking Neural Networks24 Jun 2025
- 2025A Scalable Hybrid Training Approach for Recurrent Spiking Neural Networks17 Jun 2025
- 2025Energy-Efficient Deep Reinforcement Learning with Spiking Transformers20 May 2025
12 newest of 68 All 68 (JSON)