Going Deeper in Spiking Neural Networks: VGG and Residual Architectures
Not on the map. Why?
Abstract (arXiv)
Over the past few years, Spiking Neural Networks (SNNs) have become popular as a possible pathway to enable low-power event-driven neuromorphic hardware. However, their application in machine learning have largely been limited to very shallow neural network architectures for simple problems. In this paper, we propose a novel algorithmic technique for generating an SNN with a deep architecture, and demonstrate its effectiveness on complex visual recognition problems such as CIFAR-10 and ImageNet. Our technique applies to both VGG and Residual network architectures, with significantly better accuracy than the state-of-the-art. Finally, we present analysis of the sparse event-driven computations to demonstrate reduced hardware overhead when operating in the spiking domain.
Key facts. Cited by 245 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 40; 2022: 52; 2023: 57; 2024: 34; 2025: 39; 2026: 23.
245 papers.
Sort:
By area:
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 198
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
- 2021Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networkscited by 139
- 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 117
- 2021Accurate and efficient time-domain classification with adaptive spiking recurrent neural networkscited by 115
- 2022Attention Spiking Neural Networkscited by 107
- 2022Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representationcited by 89
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
- 2021Advancing Spiking Neural Networks towards Deep Residual Learningcited by 79
- 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 78
- 2023Deep Directly-Trained Spiking Neural Networks for Object Detectioncited by 77
- 2021HIRE-SNN: Harnessing the Inherent Robustness of Energy-Efficient Deep Spiking Neural Networks by Training with Crafted Input Noisecited by 65
38 more
- 2022GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networkscited by 63
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentationcited by 55
- 2022Neural Architecture Search for Spiking Neural Networkscited by 53
- 2022Online Training Through Time for Spiking Neural Networkscited by 49
- 2023Fast-SNN: Fast Spiking Neural Network by Converting Quantized ANNcited by 46
- 2023Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillationcited by 44
- 2022Optimized Potential Initialization for Low-latency Spiking Neural Networkscited by 41
- 2023SEENN: Towards Temporal Spiking Early-Exit Neural Networkscited by 41
- 2021Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium Statecited by 40
- 2022AutoSNN: Towards Energy-Efficient Spiking Neural Networkscited by 40
- 2023Reducing ANN-SNN Conversion Error through Residual Membrane Potentialcited by 40
- 2023Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikescited by 40
- 2023Ternary Spike: Learning Ternary Spikes for Spiking Neural Networkscited by 38
- 2023Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networkscited by 37
- 2023Membrane Potential Batch Normalization for Spiking Neural Networkscited by 35
- 2021A Fully Spiking Hybrid Neural Network for Energy-Efficient Object Detectioncited by 31
- 2022Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikescited by 30
- 2023RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networkscited by 28
- 2021Visual Explanations from Spiking Neural Networks using Interspike Intervalscited by 27
- 2021Spiking Neural Networks with Improved Inherent Recurrence Dynamics for Sequential Learningcited by 27
- 2023Training Full Spike Neural Networks via Auxiliary Accumulation Pathwaycited by 26
- 2021Human-Level Control through Directly-Trained Deep Spiking Q-Networkscited by 25
- 2022Exploring Temporal Information Dynamics in Spiking Neural Networkscited by 24
- 2021Federated Learning with Spiking Neural Networkscited by 23
- 2021Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networkscited by 23
- 2021Hybrid SNN-ANN: Energy-Efficient Classification and Object Detection for Event-Based Visioncited by 22
- 2022Real Spike: Learning Real-valued Spikes for Spiking Neural Networkscited by 22
- 2021Spatio-Temporal Pruning and Quantization for Low-latency Spiking Neural Networkscited by 21
- 2022Multi-Level Firing with Spiking DS-ResNet: Enabling Better and Deeper Directly-Trained Spiking Neural Networkscited by 21
- 2022STSC-SNN: Spatio-Temporal Synaptic Connection with Temporal Convolution and Attention for Spiking Neural Networkscited by 20
- 2023HTNet for micro-expression recognitioncited by 20
- 2021The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardwarecited by 19
- 2022Spikeformer: A Novel Architecture for Training High-Performance Low-Latency Spiking Neural Networkcited by 19
- 2022Spiking Neural Networks for Frame-based and Event-based Single Object Localizationcited by 18
- 2021One Timestep is All You Need: Training Spiking Neural Networks with Ultra Low Latencycited by 17
- 2022Brain-inspired Multilayer Perceptron with Spiking Neuronscited by 16
- 2021PrivateSNN: Privacy-Preserving Spiking Neural Networkscited by 15
50 most cited of 245 All 245 (JSON)
- 2026Saliency-Guided Replay for Continual Learning in Deep Spiking Neural Networks13 Oct 2026
- 2026NeuroFlex: Lossless Element-Level ANN-SNN Co-Execution for Efficient Sparse Inference12 Sep 2026
- 2026URCHIN: A Horizontal Spiking Language Model for Data-Constrained Pretraining12 Sep 2026
- 2026Pedestrian Crossing Intent Classification From Event-Based Vision Using Convolutional Spiking Neural Networks With Temporal Augmentation11 Sep 2026
- 2026Towards an Expressivity-Normalized Energy-Demand Comparison of ANNs and SNNs30 Aug 2026
- 2026SpikeOPD: Stable On-Policy Distillation for Autoregressive Spiking Language Models28 Aug 2026
- 2026PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks7 Aug 2026
- 2026Efficient EEG Seizure Detection Using INT8 Quantization, Channel Pruning, and Spiking Neural Networks13 Jul 2026
- 2026Intrinsically Stable Spiking Neural Networks: Overcoming the Performance Barrier in the Absence of Batch Normalization30 Jun 2026
- 2026Machine Learning methods for event classification and vertex reconstruction of the 12C + 12C reaction with the MATE-TPC27 May 2026
- 2026XOResNet: Exclusive-OR Meta-Residuals Facilitate Deep Spiking Neural Networks Learning15 May 2026
- 2026NeuroTrain: Surveying Local Learning Rules for Spiking Neural Networks with an Open Benchmarking Framework14 May 2026
38 more
- 2026A Composite Activation Function for Learning Stable Binary Representations12 May 2026
- 2026BSViT: A Burst Spiking Vision Transformer for Expressive and Efficient Visual Representation Learning25 Apr 2026
- 2026Sharpness-Aware Surrogate Training for On-Sensor Spiking Neural Networks6 Apr 2026
- 2026Brain-Inspired Multimodal Spiking Neural Network for Image-Text Retrieval25 Mar 2026
- 2026Reconstructing Spiking Neural Networks Using a Single Neuron with Autapses25 Mar 2026
- 2026Determinism in the Undetermined: Deterministic Output in Charge-Conserving Continuous-Time Neuromorphic Systems with Temporal Stochasticity16 Mar 2026
- 2026Sharpness Aware Surrogate Training for Spiking Neural Networks14 Mar 2026
- 2026From Lightweight CNNs to SpikeNets: Benchmarking Accuracy-Energy Tradeoffs with Pruned Spiking SqueezeNet10 Feb 2026
- 2026BadSNN: Backdoor Attacks on Spiking Neural Networks via Adversarial Spiking Neuron6 Feb 2026
- 2026Effects of Introducing Synaptic Scaling on Spiking Neural Network Learning16 Jan 2026
- 2026Efficient Aspect Term Extraction using Spiking Neural Network10 Jan 2026
- 2025New Spiking Architecture for Multi-Modal Decision-Making in Autonomous Vehicles1 Dec 2025
- 2025Breaking the Modality Wall: Time-step Mixup for Efficient Spiking Knowledge Transfer from Static to Event Domain15 Nov 2025
- 2025Sparse by Rule: Probability-Based N:M Pruning for Spiking Neural Networks15 Nov 2025
- 2025Cross-view Localization and Synthesis -- Datasets, Challenges and Opportunities26 Oct 2025
- 2025HybridSOMSpikeNet: A Deep Model with Differentiable Soft Self-Organizing Maps and Spiking Dynamics for Waste Classification23 Oct 2025
- 2025Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training4 Oct 2025
- 2025Hybrid Layer-Wise ANN-SNN With Surrogate Spike Encoding-Decoding Structure29 Sep 2025
- 2025SpikeMatch: Semi-Supervised Learning with Temporal Dynamics of Spiking Neural Networks26 Sep 2025
- 2025CSDformer: A Conversion Method for Fully Spike-Driven Transformer22 Sep 2025
- 2025Spatio-Temporal Pruning for Compressed Spiking Large Language Models23 Aug 2025
- 2025A Self-Ensemble Inspired Approach for Effective Training of Binary-Weight Spiking Neural Networks18 Aug 2025
- 2025Neuromorphic Cybersecurity with Semi-supervised Lifelong Learning6 Aug 2025
- 2025SPARTA: Advancing Sparse Attention in Spiking Neural Networks via Spike-Timing-Based Prioritization3 Aug 2025
- 2025HetSyn: Versatile Timescale Integration in Spiking Neural Networks via Heterogeneous Synapses1 Aug 2025
- 2025Efficient Event-Based Semantic Segmentation via Exploiting Frame-Event Fusion: A Hybrid Neural Network Approach4 Jul 2025
- 2025Training of Spiking Neural Networks with Expectation-Propagation30 Jun 2025
- 2025Towards Efficient and Accurate Spiking Neural Networks via Adaptive Bit Allocation30 Jun 2025
- 2025SPEAR: Structured Pruning for Spiking Neural Networks via Synaptic Operation Estimation and Reinforcement Learning28 Jun 2025
- 2025Probabilistic Modeling of Spiking Neural Networks with Contract-Based Verification16 Jun 2025
- 2025ReverB-SNN: Reversing Bit of the Weight and Activation for Spiking Neural Networks9 Jun 2025
- 2025Integer Binary-Range Alignment Neuron for Spiking Neural Networks6 Jun 2025
- 2025Spiking Neural Network: a low power solution for physical layer authentication19 May 2025
- 2025Adversarially Robust Spiking Neural Networks with Sparse Connectivity16 May 2025
- 2025Efficient ANN-SNN Conversion with Error Compensation Learning12 May 2025
- 2025PASCAL: Precise and Efficient ANN- SNN Conversion using Spike Accumulation and Adaptive Layerwise Activation3 May 2025
- 2025Learning with Spike Synchrony in Spiking Neural Networks14 Apr 2025
- 2025On the Adversarial Robustness of Spiking Neural Networks Trained by Local Learning11 Apr 2025
50 newest of 245 All 245 (JSON)
- 2023Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillationcited by 44
- 2024BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillationcited by 11
- 2025Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networkscited by 10
- 2025Efficient Logit-based Knowledge Distillation of Deep Spiking Neural Networks for Full-Range Timestep Deploymentcited by 2
- 2025Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Trainingcited by 0
- 2026SpikeOPD: Stable On-Policy Distillation for Autoregressive Spiking Language Modelscited by 0
- 2026SpikeOPD: Stable On-Policy Distillation for Autoregressive Spiking Language Models28 Aug 2026
- 2025Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training4 Oct 2025
- 2025Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks5 Mar 2025
- 2025Efficient Logit-based Knowledge Distillation of Deep Spiking Neural Networks for Full-Range Timestep Deployment27 Jan 2025
- 2024BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation12 Jul 2024
- 2023Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation12 Apr 2023
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 198
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
- 2021Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networkscited by 139
- 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 117
- 2021Accurate and efficient time-domain classification with adaptive spiking recurrent neural networkscited by 115
- 2022Attention Spiking Neural Networkscited by 107
- 2022Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representationcited by 89
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
- 2021Advancing Spiking Neural Networks towards Deep Residual Learningcited by 79
- 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 78
- 2023Deep Directly-Trained Spiking Neural Networks for Object Detectioncited by 77
- 2021HIRE-SNN: Harnessing the Inherent Robustness of Energy-Efficient Deep Spiking Neural Networks by Training with Crafted Input Noisecited by 65
12 most cited of 235 All 235 (JSON)
- 2026Saliency-Guided Replay for Continual Learning in Deep Spiking Neural Networks13 Oct 2026
- 2026NeuroFlex: Lossless Element-Level ANN-SNN Co-Execution for Efficient Sparse Inference12 Sep 2026
- 2026URCHIN: A Horizontal Spiking Language Model for Data-Constrained Pretraining12 Sep 2026
- 2026Pedestrian Crossing Intent Classification From Event-Based Vision Using Convolutional Spiking Neural Networks With Temporal Augmentation11 Sep 2026
- 2026Towards an Expressivity-Normalized Energy-Demand Comparison of ANNs and SNNs30 Aug 2026
- 2026PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks7 Aug 2026
- 2026Efficient EEG Seizure Detection Using INT8 Quantization, Channel Pruning, and Spiking Neural Networks13 Jul 2026
- 2026Intrinsically Stable Spiking Neural Networks: Overcoming the Performance Barrier in the Absence of Batch Normalization30 Jun 2026
- 2026Machine Learning methods for event classification and vertex reconstruction of the 12C + 12C reaction with the MATE-TPC27 May 2026
- 2026XOResNet: Exclusive-OR Meta-Residuals Facilitate Deep Spiking Neural Networks Learning15 May 2026
- 2026NeuroTrain: Surveying Local Learning Rules for Spiking Neural Networks with an Open Benchmarking Framework14 May 2026
- 2026A Composite Activation Function for Learning Stable Binary Representations12 May 2026
12 newest of 235 All 235 (JSON)