Spiking Deep Networks with LIF Neurons
Not on the map. Why?
Abstract (arXiv)
We train spiking deep networks using leaky integrate-and-fire (LIF) neurons, and achieve state-of-the-art results for spiking networks on the CIFAR-10 and MNIST datasets. This demonstrates that biologically-plausible spiking LIF neurons can be integrated into deep networks can perform as well as other spiking models (e.g. integrate-and-fire). We achieved this result by softening the LIF response function, such that its derivative remains bounded, and by training the network with noise to provide robustness against the variability introduced by spikes. Our method is general and could be applied to other neuron types, including those used on modern neuromorphic hardware. Our work brings more biological realism into modern image classification models, with the hope that these models can inform how the brain performs this difficult task. It also provides new methods for training deep networks to run on neuromorphic hardware, with the aim of fast, power-efficient image classification for robotics applications.
Key facts. Cited by 63 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 11; 2023: 18; 2024: 15; 2025: 6; 2026: 5.
63 papers.
Sort:
By area:
- 2022Spikformer: When Spiking Neural Network Meets Transformercited by 271
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 259
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
- 2022Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representationcited by 89
- 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 78
- 2022Online Training Through Time for Spiking Neural Networkscited by 49
- 2024QKFormer: Hierarchical Spiking Transformer using Q-K Attentioncited by 49
- 2021Sparse Spiking Gradient Descentcited by 41
- 2021Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium Statecited by 40
- 2024Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticketcited by 30
- 2023Training Full Spike Neural Networks via Auxiliary Accumulation Pathwaycited by 26
- 2021Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networkscited by 23
38 more
- 2021Spatio-Temporal Pruning and Quantization for Low-latency Spiking Neural Networkscited by 21
- 2023Chasing Day and Night: Towards Robust and Efficient All-Day Object Detection Guided by an Event Cameracited by 21
- 2023Spiking Denoising Diffusion Probabilistic Modelscited by 19
- 2022Spiking Neural Networks for Frame-based and Event-based Single Object Localizationcited by 18
- 2023Sneaky Spikes: Uncovering Stealthy Backdoor Attacks in Spiking Neural Networks with Neuromorphic Datacited by 18
- 2021One Timestep is All You Need: Training Spiking Neural Networks with Ultra Low Latencycited by 17
- 2024Spiking Convolutional Neural Networks for Text Classificationcited by 10
- 2024SpikMamba: When SNN meets Mamba in Event-based Human Action Recognitioncited by 10
- 2023SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networkscited by 8
- 2024Spiking Neural Network as Adaptive Event Stream Slicercited by 8
- 2022Simple and complex spiking neurons: perspectives and analysis in a simple STDP scenariocited by 6
- 2023KLIF: An optimized spiking neuron unit for tuning surrogate gradient slope and membrane potentialcited by 6
- 2025Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacementcited by 6
- 2023Hybrid Spiking Neural Network Fine-tuning for Hippocampus Segmentationcited by 5
- 2021Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Frameworkcited by 4
- 2022Navigating Local Minima in Quantized Spiking Neural Networkscited by 4
- 2023SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Networkcited by 4
- 2023Addressing the speed-accuracy simulation trade-off for adaptive spiking neuronscited by 4
- 2022Intelligence Processing Units Accelerate Neuromorphic Learningcited by 3
- 2023Attention-free Spikformer: Mixing Spike Sequences with Simple Linear Transformscited by 3
- 2024SVFormer: A Direct Training Spiking Transformer for Efficient Video Action Recognitioncited by 3
- 2024Spiking Diffusion Modelscited by 3
- 2024Membership Privacy Evaluation in Deep Spiking Neural Networkscited by 3
- 2024Hybrid variable spiking graph neural networks for energy-efficient scientific machine learningcited by 3
- 2022A noise based novel strategy for faster SNN trainingcited by 2
- 2024SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networkscited by 2
- 2025EventTracer: Fast Path Tracing-based Event Stream Renderingcited by 2
- 2022SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Drivingcited by 1
- 2022EDeNN: Event Decay Neural Networks for low latency visioncited by 1
- 2023Joint ANN-SNN Co-training for Object Localization and Image Segmentationcited by 1
- 2023Spike-based computation using classical recurrent neural networkscited by 1
- 2023Bitformer: An efficient Transformer with bitwise operation-based attention for Big Data Analytics at low-cost low-precision devicescited by 1
- 2023Dynamic Spiking Framework for Graph Neural Networkscited by 1
- 2024Learning Monocular Depth from Focus with Event Focal Stackcited by 1
- 2025ES-Parkour: Advanced Robot Parkour with Bio-inspired Event Camera and Spiking Neural Networkcited by 1
- 2025Dynamic Graph Condensationcited by 1
- 2022A temporally and spatially local spike-based backpropagation algorithm to enable training in hardwarecited by 0
- 2023Frameworks for SNNs: a Review of Data Science-oriented Software and an Expansion of SpykeTorchcited by 0
50 most cited of 63 All 63 (JSON)
- 2026MeMark: Membrane-Space Watermarking for Spiking Neural Networks26 Aug 2026
- 2026The Neural Division of Labor: Biologically-Inspired Modular Architectures for Robust Neuromorphic Computing8 Aug 2026
- 2026XOResNet: Exclusive-OR Meta-Residuals Facilitate Deep Spiking Neural Networks Learning15 May 2026
- 2026S2Act: Simple Spiking Actor16 Mar 2026
- 2026Emerging Threats and Countermeasures in Neuromorphic Systems: A Survey23 Jan 2026
- 2025Stabilizing Direct Training of Spiking Neural Networks: Membrane Potential Initialization and Threshold-robust Surrogate Gradient11 Nov 2025
- 2025EventTracer: Fast Path Tracing-based Event Stream Rendering25 Aug 2025
- 2025Dynamic Graph Condensation16 Jun 2025
- 2025Izhikevich-Inspired Temporal Dynamics for Enhancing Privacy, Efficiency, and Transferability in Spiking Neural Networks7 May 2025
- 2025Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement20 Mar 2025
- 2025ES-Parkour: Advanced Robot Parkour with Bio-inspired Event Camera and Spiking Neural Network13 Mar 2025
- 2024Hybrid variable spiking graph neural networks for energy-efficient scientific machine learning12 Dec 2024
38 more
- 2024Differentiable architecture search with multi-dimensional attention for spiking neural networks1 Nov 2024
- 2024SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition22 Oct 2024
- 2024Spiking Neural Network as Adaptive Event Stream Slicer3 Oct 2024
- 2024Deep activity propagation via weight initialization in spiking neural networks1 Oct 2024
- 2024Membership Privacy Evaluation in Deep Spiking Neural Networks28 Sep 2024
- 2024Spiking Diffusion Models29 Aug 2024
- 2024Spiking Convolutional Neural Networks for Text Classification27 Jun 2024
- 2024SVFormer: A Direct Training Spiking Transformer for Efficient Video Action Recognition21 Jun 2024
- 2024Heterogeneous Federated Learning with Convolutional and Spiking Neural Networks14 Jun 2024
- 2024Learning Monocular Depth from Focus with Event Focal Stack11 May 2024
- 2024SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks15 Apr 2024
- 2024QKFormer: Hierarchical Spiking Transformer using Q-K Attention25 Mar 2024
- 2024Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency5 Jan 2024
- 2024Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket4 Jan 2024
- 2023Dynamic Spiking Framework for Graph Neural Networks15 Dec 2023
- 2023Bitformer: An efficient Transformer with bitwise operation-based attention for Big Data Analytics at low-cost low-precision devices22 Nov 2023
- 2023Addressing the speed-accuracy simulation trade-off for adaptive spiking neurons19 Nov 2023
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence25 Oct 2023
- 2023SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Network10 Oct 2023
- 2023Chasing Day and Night: Towards Robust and Efficient All-Day Object Detection Guided by an Event Camera17 Sep 2023
- 2023Attention-free Spikformer: Mixing Spike Sequences with Simple Linear Transforms2 Aug 2023
- 2023Spiking Denoising Diffusion Probabilistic Models29 Jun 2023
- 2023Spike-based computation using classical recurrent neural networks6 Jun 2023
- 2023SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks18 May 2023
- 2023Membrane Potential Distribution Adjustment and Parametric Surrogate Gradient in Spiking Neural Networks26 Apr 2023
- 2023Joint ANN-SNN Co-training for Object Localization and Image Segmentation10 Mar 2023
- 2023KLIF: An optimized spiking neuron unit for tuning surrogate gradient slope and membrane potential18 Feb 2023
- 2023Frameworks for SNNs: a Review of Data Science-oriented Software and an Expansion of SpykeTorch15 Feb 2023
- 2023Hybrid Spiking Neural Network Fine-tuning for Hippocampus Segmentation14 Feb 2023
- 2023Sneaky Spikes: Uncovering Stealthy Backdoor Attacks in Spiking Neural Networks with Neuromorphic Data13 Feb 2023
- 2023SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networks1 Feb 2023
- 2023Training Full Spike Neural Networks via Auxiliary Accumulation Pathway27 Jan 2023
- 2022Intelligence Processing Units Accelerate Neuromorphic Learning19 Nov 2022
- 2022A noise based novel strategy for faster SNN training10 Nov 2022
- 2022Online Training Through Time for Spiking Neural Networks9 Oct 2022
- 2022Spikformer: When Spiking Neural Network Meets Transformer29 Sep 2022
- 2022EDeNN: Event Decay Neural Networks for low latency vision9 Sep 2022
- 2022A temporally and spatially local spike-based backpropagation algorithm to enable training in hardware20 Jul 2022
50 newest of 63 All 63 (JSON)
- 2023Spiking Denoising Diffusion Probabilistic Modelscited by 19
- 2024Spiking Diffusion Modelscited by 3
- 2024Spiking Diffusion Models29 Aug 2024
- 2023Spiking Denoising Diffusion Probabilistic Models29 Jun 2023
- 2022Spikformer: When Spiking Neural Network Meets Transformercited by 271
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 259
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
- 2022Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representationcited by 89
- 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 78
- 2022Online Training Through Time for Spiking Neural Networkscited by 49
- 2024QKFormer: Hierarchical Spiking Transformer using Q-K Attentioncited by 49
- 2021Sparse Spiking Gradient Descentcited by 41
- 2021Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium Statecited by 40
- 2024Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticketcited by 30
- 2023Training Full Spike Neural Networks via Auxiliary Accumulation Pathwaycited by 26
- 2021Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networkscited by 23
12 most cited of 60 All 60 (JSON)
- 2026MeMark: Membrane-Space Watermarking for Spiking Neural Networks26 Aug 2026
- 2026The Neural Division of Labor: Biologically-Inspired Modular Architectures for Robust Neuromorphic Computing8 Aug 2026
- 2026XOResNet: Exclusive-OR Meta-Residuals Facilitate Deep Spiking Neural Networks Learning15 May 2026
- 2026S2Act: Simple Spiking Actor16 Mar 2026
- 2026Emerging Threats and Countermeasures in Neuromorphic Systems: A Survey23 Jan 2026
- 2025Stabilizing Direct Training of Spiking Neural Networks: Membrane Potential Initialization and Threshold-robust Surrogate Gradient11 Nov 2025
- 2025EventTracer: Fast Path Tracing-based Event Stream Rendering25 Aug 2025
- 2025Dynamic Graph Condensation16 Jun 2025
- 2025Izhikevich-Inspired Temporal Dynamics for Enhancing Privacy, Efficiency, and Transferability in Spiking Neural Networks7 May 2025
- 2025Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement20 Mar 2025
- 2025ES-Parkour: Advanced Robot Parkour with Bio-inspired Event Camera and Spiking Neural Network13 Mar 2025
- 2024Hybrid variable spiking graph neural networks for energy-efficient scientific machine learning12 Dec 2024
12 newest of 60 All 60 (JSON)