# Unifying Activation- and Timing-based Learning Rules for Spiking Neural Networks

arXiv: https://arxiv.org/abs/2006.02642 · HTML: https://mlsanity.com/paper/2006.02642/

## Key facts

- Cited by 28 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Jun 2020.

## Built on by (most cited first, 28 of 28)

- [Online Training Through Time for Spiking Neural Networks](https://mlsanity.com/paper/2210.04195/) (2022)
- [Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation](https://mlsanity.com/paper/2304.05627/) (2023)
- [Optimized Potential Initialization for Low-latency Spiking Neural Networks](https://mlsanity.com/paper/2202.01440/) (2022)
- [Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State](https://mlsanity.com/paper/2109.14247/) (2021)
- [Reducing ANN-SNN Conversion Error through Residual Membrane Potential](https://mlsanity.com/paper/2302.02091/) (2023)
- [Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes](https://mlsanity.com/paper/2302.10685/) (2023)
- [Training Full Spike Neural Networks via Auxiliary Accumulation Pathway](https://mlsanity.com/paper/2301.11929/) (2023)
- [Learning A Spiking Neural Network for Efficient Image Deraining](https://mlsanity.com/paper/2405.06277/) (2024)
- [TIM: An Efficient Temporal Interaction Module for Spiking Transformer](https://mlsanity.com/paper/2401.11687/) (2024)
- [Spiking-GAN: A Spiking Generative Adversarial Network Using Time-To-First-Spike Coding](https://mlsanity.com/paper/2106.15420/) (2021)
- [SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networks](https://mlsanity.com/paper/2302.00232/) (2023)
- [Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation](https://mlsanity.com/paper/2410.11488/) (2024)
- [Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement](https://mlsanity.com/paper/2503.16572/) (2025)
- [FTBC: Forward Temporal Bias Correction for Optimizing ANN-SNN Conversion](https://mlsanity.com/paper/2403.18388/) (2024)
- [Efficient ANN-SNN Conversion with Error Compensation Learning](https://mlsanity.com/paper/2506.01968/) (2025)
- [BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks](https://mlsanity.com/paper/2111.13188/) (2021)
- [Timing-Based Backpropagation in Spiking Neural Networks Without Single-Spike Restrictions](https://mlsanity.com/paper/2211.16113/) (2022)
- [Online Pseudo-Zeroth-Order Training of Neuromorphic Spiking Neural Networks](https://mlsanity.com/paper/2407.12516/) (2024)
- [Efficient Logit-based Knowledge Distillation of Deep Spiking Neural Networks for Full-Range Timestep Deployment](https://mlsanity.com/paper/2501.15925/) (2025)
- [Edge Intelligence with Spiking Neural Networks](https://mlsanity.com/paper/2507.14069/) (2025)
- [Effects of VLSI Circuit Constraints on Temporal-Coding Multilayer Spiking Neural Networks](https://mlsanity.com/paper/2106.10382/) (2021)
- [DS2TA: Denoising Spiking Transformer with Attenuated Spatiotemporal Attention](https://mlsanity.com/paper/2409.15375/) (2024)
- [SpikeDerain: Unveiling Clear Videos from Rainy Sequences Using Color Spike Streams](https://mlsanity.com/paper/2503.20315/) (2025)
- [SNNSIR: A Simple Spiking Neural Network for Stereo Image Restoration](https://mlsanity.com/paper/2508.12271/) (2025)
- [Rethinking SNN Online Training and Deployment: Gradient-Coherent Learning via Hybrid-Driven LIF Model](https://mlsanity.com/paper/2410.07547/) (2024)
- [Temporal Misalignment in ANN-SNN Conversion and Its Mitigation via Probabilistic Spiking Neurons](https://mlsanity.com/paper/2502.14487/) (2025)
- [Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training](https://mlsanity.com/paper/2510.06254/) (2025)
- [Scalable Training of Continuous-Time Spiking Neural Networks with Differentiable Spike-Time Discretization](https://mlsanity.com/paper/2607.14672/) (2026)

## Abstract (arXiv)

For the gradient computation across the time domain in Spiking Neural Networks (SNNs) training, two different approaches have been independently studied. The first is to compute the gradients with respect to the change in spike activation (activation-based methods), and the second is to compute the gradients with respect to the change in spike timing (timing-based methods). In this work, we present a comparative study of the two methods and propose a new supervised learning method that combines them. The proposed method utilizes each individual spike more effectively by shifting spike timings as in the timing-based methods as well as generating and removing spikes as in the activation-based methods. Experimental results showed that the proposed method achieves higher performance in terms of both accuracy and efficiency than the previous approaches.