Learnable Burst Quantization for Expressive and Efficient Spiking Neural Networks
Not on the map. Why?
Abstract (arXiv)
Binary spikes provide only two neuronal output states per timestep, limiting the response capacity of spiking neural networks (SNNs) under short simulation horizons. Burst neurons expand this response space, but their threshold spacing is typically fixed before training, leaving layer-specific burst resolution outside end-to-end optimization. We propose Learnable Burst Quantization (LBQ), which formulates burst emission as saturated uniform quantization with a positive, layer-wise learnable step. ReLSG-ET, a rectified-linear surrogate gradient with exponential tails, provides gradient support throughout and beyond the active burst range, thereby enabling joint optimization of synaptic weights and burst resolution. At inference, LBQ absorbs each learned step into downstream weights and decomposes integer burst levels into binary bit planes, accumulating only the non-zero planes. This changes the synaptic accumulation count for a level S from S to operatornamepopcount(S). At two timesteps, LBQ achieves 97.45% on CIFAR-10 and 82.82% on CIFAR-100 with ResNet-20, and 73.67% on ImageNet-1K with ResNet-34. On CIFAR-10, it comes within 0.07 percentage points of the 97.52% ResNet-20 ANN reference; at Nmax=5, bit-plane execution reduces unary-equivalent synaptic accumulations by 40.52% relative to unary execution. Controlled ablations isolate the benefits of learned quantization and ReLSG-ET, while layer-wise analyses reveal selective burst allocation across network depth. Results on CIFAR10-DVS and DVS128-Gesture extend the evidence to event-driven recognition. LBQ therefore couples adaptive burst resolution and accurate inference with an algebraically equivalent bit-sparse synaptic execution path.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 58 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
35 of 58 references.
References · 35
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2019Learned Step Size Quantizationcited by 628
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
- 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 406
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
- 2021Deep Residual Learning in Spiking Neural Networkscited by 331
- 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 278
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 198
- 2017SuperSpike: Supervised learning in multi-layer spiking neural networkscited by 182
- 2020RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Networkcited by 145
- 2020Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagationcited by 144
- 2021Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networkscited by 139
23 more
- 2019Enabling Spike-based Backpropagation for Training Deep Neural Network Architecturescited by 123
- 2023Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networkscited by 122
- 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 117
- 2022Attention Spiking Neural Networkscited by 107
- 2016Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computingcited by 70
- 2024Integer-Valued Training and Spike-Driven Inference Spiking Neural Network for High-performance and Energy-efficient Object Detectioncited by 67
- 2022GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networkscited by 63
- 2024Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Trainingcited by 59
- 2023Ternary Spike: Learning Ternary Spikes for Spiking Neural Networkscited by 38
- 2018Fast and Efficient Information Transmission with Burst Spikes in Deep Spiking Neural Networkscited by 35
- 2023Membrane Potential Batch Normalization for Spiking Neural Networkscited by 35
- 2022Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikescited by 30
- 2023RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networkscited by 28
- 2022Real Spike: Learning Real-valued Spikes for Spiking Neural Networkscited by 22
- 2022Multi-Level Firing with Spiking DS-ResNet: Enabling Better and Deeper Directly-Trained Spiking Neural Networkscited by 21
- 2023Inherent Redundancy in Spiking Neural Networkscited by 13
- 2024LM-HT SNN: Enhancing the Performance of SNN to ANN Counterpart through Learnable Multi-hierarchical Threshold Modelcited by 11
- 2025STAA-SNN: Spatial-Temporal Attention Aggregator for Spiking Neural Networkscited by 11
- 2024FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networkscited by 10
- 2023Tensor Decomposition Based Attention Module for Spiking Neural Networkscited by 8
- 2025DA-LIF: Dual Adaptive Leaky Integrate-and-Fire Model for Deep Spiking Neural Networkscited by 8
- 2024Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Networkcited by 6
- 2026BSViT: A Burst Spiking Vision Transformer for Expressive and Efficient Visual Representation Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks
- 2021Q-SpiNN: A Framework for Quantizing Spiking Neural Networks
- 2025Towards Efficient and Accurate Spiking Neural Networks via Adaptive Bit Allocation
- 2026Quantization of Spiking Neural Networks Beyond Accuracy
- 2025Memory-Free and Parallel Computation for Quantized Spiking Neural Networks
- 2026BASC : Behavior-Aligned Quantization and Pruning for Low-Bit Spiking Neural Networks
- 2024Q-SNNs: Quantized Spiking Neural Networks
- 2024Heterogeneous quantization regularizes spiking neural network activity