mlsanityData to 14 Oct 2026

Quantization Meets Spikes: Nearly Lossless Conversion at the First Timestep via Polarity Multi-Spike Mapping

arXiv 2508.14520 ↗First posted 20 Aug 2025cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

Spiking neural networks (SNNs) offer advantages in computational efficiency via event-driven computing, compared to traditional artificial neural networks (ANNs). While direct training methods tackle the challenge of non-differentiable activation mechanisms in SNNs, they often suffer from high computational and energy costs during training. As a result, ANN-to-SNN conversion approach remains a valuable and practical alternative. These conversion-based methods aim to leverage the discrete output produced by the quantization layer to obtain SNNs with low latency. Although the theoretical minimum latency is one timestep, existing conversion methods have struggled to realize such ultra-low latency without accuracy loss. Moreover, current quantization approaches often discard negative-value information following batch normalization and are highly sensitive to the hyperparameter configuration, leading to degraded performance. In this work, we, for the first time, analyze the information loss introduced by quantization layers through the lens of information entropy. Building on our analysis, we introduce polarity multi-spike mapping (PMSM) framework and a hyperparameter initialization strategy tailored for the quantization layer. Our method achieves nearly lossless ANN-to-SNN conversion at the extremity, i.e., the first timestep, while also leveraging the temporal dynamics of SNNs across multiple timesteps to maintain stable performance on complex tasks. Extensive experiments on six image and neuromorphic datasets consistently demonstrate that PMSM achieves nearly lossless accuracy at the first timestep. Remarkably, despite operating under ultra-low-latency constraints, PMSM surpasses state-of-the-art direct training methods on multiple benchmarks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 76 references that are in the map. First posted on arXiv 20 Aug 2025.

Builds on

42 of 76 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  6. 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 278
  7. 2022Spikformer: When Spiking Neural Network Meets Transformercited by 271
  8. 2018SLAYER: Spike Layer Error Reassignment in Timecited by 266
  9. 2023Spike-driven Transformercited by 146
  10. 2020RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Networkcited by 145
  11. 2021Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networkscited by 139
  12. 2023Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networkscited by 122
30 more
  1. 2021A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibrationcited by 117
  2. 2022Attention Spiking Neural Networkscited by 107
  3. 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 96
  4. 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 78
  5. 2024Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Trainingcited by 59
  6. 2024QKFormer: Hierarchical Spiking Transformer using Q-K Attentioncited by 49
  7. 2023Fast-SNN: Fast Spiking Neural Network by Converting Quantized ANNcited by 46
  8. 2022Optimized Potential Initialization for Low-latency Spiking Neural Networkscited by 41
  9. 2023Reducing ANN-SNN Conversion Error through Residual Membrane Potentialcited by 40
  10. 2023Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikescited by 40
  11. 2024SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networkscited by 40
  12. 2022Masked Spiking Transformercited by 39
  13. 2023Ternary Spike: Learning Ternary Spikes for Spiking Neural Networkscited by 38
  14. 2023RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networkscited by 28
  15. 2019An Introduction to Probabilistic Spiking Neural Networks: Probabilistic Models, Learning Rules, and Applicationscited by 26
  16. 2022Training Spiking Neural Networks with Local Tandem Learningcited by 23
  17. 2024Spiking Transformer with Spatial-Temporal Attentioncited by 19
  18. 2024SpikeZIP-TF: Conversion is All You Need for Transformer-based SNNcited by 18
  19. 2019TactileGCN: A Graph Convolutional Network for Predicting Grasp Stability with Tactile Sensorscited by 17
  20. 2020Constructing Accurate and Efficient Deep Spiking Neural Networks with Double-threshold and Augmented Schemescited by 17
  21. 2020TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognitioncited by 16
  22. 2022Towards Lossless ANN-SNN Conversion under Ultra-Low Latency with Dual-Phase Optimizationcited by 14
  23. 2022Recurrent Bilinear Optimization for Binary Neural Networkscited by 12
  24. 2024LM-HT SNN: Enhancing the Performance of SNN to ANN Counterpart through Learnable Multi-hierarchical Threshold Modelcited by 11
  25. 2022Converting Artificial Neural Networks to Spiking Neural Networks via Parameter Calibrationcited by 7
  26. 2022Low Latency Conversion of Artificial Neural Network Models to Rate-encoded Spiking Neural Networkscited by 6
  27. 2023A Hybrid Neural Coding Approach for Pattern Recognition with Spiking Neural Networkscited by 6
  28. 2025Efficient ANN-SNN Conversion with Error Compensation Learningcited by 4
  29. 2020Synaptic Learning with Augmented Spikescited by 3
  30. 2024Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Q-SpiNN: A Framework for Quantizing Spiking Neural Networks
  2. 2024Q-SNNs: Quantized Spiking Neural Networks
  3. 2026PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks
  4. 2025MD-SNN: Membrane Potential-aware Distillation on Quantized Spiking Neural Network
  5. 2025All in one timestep: Enhancing Sparsity and Energy efficiency in Multi-level Spiking Neural Networks
  6. 2026Quantization of Spiking Neural Networks Beyond Accuracy
  7. 2026Reducing ANN-SNN Conversion Error via Residual Membrane Potential Alignment ↗
  8. 2023MINT: Multiplier-less INTeger Quantization for Energy Efficient Spiking Neural Networks