Efficient Parallel Training Methods for Spiking Neural Networks with Constant Time Complexity
Not on the map. Why?
Abstract (arXiv)
Spiking Neural Networks (SNNs) often suffer from high time complexity O(T) due to the sequential processing of T spikes, making training computationally expensive. In this paper, we propose a novel Fixed-point Parallel Training (FPT) method to accelerate SNN training without modifying the network architecture or introducing additional assumptions. FPT reduces the time complexity to O(K), where K is a small constant (usually K=3), by using a fixed-point iteration form of Leaky Integrate-and-Fire (LIF) neurons for all T timesteps. We provide a theoretical convergence analysis of FPT and demonstrate that existing parallel spiking neurons can be viewed as special cases of our proposed method. Experimental results show that FPT effectively simulates the dynamics of original LIF neurons, significantly reducing computational time without sacrificing accuracy. This makes FPT a scalable and efficient solution for real-world applications, particularly for long-term tasks. Our code will be released at hrefhttps://github.com/WanjinVon/FPTtexttthttps://github.com/WanjinVon/FPT.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
25 of 44 references.
References · 25
- 2019Deep Equilibrium Modelscited by 615
- 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 278
- 2019Implicit Deep Learningcited by 124
- 2022Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representationcited by 89
- 2022HARDVS: Revisiting Human Activity Recognition with Dynamic Vision Sensorscited by 47
- 2023Parallelizing non-linear sequential models over the sequence lengthcited by 45
- 2023SEENN: Towards Temporal Spiking Early-Exit Neural Networkscited by 41
- 2023Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependenciescited by 41
- 2021Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium Statecited by 40
- 2023Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networkscited by 37
- 2021Accurate online training of dynamical spiking neural networks through Forward Propagation Through Timecited by 34
- 2022Exploring Temporal Information Dynamics in Spiking Neural Networkscited by 24
13 more
- 2023Learning Long Sequences in Spiking Neural Networkscited by 19
- 2024Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Networkcited by 19
- 2023Exploiting Noise as a Resource for Computation and Learning in Spiking Neural Networkscited by 18
- 2023Unleashing the Potential of Spiking Neural Networks by Dynamic Confidencecited by 15
- 2022Towards Lossless ANN-SNN Conversion under Ultra-Low Latency with Dual-Phase Optimizationcited by 14
- 2024High-Performance Temporal Reversible Spiking Neural Networks with O(L) Training Memory and O(1) Inference Costcited by 14
- 2023Inherent Redundancy in Spiking Neural Networkscited by 13
- 2023SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networkscited by 8
- 2023Sharing Leaky-Integrate-and-Fire Neurons for Memory-Efficient Spiking Neural Networkscited by 5
- 2023Accelerating SNN Training with Stochastic Parallelizable Spiking Neuronscited by 4
- 2023Addressing the speed-accuracy simulation trade-off for adaptive spiking neuronscited by 4
- 2021Approximate Fixed-Points in Recurrent Neural Networkscited by 3
- 2023Learning fixed points of recurrent neural networks by reparameterizing the network modelcited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025AR-LIF: Adaptive reset leaky integrate-and-fire neuron for spiking neural networkscited by 2
- 2025Learning from Dense Events: Towards Fast Spiking Neural Networks Training via Event Dataset Distillationcited by 2
- 2026Bullet Trains: Parallelizing Training of Temporally Precise Spiking Neural Networkscited by 2
- 2025ParaRevSNN: A Parallel Reversible Spiking Neural Network for Efficient Training and Inferencecited by 0
- 2026ADPTNet: Adaptive with Prescriptive Timescales Non-Linear SSM for Sequence Modellingcited by 0
- 2026ADPTNet: Adaptive with Prescriptive Timescales Non-Linear SSM for Sequence Modelling27 Sep 2026
- 2026Bullet Trains: Parallelizing Training of Temporally Precise Spiking Neural Networks27 Feb 2026
- 2025Learning from Dense Events: Towards Fast Spiking Neural Networks Training via Event Dataset Distillation15 Nov 2025
- 2025ParaRevSNN: A Parallel Reversible Spiking Neural Network for Efficient Training and Inference2 Aug 2025
- 2025AR-LIF: Adaptive reset leaky integrate-and-fire neuron for spiking neural networks28 Jul 2025