# PMSN: A Parallel Multi-compartment Spiking Neuron for Multi-scale Temporal Processing

arXiv: https://arxiv.org/abs/2408.14917 · HTML: https://mlsanity.com/paper/2408.14917/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 Aug 2024.

## Built on by (most cited first, 5 of 5)

- [Dendritic Resonate-and-Fire Neuron for Effective and Efficient Long Sequence Modeling](https://mlsanity.com/paper/2509.17186/) (2025)
- [Neural Dynamics Self-Attention for Spiking Transformers](https://mlsanity.com/paper/2603.19290/) (2026)
- [Efficient Training of Spiking Neural Networks by Spike-aware Data Pruning](https://mlsanity.com/paper/2510.04098/) (2025)
- [Revisiting Reset Mechanisms in Spiking Neural Networks for Sequential Modeling: Specialized Discretization for Binary Activated RNN](https://mlsanity.com/paper/2504.17751/) (2025)
- [Reconstructing Spiking Neural Networks Using a Single Neuron with Autapses](https://mlsanity.com/paper/2603.24692/) (2026)

## Abstract (arXiv)

Spiking Neural Networks (SNNs) hold great potential to realize brain-inspired, energy-efficient computational systems. However, current SNNs still fall short in terms of multiscale temporal processing compared to their biological counterparts. This limitation has resulted in poor performance in many pattern recognition tasks with information that varies across different timescales. To address this issue, we put forward a novel spiking neuron model called Parallel Multi-compartment Spiking Neuron (PMSN). The PMSN emulates biological neurons by incorporating multiple interacting substructures and allows for flexible adjustment of the substructure counts to effectively represent temporal information across diverse timescales. Additionally, to address the computational burden associated with the increased complexity of the proposed model, we introduce two parallelization techniques that decouple the temporal dependencies of neuronal updates, enabling parallelized training across different time steps. Our experiments across a wide range of pattern recognition tasks demonstrate that PMSN outperforms state-of-the-art spiking neuron models in temporal processing capacity and training speed. Specifically, compared with the commonly used Leaky Integrate-and-Fire neuron, PMSN offers more than 10 times acceleration and a 30% accuracy improvement on Sequential CIFAR-10 dataset, while maintaining comparable computational cost. Our implementation on neuromorphic hardware further demonstrates the deployability of PMSN and highlights its favorable trade-off between effectiveness and efficiency. Therefore, the proposed PMSN presents a promising solution to harness the computational advantages of detailed biological neurons, enabling high-performance and efficient temporal processing on neuromorphic computing systems. Code is available at https://github.com/xychen-comp/PMSN.