SpikCommander: A High-performance Spiking Transformer with Multi-view Learning for Efficient Speech Command Recognition
Not on the map. Why?
Abstract (arXiv)
Spiking neural networks (SNNs) offer a promising path toward energy-efficient speech command recognition (SCR) by leveraging their event-driven processing paradigm. However, existing SNN-based SCR methods often struggle to capture rich temporal dependencies and contextual information from speech due to limited temporal modeling and binary spike-based representations. To address these challenges, we first introduce the multi-view spiking temporal-aware self-attention (MSTASA) module, which combines effective spiking temporal-aware attention with a multi-view learning framework to model complementary temporal dependencies in speech commands. Building on MSTASA, we further propose SpikCommander, a fully spike-driven transformer architecture that integrates MSTASA with a spiking contextual refinement channel MLP (SCR-MLP) to jointly enhance temporal context modeling and channel-wise feature integration. We evaluate our method on three benchmark datasets: the Spiking Heidelberg Dataset (SHD), the Spiking Speech Commands (SSC), and the Google Speech Commands V2 (GSC). Extensive experiments demonstrate that SpikCommander consistently outperforms state-of-the-art (SOTA) SNN approaches with fewer parameters under comparable time steps, highlighting its effectiveness and efficiency for robust speech command recognition.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
21 of 44 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
- 2021AST: Audio Spectrogram Transformercited by 634
- 2021Deep Residual Learning in Spiking Neural Networkscited by 326
- 2022Spikformer: When Spiking Neural Network Meets Transformercited by 263
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 163
- 2019The Heidelberg spiking datasets for the systematic evaluation of spiking neural networkscited by 135
- 2024Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chipscited by 97
- 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 90
- 2021Keyword Transformer: A Self-Attention Model for Keyword Spottingcited by 59
9 more
- 2023Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable Spacingscited by 48
- 2024SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanismscited by 31
- 2024SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spikingcited by 29
- 2023Training Full Spike Neural Networks via Auxiliary Accumulation Pathwaycited by 26
- 2024LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Unitscited by 11
- 2023Delayed Memory Unit: Modelling Temporal Dependency Through Delay Gatecited by 4
- 2024Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spottingcited by 4
- 2021Attention-Free Keyword Spottingcited by 2
- 2025MSVIT: Improving Spiking Vision Transformer Using Multi-scale Attention Fusioncited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.