mlsanityData to 7 Oct 2026

SpikCommander: A High-performance Spiking Transformer with Multi-view Learning for Efficient Speech Command Recognition

arXiv 2511.07883 ↗First posted 11 Nov 2025cs.SD cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Spiking neural networks (SNNs) offer a promising path toward energy-efficient speech command recognition (SCR) by leveraging their event-driven processing paradigm. However, existing SNN-based SCR methods often struggle to capture rich temporal dependencies and contextual information from speech due to limited temporal modeling and binary spike-based representations. To address these challenges, we first introduce the multi-view spiking temporal-aware self-attention (MSTASA) module, which combines effective spiking temporal-aware attention with a multi-view learning framework to model complementary temporal dependencies in speech commands. Building on MSTASA, we further propose SpikCommander, a fully spike-driven transformer architecture that integrates MSTASA with a spiking contextual refinement channel MLP (SCR-MLP) to jointly enhance temporal context modeling and channel-wise feature integration. We evaluate our method on three benchmark datasets: the Spiking Heidelberg Dataset (SHD), the Spiking Speech Commands (SSC), and the Google Speech Commands V2 (GSC). Extensive experiments demonstrate that SpikCommander consistently outperforms state-of-the-art (SOTA) SNN approaches with fewer parameters under comparable time steps, highlighting its effectiveness and efficiency for robust speech command recognition.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

21 of 44 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  4. 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
  5. 2021AST: Audio Spectrogram Transformercited by 634
  6. 2021Deep Residual Learning in Spiking Neural Networkscited by 326
  7. 2022Spikformer: When Spiking Neural Network Meets Transformercited by 263
  8. 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 163
  9. 2019The Heidelberg spiking datasets for the systematic evaluation of spiking neural networkscited by 135
  10. 2024Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chipscited by 97
  11. 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 90
  12. 2021Keyword Transformer: A Self-Attention Model for Keyword Spottingcited by 59
9 more
  1. 2023Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable Spacingscited by 48
  2. 2024SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanismscited by 31
  3. 2024SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spikingcited by 29
  4. 2023Training Full Spike Neural Networks via Auxiliary Accumulation Pathwaycited by 26
  5. 2024LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Unitscited by 11
  6. 2023Delayed Memory Unit: Modelling Temporal Dependency Through Delay Gatecited by 4
  7. 2024Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spottingcited by 4
  8. 2021Attention-Free Keyword Spottingcited by 2
  9. 2025MSVIT: Improving Spiking Vision Transformer Using Multi-scale Attention Fusioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.