mlsanityData to 7 Oct 2026

PTS-SNN: A Prompt-Tuned Temporal Shift Spiking Neural Networks for Efficient Speech Emotion Recognition

arXiv 2602.08240 ↗First posted 9 Feb 2026cs.AI cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Speech Emotion Recognition (SER) is widely deployed in Human-Computer Interaction, yet the high computational cost of conventional models hinders their implementation on resource-constrained edge devices. Spiking Neural Networks (SNNs) offer an energy-efficient alternative due to their event-driven nature; however, their integration with continuous Self-Supervised Learning (SSL) representations is fundamentally challenged by distribution mismatch, where high-dynamic-range embeddings degrade the information coding capacity of threshold-based neurons. To resolve this, we propose Prompt-Tuned Spiking Neural Networks (PTS-SNN), a parameter-efficient neuromorphic adaptation framework that aligns frozen SSL backbones with spiking dynamics. Specifically, we introduce a Temporal Shift Spiking Encoder to capture local temporal dependencies via parameter-free channel shifts, establishing a stable feature basis. To bridge the domain gap, we devise a Context-Aware Membrane Potential Calibration strategy. This mechanism leverages a Spiking Sparse Linear Attention module to aggregate global semantic context into learnable soft prompts, which dynamically regulate the bias voltages of Parametric Leaky Integrate-and-Fire (PLIF) neurons. This regulation effectively centers the heterogeneous input distribution within the responsive firing range, mitigating functional silence or saturation. Extensive experiments on five multilingual datasets (e.g., IEMOCAP, CASIA, EMODB) demonstrate that PTS-SNN achieves 73.34% accuracy on IEMOCAP, comparable to competitive Artificial Neural Networks (ANNs), while requiring only 1.19M trainable parameters and 0.35 mJ inference energy per sample.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 64 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

31 of 64 references.

References · 31

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  5. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  6. 2022MaPLe: Multi-modal Prompt Learningcited by 685
  7. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
  8. 2022Spikformer: When Spiking Neural Network Meets Transformercited by 263
  9. 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 251
  10. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 196
  11. 2023Spike-driven Transformercited by 141
  12. 2022On the Effectiveness of Parameter-Efficient Fine-Tuningcited by 140
19 more
  1. 2023Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipelinecited by 50
  2. 2023SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiationcited by 47
  3. 2022Speech Emotion Recognition with Co-Attention based Multi-level Acoustic Informationcited by 31
  4. 2019Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognitioncited by 27
  5. 2022Exploring Temporal Information Dynamics in Spiking Neural Networkscited by 23
  6. 2023PEFT-SER: On the Use of Parameter Efficient Transfer Learning Approaches For Speech Emotion Recognition Using Pre-trained Speech Modelscited by 17
  7. 2023DST: Deformable Speech Transformer for Emotion Recognitioncited by 11
  8. 2024Elucidating the theoretical underpinnings of surrogate gradient learning in spiking neural networkscited by 11
  9. 2023Acoustic Prompt Tuning: Empowering Large Language Models with Audition Capabilitiescited by 10
  10. 2025Differential Coding for Training-Free ANN-to-SNN Conversioncited by 9
  11. 2023Mingling or Misalignment? Temporal Shift for Speech Emotion Recognition with Pre-trained Representationscited by 5
  12. 2024Step-wise Distribution Alignment Guided Style Prompt Tuning for Source-free Cross-domain Few-shot Learningcited by 5
  13. 2025TS-SNN: Temporal Shift Module for Spiking Neural Networkscited by 5
  14. 2024Multi-Scale Temporal Transformer For Speech Emotion Recognitioncited by 4
  15. 2024Emotion Neural Transducer for Fine-Grained Speech Emotion Recognitioncited by 3
  16. 2024SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Networkcited by 3
  17. 2025Learning More with Less: Self-Supervised Approaches for Low-Resource Speech Emotion Recognitioncited by 2
  18. 2024Exploring neural oscillations during speech perception via surrogate gradient spiking neural networkscited by 1
  19. 2025Self-Attentive Spatio-Temporal Calibration for Precise Intermediate Layer Matching in ANN-to-SNN Distillationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.