mlsanityData to 14 Oct 2026

Practical Bayesian Inference for Speech SNNs: Uncertainty and Loss-Landscape Smoothing

arXiv 2604.08624 ↗First posted 9 Apr 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Spiking Neural Networks (SNNs) are naturally suited for speech processing tasks due to their specific dynamics, which allows them to handle temporal data. However, the threshold-based generation of spikes in SNNs intuitively causes an angular or irregular predictive landscape. We explore the effect of using the Bayesian learning approach for the weights on the irregular predictive landscape. For the surrogate-gradient SNNs, we also explore the application of the Improved Variational Online Newton (IVON) approach, which is an efficient variational approach. The performance of the proposed approach is evaluated on the Heidelberg Digits and Speech Commands datasets. The hypothesis is that the Bayesian approach will result in a smoother and more regular predictive landscape, given the angular nature of the deterministic predictive landscape. The experimental evaluation of the proposed approach shows improved performance on the negative log-likelihood and Brier score. Furthermore, the proposed approach has resulted in a smoother and more regular predictive landscape compared to the deterministic approach, based on the one-dimensional slices of the weight space

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

15 of 22 references.

References · 15

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  3. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  4. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 560
  5. 2015Weight Uncertainty in Neural Networkscited by 554
  6. 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 365
  7. 2019Practical Deep Learning with Bayesian Principlescited by 158
  8. 2018Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adamcited by 131
  9. 2021The Bayesian Learning Rulecited by 99
  10. 2024Variational Learning is Effective for Large Deep Networkscited by 65
  11. 2019Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognitioncited by 27
  12. 2022Bayesian Continual Learning via Spiking Neural Networkscited by 13
3 more
  1. 2022Examining the Robustness of Spiking Neural Networks on Non-ideal Memristive Crossbarscited by 9
  2. 2021Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processorscited by 7
  3. 2023Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processorscited by 4

Built on by

Not cited yet.