Average-Over-Time Spiking Neural Networks for Uncertainty Estimation in Regression
Not on the map. Why?
Abstract (arXiv)
Uncertainty estimation is a standard tool to quantify the reliability of modern deep learning models, and crucial for many real-world applications. However, efficient uncertainty estimation methods for spiking neural networks, particularly for regression models, have been lacking. Here, we introduce two methods that adapt the Average-Over-Time Spiking Neural Network (AOT-SNN) framework to regression tasks, enhancing uncertainty estimation in event-driven models. The first method uses the heteroscedastic Gaussian approach, where SNNs predict both the mean and variance at each time step, thereby generating a conditional probability distribution of the target variable. The second method leverages the Regression-as-Classification (RAC) approach, reformulating regression as a classification problem to facilitate uncertainty estimation. We evaluate our approaches on both a toy dataset and several benchmark datasets, demonstrating that the proposed AOT-SNN models achieve performance comparable to or better than state-of-the-art deep neural network methods, particularly in uncertainty estimation. Our findings highlight the potential of SNNs for uncertainty estimation in regression tasks, providing an efficient and biologically inspired alternative for applications requiring both accuracy and energy efficiency.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 29 Nov 2024.
Builds on
14 of 22 references.
References · 14
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2016Colorful Image Colorizationcited by 1,114
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
- 2021Accurate and efficient time-domain classification with adaptive spiking recurrent neural networkscited by 115
- 2022Regression as Classification: Influence of Task Formulation on Neural Network Featurescited by 29
- 2024Conformal Prediction via Regression-as-Classificationcited by 18
- 2023Efficient Uncertainty Estimation in Spiking Neural Networks via MC-dropoutcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.