Slumbering to Precision: Enhancing Artificial Neural Network Calibration Through Sleep-like Processes
Not on the map. Why?
Abstract (arXiv)
Artificial neural networks are often overconfident, undermining trust because their predicted probabilities do not match actual accuracy. Inspired by biological sleep and the role of spontaneous replay in memory and learning, we introduce Sleep Replay Consolidation (SRC), a novel calibration approach. SRC is a post-training, sleep-like phase that selectively replays internal representations to update network weights and improve calibration without supervised retraining. Across multiple experiments, SRC is competitive with and complementary to standard approaches such as temperature scaling. Combining SRC with temperature scaling achieves the best Brier score and entropy trade-offs for AlexNet and VGG19. These results show that SRC provides a fundamentally novel approach to improving neural network calibration. SRC-based calibration offers a practical path toward more trustworthy confidence estimates and narrows the gap between human-like uncertainty handling and modern deep networks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 51 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
14 of 51 references.
References · 14
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2014Going Deeper with Convolutionscited by 4,241
- 2019When Does Label Smoothing Help?cited by 988
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 364
- 2020Calibrating Deep Neural Networks using Focal Losscited by 357
- 2023On the Calibration of Large Language Models and Alignmentcited by 73
- 2024Calibrating Large Language Models with Sample Consistencycited by 73
- 2022Calibrated Learning to Defer with One-vs-All Classifierscited by 69
Built on by
Not cited yet.