mlsanityData to 14 Oct 2026

Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Review

arXiv 2312.09454 ↗First posted 15 Nov 2023eess.SP cs.HC cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Purpose: Uncertainty Quantification (UQ) has gained traction in an attempt to improve the interpretability and robustness of machine learning predictions. Specifically (medical) biosignals such as electroencephalography (EEG), electrocardiography (ECG), electrooculography (EOG), and electromyography (EMG) could benefit from good UQ, since these suffer from a poor signal-to-noise ratio, and good human interpretability is pivotal for medical applications. To determine how uncertainty estimation can be used for biosignal tasks, we investigate current methods, use cases, applications, evaluations, and uncertainty measures. Methods: In this paper, we systematically review the state of the art of applying Uncertainty Quantification to Machine Learning tasks in the biosignal domain. All works from Web of Science, Scopus, IEEE XPlore and PsycINFO that discuss uncertainty in Machine Learning on one of the aforementioned biosignals is included. Results: We present various methods, shortcomings, uncertainty measures and theoretical frameworks that currently exist in this application domain based on the 53 reviewed papers and related literature. We address misconceptions in the field, provide recommendations for future work, and discuss gaps in the literature in relation to diagnostic implementations as well as control for prostheses or brain-computer interfaces. Conclusion: Overall it can be concluded that promising UQ methods are available, but that research is needed on how people and systems may interact with an uncertainty-model in a (clinical) environment.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 48 of its 157 references that are in the map. First posted on arXiv 15 Nov 2023.

Builds on

48 of 157 references.

References · 48

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  4. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
  5. 2019An Introduction to Variational Autoencoderscited by 1,000
  6. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
  7. 2017A Survey on Multi-Task Learningcited by 840
  8. 2017Deep Bayesian Active Learning with Image Datacited by 819
  9. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
  10. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  11. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  12. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
36 more
  1. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 628
  2. 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
  3. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 560
  4. 2018Predictive Uncertainty Estimation via Prior Networkscited by 557
  5. 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
  6. 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
  7. 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 338
  8. 2018To Trust Or Not To Trust A Classifiercited by 207
  9. 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
  10. 2018Understanding Measures of Uncertainty for Adversarial Example Detectioncited by 177
  11. 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
  12. 2020Deep Learning for ECG Analysis: Benchmarks and Insights from PTB-XLcited by 158
  13. 2020Data Uncertainty Learning in Face Recognitioncited by 134
  14. 2022Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?cited by 125
  15. 2022On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networkscited by 120
  16. 2018Uncertainty in Neural Networks: Approximately Bayesian Ensemblingcited by 94
  17. 2019Evaluating and Calibrating Uncertainty Prediction in Regression Taskscited by 87
  18. 2022A Deeper Look into Aleatoric and Epistemic Uncertainty Disentanglementcited by 87
  19. 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 84
  20. 2018Lightweight Probabilistic Deep Networkscited by 77
  21. 2020SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimatescited by 75
  22. 2022Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priorscited by 43
  23. 2015Bayesian model averaging: A systematic review and conceptual classificationcited by 29
  24. 2021DeepSleepNet-Lite: A Simplified Automatic Sleep Stage Scoring Model with Uncertainty Estimatescited by 26
  25. 2020On Last-Layer Algorithms for Classification: Decoupling Representation from Uncertainty Estimationcited by 23
  26. 2019A Bayesian Deep Learning Framework for End-To-End Prediction of Emotion from Heartbeatcited by 11
  27. 2022Bias Reducing Multitask Learning on Mental Health Predictioncited by 9
  28. 2023Bayesian neural networks via MCMC: a Python-based tutorialcited by 8
  29. 2021Benchmarking Uncertainty Quantification on Biosignal Classification Tasks under Dataset Shiftcited by 6
  30. 2020Quantile Regression Neural Networks: A Bayesian Approachcited by 5
  31. 2019Evaluating and Boosting Uncertainty Quantification in Classificationcited by 4
  32. 2021The information of attribute uncertainties: what convolutional neural networks can learn about errors in input datacited by 4
  33. 2021Exploring the Limits of Epistemic Uncertainty Quantification in Low-Shot Settingscited by 4
  34. 2021Classification of fNIRS Data Under Uncertainty: A Bayesian Neural Network Approachcited by 2
  35. 2021Interval Deep Learning for Uncertainty Quantification in Safety Applicationscited by 2
  36. 2023A new method of modeling the multi-stage decision-making process of CRT using machine learning with uncertainty quantificationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 3.

7 papers.