mlsanityData to 7 Oct 2026

DeepSleepNet-Lite: A Simplified Automatic Sleep Stage Scoring Model with Uncertainty Estimates

arXiv 2108.10600 ↗First posted 24 Aug 2021cs.LGcited by 26

Not on the map. Why?

Abstract (arXiv)

Deep learning is widely used in the most recent automatic sleep scoring algorithms. Its popularity stems from its excellent performance and from its ability to directly process raw signals and to learn feature from the data. Most of the existing scoring algorithms exploit very computationally demanding architectures, due to their high number of training parameters, and process lengthy time sequences in input (up to 12 minutes). Only few of these architectures provide an estimate of the model uncertainty. In this study we propose DeepSleepNet-Lite, a simplified and lightweight scoring architecture, processing only 90-seconds EEG input sequences. We exploit, for the first time in sleep scoring, the Monte Carlo dropout technique to enhance the performance of the architecture and to also detect the uncertain instances. The evaluation is performed on a single-channel EEG Fpz-Cz from the open source Sleep-EDF expanded database. DeepSleepNet-Lite achieves slightly lower performance, if not on par, compared to the existing state-of-the-art architectures, in overall accuracy, macro F1-score and Cohen's kappa (on Sleep-EDF v1-2013 +/-30mins: 84.0%, 78.0%, 0.78; on Sleep-EDF v2-2018 +/-30mins: 80.3%, 75.2%, 0.73). Monte Carlo dropout enables the estimate of the uncertain predictions. By rejecting the uncertain instances, the model achieves higher performance on both versions of the database (on Sleep-EDF v1-2013 +/-30mins: 86.1.0%, 79.6%, 0.81; on Sleep-EDF v2-2018 +/-30mins: 82.3%, 76.7%, 0.76). Our lighter sleep scoring approach paves the way to the application of scoring algorithms for sleep analysis in real-time.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 16 of its 46 references that are in the map. First posted on arXiv 24 Aug 2021.

Builds on

16 of 46 references.

References · 16

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  3. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  4. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  5. 2019When Does Label Smoothing Help?cited by 985
  6. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
  7. 2020XSleepNet: Multi-View Sequential Model for Automatic Sleep Stagingcited by 87
  8. 2017A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time seriescited by 58
  9. 2019SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approachcited by 54
  10. 2017Neural network an1alysis of sleep stages enables efficient diagnosis of narcolepsycited by 39
  11. 2019Towards More Accurate Automatic Sleep Staging via Deep Transfer Learningcited by 31
  12. 2016Mixed Neural Network Approach for Temporal Sleep Stage Classificationcited by 23
4 more
  1. 2016Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networkscited by 21
  2. 2017Deep Convolutional Neural Networks for Interpretable Analysis of EEG Sleep Stage Scoringcited by 15
  3. 2018Deep residual networks for automatic sleep stage classification of raw polysomnographic waveformscited by 5
  4. 2019Intra- and Inter-epoch Temporal Context Network (IITNet) Using Sub-epoch Features for Automatic Sleep Scoring on Raw Single-channel EEGcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 7; 2023: 9; 2024: 4; 2025: 1; 2026: 4.

26 papers.

Sort:

By area:

  1. 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 41
  2. 2023L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Stagingcited by 21
  3. 2023When More is Less: Incorporating Additional Datasets Can Hurt Performance By Introducing Spurious Correlationscited by 18
  4. 2022Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformerscited by 13
  5. 2023Calibration of Transformer-based Models for Identifying Stress and Depression in Social Mediacited by 12
  6. 2022Automated Sleep Staging via Parallel Frequency-Cut Attentioncited by 7
  7. 2022Do Not Sleep on Traditional Machine Learning: Simple and Interpretable Techniques Are Competitive to Deep Learning for Sleep Scoringcited by 7
  8. 2022SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learningcited by 7
  9. 2023Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Reviewcited by 7
  10. 2022Multi-Tier Platform for Cognizing Massive Electroencephalogramcited by 4
  11. 2022Multi-Scored Sleep Databases: How to Exploit the Multiple-Labels in Automated Sleep Scoringcited by 4
  12. 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Inputcited by 3
14 more
  1. 2024SplitSEE: A Splittable Self-supervised Framework for Single-Channel EEG Representation Learningcited by 3
  2. 2025MSA-CNN: A Lightweight Multi-Scale CNN with Attention for Sleep Stage Classificationcited by 3
  3. 2022Towards Sleep Scoring Generalization Through Self-Supervised Meta-Learningcited by 2
  4. 2023SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced Classification of Sleep Stagescited by 2
  5. 2024Generalization and Risk Bounds for Recurrent Neural Networkscited by 2
  6. 2023Quantifying the Impact of Data Characteristics on the Transferability of Sleep Stage Scoring Modelscited by 1
  7. 2023aSAGA: Automatic Sleep Analysis with Gray Areascited by 1
  8. 2023Bridging AI and Clinical Practice: Integrating Automated Sleep Scoring Algorithm with Uncertainty-Guided Physician Reviewcited by 1
  9. 2026ULW-SleepNet: An Ultra-Lightweight Network for Multimodal Sleep Stage Scoringcited by 1
  10. 2023U-PASS: an Uncertainty-guided deep learning Pipeline for Automated Sleep Stagingcited by 0
  11. 2024MorpheusNet: Resource efficient sleep stage classifier for embedded on-line systemscited by 0
  12. 2026NeuroSleep: Neuromorphic Event-Driven Single-Channel EEG Sleep Staging for Edge-Efficient Sensingcited by 0
  13. 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasetscited by 0
  14. 2026NanoSleep: A Parameter-Efficient Hybrid Temporal Convolutional Network for Single-Channel Sleep Stage Classificationcited by 0