DeepSleepNet-Lite: A Simplified Automatic Sleep Stage Scoring Model with Uncertainty Estimates
Not on the map. Why?
Abstract (arXiv)
Deep learning is widely used in the most recent automatic sleep scoring algorithms. Its popularity stems from its excellent performance and from its ability to directly process raw signals and to learn feature from the data. Most of the existing scoring algorithms exploit very computationally demanding architectures, due to their high number of training parameters, and process lengthy time sequences in input (up to 12 minutes). Only few of these architectures provide an estimate of the model uncertainty. In this study we propose DeepSleepNet-Lite, a simplified and lightweight scoring architecture, processing only 90-seconds EEG input sequences. We exploit, for the first time in sleep scoring, the Monte Carlo dropout technique to enhance the performance of the architecture and to also detect the uncertain instances. The evaluation is performed on a single-channel EEG Fpz-Cz from the open source Sleep-EDF expanded database. DeepSleepNet-Lite achieves slightly lower performance, if not on par, compared to the existing state-of-the-art architectures, in overall accuracy, macro F1-score and Cohen's kappa (on Sleep-EDF v1-2013 +/-30mins: 84.0%, 78.0%, 0.78; on Sleep-EDF v2-2018 +/-30mins: 80.3%, 75.2%, 0.73). Monte Carlo dropout enables the estimate of the uncertain predictions. By rejecting the uncertain instances, the model achieves higher performance on both versions of the database (on Sleep-EDF v1-2013 +/-30mins: 86.1.0%, 79.6%, 0.81; on Sleep-EDF v2-2018 +/-30mins: 82.3%, 76.7%, 0.76). Our lighter sleep scoring approach paves the way to the application of scoring algorithms for sleep analysis in real-time.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 16 of its 46 references that are in the map. First posted on arXiv 24 Aug 2021.
Builds on
16 of 46 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2019When Does Label Smoothing Help?cited by 985
- 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
- 2020XSleepNet: Multi-View Sequential Model for Automatic Sleep Stagingcited by 87
- 2017A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time seriescited by 58
- 2019SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approachcited by 54
- 2017Neural network an1alysis of sleep stages enables efficient diagnosis of narcolepsycited by 39
- 2019Towards More Accurate Automatic Sleep Staging via Deep Transfer Learningcited by 31
- 2016Mixed Neural Network Approach for Temporal Sleep Stage Classificationcited by 23
4 more
- 2016Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networkscited by 21
- 2017Deep Convolutional Neural Networks for Interpretable Analysis of EEG Sleep Stage Scoringcited by 15
- 2018Deep residual networks for automatic sleep stage classification of raw polysomnographic waveformscited by 5
- 2019Intra- and Inter-epoch Temporal Context Network (IITNet) Using Sub-epoch Features for Automatic Sleep Scoring on Raw Single-channel EEGcited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 7; 2023: 9; 2024: 4; 2025: 1; 2026: 4.
26 papers.
Sort:
By area:
- 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 41
- 2023L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Stagingcited by 21
- 2023When More is Less: Incorporating Additional Datasets Can Hurt Performance By Introducing Spurious Correlationscited by 18
- 2022Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformerscited by 13
- 2023Calibration of Transformer-based Models for Identifying Stress and Depression in Social Mediacited by 12
- 2022Automated Sleep Staging via Parallel Frequency-Cut Attentioncited by 7
- 2022Do Not Sleep on Traditional Machine Learning: Simple and Interpretable Techniques Are Competitive to Deep Learning for Sleep Scoringcited by 7
- 2022SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learningcited by 7
- 2023Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Reviewcited by 7
- 2022Multi-Tier Platform for Cognizing Massive Electroencephalogramcited by 4
- 2022Multi-Scored Sleep Databases: How to Exploit the Multiple-Labels in Automated Sleep Scoringcited by 4
- 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Inputcited by 3
14 more
- 2024SplitSEE: A Splittable Self-supervised Framework for Single-Channel EEG Representation Learningcited by 3
- 2025MSA-CNN: A Lightweight Multi-Scale CNN with Attention for Sleep Stage Classificationcited by 3
- 2022Towards Sleep Scoring Generalization Through Self-Supervised Meta-Learningcited by 2
- 2023SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced Classification of Sleep Stagescited by 2
- 2024Generalization and Risk Bounds for Recurrent Neural Networkscited by 2
- 2023Quantifying the Impact of Data Characteristics on the Transferability of Sleep Stage Scoring Modelscited by 1
- 2023aSAGA: Automatic Sleep Analysis with Gray Areascited by 1
- 2023Bridging AI and Clinical Practice: Integrating Automated Sleep Scoring Algorithm with Uncertainty-Guided Physician Reviewcited by 1
- 2026ULW-SleepNet: An Ultra-Lightweight Network for Multimodal Sleep Stage Scoringcited by 1
- 2023U-PASS: an Uncertainty-guided deep learning Pipeline for Automated Sleep Stagingcited by 0
- 2024MorpheusNet: Resource efficient sleep stage classifier for embedded on-line systemscited by 0
- 2026NeuroSleep: Neuromorphic Event-Driven Single-Channel EEG Sleep Staging for Edge-Efficient Sensingcited by 0
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasetscited by 0
- 2026NanoSleep: A Parameter-Efficient Hybrid Temporal Convolutional Network for Single-Channel Sleep Stage Classificationcited by 0
- 2026NanoSleep: A Parameter-Efficient Hybrid Temporal Convolutional Network for Single-Channel Sleep Stage Classification19 Aug 2026
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasets6 Jul 2026
- 2026ULW-SleepNet: An Ultra-Lightweight Network for Multimodal Sleep Stage Scoring27 Feb 2026
- 2026NeuroSleep: Neuromorphic Event-Driven Single-Channel EEG Sleep Staging for Edge-Efficient Sensing6 Feb 2026
- 2025MSA-CNN: A Lightweight Multi-Scale CNN with Attention for Sleep Stage Classification6 Jan 2025
- 2024Generalization and Risk Bounds for Recurrent Neural Networks5 Nov 2024
- 2024SplitSEE: A Splittable Self-supervised Framework for Single-Channel EEG Representation Learning15 Oct 2024
- 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Input9 Aug 2024
- 2024MorpheusNet: Resource efficient sleep stage classifier for embedded on-line systems14 Jan 2024
- 2023Bridging AI and Clinical Practice: Integrating Automated Sleep Scoring Algorithm with Uncertainty-Guided Physician Review22 Dec 2023
- 2023Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Review15 Nov 2023
- 2023aSAGA: Automatic Sleep Analysis with Gray Areas3 Oct 2023
14 more
- 2023When More is Less: Incorporating Additional Datasets Can Hurt Performance By Introducing Spurious Correlations8 Aug 2023
- 2023SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced Classification of Sleep Stages4 Jul 2023
- 2023U-PASS: an Uncertainty-guided deep learning Pipeline for Automated Sleep Staging7 Jun 2023
- 2023Calibration of Transformer-based Models for Identifying Stress and Depression in Social Media26 May 2023
- 2023Quantifying the Impact of Data Characteristics on the Transferability of Sleep Stage Scoring Models28 Mar 2023
- 2023L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Staging9 Jan 2023
- 2022SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learning20 Sep 2022
- 2022Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers15 Aug 2022
- 2022Towards Sleep Scoring Generalization Through Self-Supervised Meta-Learning27 Jul 2022
- 2022Do Not Sleep on Traditional Machine Learning: Simple and Interpretable Techniques Are Competitive to Deep Learning for Sleep Scoring15 Jul 2022
- 2022Multi-Scored Sleep Databases: How to Exploit the Multiple-Labels in Automated Sleep Scoring5 Jul 2022
- 2022Multi-Tier Platform for Cognizing Massive Electroencephalogram21 Apr 2022
- 2022Automated Sleep Staging via Parallel Frequency-Cut Attention7 Apr 2022
- 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directions3 Nov 2021
- 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 41
- 2023L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Stagingcited by 21
- 2023When More is Less: Incorporating Additional Datasets Can Hurt Performance By Introducing Spurious Correlationscited by 18
- 2022Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformerscited by 13
- 2023Calibration of Transformer-based Models for Identifying Stress and Depression in Social Mediacited by 12
- 2022Automated Sleep Staging via Parallel Frequency-Cut Attentioncited by 7
- 2022Do Not Sleep on Traditional Machine Learning: Simple and Interpretable Techniques Are Competitive to Deep Learning for Sleep Scoringcited by 7
- 2022SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learningcited by 7
- 2023Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Reviewcited by 7
- 2022Multi-Tier Platform for Cognizing Massive Electroencephalogramcited by 4
- 2022Multi-Scored Sleep Databases: How to Exploit the Multiple-Labels in Automated Sleep Scoringcited by 4
- 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Inputcited by 3
12 most cited of 25 All 25 (JSON)
- 2026NanoSleep: A Parameter-Efficient Hybrid Temporal Convolutional Network for Single-Channel Sleep Stage Classification19 Aug 2026
- 2026ULW-SleepNet: An Ultra-Lightweight Network for Multimodal Sleep Stage Scoring27 Feb 2026
- 2026NeuroSleep: Neuromorphic Event-Driven Single-Channel EEG Sleep Staging for Edge-Efficient Sensing6 Feb 2026
- 2025MSA-CNN: A Lightweight Multi-Scale CNN with Attention for Sleep Stage Classification6 Jan 2025
- 2024Generalization and Risk Bounds for Recurrent Neural Networks5 Nov 2024
- 2024SplitSEE: A Splittable Self-supervised Framework for Single-Channel EEG Representation Learning15 Oct 2024
- 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Input9 Aug 2024
- 2024MorpheusNet: Resource efficient sleep stage classifier for embedded on-line systems14 Jan 2024
- 2023Bridging AI and Clinical Practice: Integrating Automated Sleep Scoring Algorithm with Uncertainty-Guided Physician Review22 Dec 2023
- 2023Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Review15 Nov 2023
- 2023aSAGA: Automatic Sleep Analysis with Gray Areas3 Oct 2023
- 2023When More is Less: Incorporating Additional Datasets Can Hurt Performance By Introducing Spurious Correlations8 Aug 2023
12 newest of 25 All 25 (JSON)