Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluation
Not on the map. Why?
Abstract (arXiv)
The past few years have witnessed a remarkable advance in deep learning for EEG-based sleep stage classification (SSC). However, the success of these models is attributed to possessing a massive amount of labeled data for training, limiting their applicability in real-world scenarios. In such scenarios, sleep labs can generate a massive amount of data, but labeling these data can be expensive and time-consuming. Recently, the self-supervised learning (SSL) paradigm has shined as one of the most successful techniques to overcome the scarcity of labeled data. In this paper, we evaluate the efficacy of SSL to boost the performance of existing SSC models in the few-labels regime. We conduct a thorough study on three SSC datasets, and we find that fine-tuning the pretrained SSC models with only 5% of labeled data can achieve competitive performance to the supervised training with full labels. Moreover, self-supervised pretraining helps SSC models to be more robust to data imbalance and domain shift problems. The code is publicly available at https://github.com/emadeldeen24/eval_ssl_ssc.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 10 Oct 2022.
Builds on
24 of 42 references.
References · 24
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2020A Survey on Contrastive Self-supervised Learningcited by 553
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
- 2021Self-supervised Learning is More Robust to Dataset Imbalancecited by 122
- 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
12 more
- 2020Self-supervised ECG Representation Learning for Emotion Recognitioncited by 99
- 2019Multi-task Self-Supervised Learning for Human Activity Detectioncited by 98
- 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 90
- 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 83
- 2020How Useful is Self-Supervised Pretraining for Visual Tasks?cited by 80
- 2022ADATIME: A Benchmarking Suite for Domain Adaptation on Time Series Datacited by 45
- 2022Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classificationcited by 39
- 2019Towards More Accurate Automatic Sleep Staging via Deep Transfer Learningcited by 31
- 2021Self-supervised Autoregressive Domain Adaptation for Time Series Datacited by 29
- 2021Self-supervised Contrastive Learning for EEG-based Sleep Stagingcited by 27
- 2021ADAST: Attentive Cross-domain EEG-based Sleep Staging Framework with Iterative Self-Trainingcited by 17
- 2019End-to-end Sleep Staging with Raw Single Channel EEG using Deep Residual ConvNetscited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 6; 2025: 3; 2026: 3.
14 papers.
Sort:
- 2023Label-efficient Time Series Representation Learning: A Reviewcited by 16
- 2024SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEGcited by 12
- 2026SleepLM: Natural-Language Intelligence for Human Sleepcited by 10
- 2024Personalized Sleep Staging Leveraging Source-free Unsupervised Domain Adaptationcited by 7
- 2025Are foundation models useful feature extractors for electroencephalography analysis?cited by 3
- 2024EEGUnity: Open-Source Tool in Facilitating Unified EEG Datasets Towards Large-Scale EEG Modelcited by 2
- 2024HeartBERT: A Self-Supervised ECG Embedding Model for Efficient and Effective Medical Signal Analysiscited by 2
- 2024SelfReplay: Adapting Self-Supervised Sensory Models via Adaptive Meta-Task Replaycited by 1
- 2023Large-scale Foundation Models and Generative AI for BigData Neurosciencecited by 0
- 2024Data-Efficient Sleep Staging with Synthetic Time Series Pretrainingcited by 0
- 2025MetaSTH-Sleep: Towards Effective Few-Shot Sleep Stage Classification for Health Management with Spatial-Temporal Hypergraph Enhanced Meta-Learningcited by 0
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEGcited by 0
- 2026Sleep-stage efficient classification using a lightweight self-supervised model25 May 2026
- 2026Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment14 May 2026
- 2026SleepLM: Natural-Language Intelligence for Human Sleep27 Feb 2026
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEG9 Oct 2025
- 2025MetaSTH-Sleep: Towards Effective Few-Shot Sleep Stage Classification for Health Management with Spatial-Temporal Hypergraph Enhanced Meta-Learning22 May 2025
- 2025Are foundation models useful feature extractors for electroencephalography analysis?28 Feb 2025
- 2024Personalized Sleep Staging Leveraging Source-free Unsupervised Domain Adaptation11 Dec 2024
- 2024HeartBERT: A Self-Supervised ECG Embedding Model for Efficient and Effective Medical Signal Analysis8 Nov 2024
- 2024SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEG26 Oct 2024
- 2024EEGUnity: Open-Source Tool in Facilitating Unified EEG Datasets Towards Large-Scale EEG Model24 Sep 2024
- 2024SelfReplay: Adapting Self-Supervised Sensory Models via Adaptive Meta-Task Replay29 Mar 2024
- 2024Data-Efficient Sleep Staging with Synthetic Time Series Pretraining13 Mar 2024
2 more
- 2023Label-efficient Time Series Representation Learning: A Reviewcited by 16
- 2024SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEGcited by 12
- 2026SleepLM: Natural-Language Intelligence for Human Sleepcited by 10
- 2024Personalized Sleep Staging Leveraging Source-free Unsupervised Domain Adaptationcited by 7
- 2025Are foundation models useful feature extractors for electroencephalography analysis?cited by 3
- 2024EEGUnity: Open-Source Tool in Facilitating Unified EEG Datasets Towards Large-Scale EEG Modelcited by 2
- 2024HeartBERT: A Self-Supervised ECG Embedding Model for Efficient and Effective Medical Signal Analysiscited by 2
- 2024SelfReplay: Adapting Self-Supervised Sensory Models via Adaptive Meta-Task Replaycited by 1
- 2023Large-scale Foundation Models and Generative AI for BigData Neurosciencecited by 0
- 2024Data-Efficient Sleep Staging with Synthetic Time Series Pretrainingcited by 0
- 2025MetaSTH-Sleep: Towards Effective Few-Shot Sleep Stage Classification for Health Management with Spatial-Temporal Hypergraph Enhanced Meta-Learningcited by 0
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEGcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Sleep-stage efficient classification using a lightweight self-supervised model25 May 2026
- 2026Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment14 May 2026
- 2026SleepLM: Natural-Language Intelligence for Human Sleep27 Feb 2026
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEG9 Oct 2025
- 2025MetaSTH-Sleep: Towards Effective Few-Shot Sleep Stage Classification for Health Management with Spatial-Temporal Hypergraph Enhanced Meta-Learning22 May 2025
- 2025Are foundation models useful feature extractors for electroencephalography analysis?28 Feb 2025
- 2024Personalized Sleep Staging Leveraging Source-free Unsupervised Domain Adaptation11 Dec 2024
- 2024HeartBERT: A Self-Supervised ECG Embedding Model for Efficient and Effective Medical Signal Analysis8 Nov 2024
- 2024SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEG26 Oct 2024
- 2024EEGUnity: Open-Source Tool in Facilitating Unified EEG Datasets Towards Large-Scale EEG Model24 Sep 2024
- 2024SelfReplay: Adapting Self-Supervised Sensory Models via Adaptive Meta-Task Replay29 Mar 2024
- 2024Data-Efficient Sleep Staging with Synthetic Time Series Pretraining13 Mar 2024
12 newest of 14 All 14 (JSON)