mlsanityData to 7 Oct 2026

Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluation

arXiv 2210.06286 ↗First posted 10 Oct 2022eess.SP cs.LGcited by 14

Not on the map. Why?

Abstract (arXiv)

The past few years have witnessed a remarkable advance in deep learning for EEG-based sleep stage classification (SSC). However, the success of these models is attributed to possessing a massive amount of labeled data for training, limiting their applicability in real-world scenarios. In such scenarios, sleep labs can generate a massive amount of data, but labeling these data can be expensive and time-consuming. Recently, the self-supervised learning (SSL) paradigm has shined as one of the most successful techniques to overcome the scarcity of labeled data. In this paper, we evaluate the efficacy of SSL to boost the performance of existing SSC models in the few-labels regime. We conduct a thorough study on three SSC datasets, and we find that fine-tuning the pretrained SSC models with only 5% of labeled data can achieve competitive performance to the supervised training with full labels. Moreover, self-supervised pretraining helps SSC models to be more robust to data imbalance and domain shift problems. The code is publicly available at https://github.com/emadeldeen24/eval_ssl_ssc.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 10 Oct 2022.

Builds on

24 of 42 references.

References · 24

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  5. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  6. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  7. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  8. 2020A Survey on Contrastive Self-supervised Learningcited by 553
  9. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  10. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
  11. 2021Self-supervised Learning is More Robust to Dataset Imbalancecited by 122
  12. 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
12 more
  1. 2020Self-supervised ECG Representation Learning for Emotion Recognitioncited by 99
  2. 2019Multi-task Self-Supervised Learning for Human Activity Detectioncited by 98
  3. 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 90
  4. 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 83
  5. 2020How Useful is Self-Supervised Pretraining for Visual Tasks?cited by 80
  6. 2022ADATIME: A Benchmarking Suite for Domain Adaptation on Time Series Datacited by 45
  7. 2022Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classificationcited by 39
  8. 2019Towards More Accurate Automatic Sleep Staging via Deep Transfer Learningcited by 31
  9. 2021Self-supervised Autoregressive Domain Adaptation for Time Series Datacited by 29
  10. 2021Self-supervised Contrastive Learning for EEG-based Sleep Stagingcited by 27
  11. 2021ADAST: Attentive Cross-domain EEG-based Sleep Staging Framework with Iterative Self-Trainingcited by 17
  12. 2019End-to-end Sleep Staging with Raw Single Channel EEG using Deep Residual ConvNetscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 6; 2025: 3; 2026: 3.

14 papers.

Sort: