mlsanityData to 7 Oct 2026

Self-supervised Contrastive Learning for EEG-based Sleep Staging

arXiv 2109.07839 ↗First posted 16 Sep 2021cs.LGcited by 27

Not on the map. Why?

Abstract (arXiv)

EEG signals are usually simple to obtain but expensive to label. Although supervised learning has been widely used in the field of EEG signal analysis, its generalization performance is limited by the amount of annotated data. Self-supervised learning (SSL), as a popular learning paradigm in computer vision (CV) and natural language processing (NLP), can employ unlabeled data to make up for the data shortage of supervised learning. In this paper, we propose a self-supervised contrastive learning method of EEG signals for sleep stage classification. During the training process, we set up a pretext task for the network in order to match the right transformation pairs generated from EEG signals. In this way, the network improves the representation ability by learning the general features of EEG signals. The robustness of the network also gets improved in dealing with diverse data, that is, extracting constant features from changing data. In detail, the network's performance depends on the choice of transformations and the amount of unlabeled data used in the training process of self-supervised learning. Empirical evaluations on the Sleep-edf dataset demonstrate the competitive performance of our method on sleep staging (88.16% accuracy and 81.96% F1 score) and verify the effectiveness of SSL strategy for EEG signal analysis in limited labeled data regimes. All codes are provided publicly online.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 16 Sep 2021.

Builds on

20 of 35 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  6. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  7. 2016Colorful Image Colorizationcited by 1,113
  8. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  9. 2019Revisiting Self-Supervised Visual Representation Learningcited by 250
  10. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
  11. 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
  12. 2019U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Stagingcited by 87
8 more
  1. 2019SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approachcited by 54
  2. 2018Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classificationcited by 42
  3. 2020Federated Self-Supervised Learning of Multi-Sensor Representations for Embedded Intelligencecited by 39
  4. 2019Dreem Open Datasets: Multi-Scored Sleep Datasets to compare Human and Automated sleep stagingcited by 33
  5. 2019Self-supervised Learning for ECG-based Emotion Recognitioncited by 32
  6. 2018An Automated System for Epilepsy Detection using EEG Brain Signals based on Deep Learning Approachcited by 16
  7. 2018DOSED: a deep learning approach to detect multiple sleep micro-events in EEG signalcited by 8
  8. 2020RED: Deep Recurrent Neural Networks for Sleep EEG Event Detectioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 4; 2023: 6; 2024: 5; 2025: 9; 2026: 2.

27 papers.

Sort:

By area:

  1. 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 51
  2. 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 41
  3. 2024Self-supervised Learning for Electroencephalogram: A Systematic Surveycited by 19
  4. 2023Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognitioncited by 17
  5. 2023Label-efficient Time Series Representation Learning: A Reviewcited by 16
  6. 2022Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluationcited by 14
  7. 2022SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learningcited by 7
  8. 2024Knowledge-guided EEG Representation Learningcited by 7
  9. 2022Self-supervised Group Meiosis Contrastive Learning for EEG-Based Emotion Recognitioncited by 6
  10. 2024Guidelines for Augmentation Selection in Contrastive Learning for Time Series Classificationcited by 5
  11. 2025The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: a preliminary studycited by 4
  12. 2023A novel dual-stream time-frequency contrastive pretext tasks framework for sleep stage classificationcited by 3
15 more
  1. 2024A Survey of Spatio-Temporal EEG data Analysis: from Models to Applicationscited by 3
  2. 2025TS-OOD: Evaluating Time-Series Out-of-Distribution Detection and Prospective Directions for Progresscited by 3
  3. 2025Deep Learning-Powered Electrical Brain Signals Analysis: Advancing Neurological Diagnosticscited by 3
  4. 2025MVCNet: Multi-View Contrastive Network for Motor Imagery Classificationcited by 3
  5. 2025From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Saptiotemporal Dynamics in Brain Signal Analysiscited by 3
  6. 2023Semi-Supervised End-To-End Contrastive Learning For Time Series Classificationcited by 2
  7. 2023Domain Invariant Representation Learning and Sleep Dynamics Modeling for Automatic Sleep Stagingcited by 1
  8. 2022CropCat: Data Augmentation for Smoothing the Feature Distribution of EEG Signalscited by 0
  9. 2023Contrastive Learning for Sleep Staging based on Inter Subject Correlationcited by 0
  10. 2025MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classificationcited by 0
  11. 2025MCLPD:Multi-view Contrastive Learning for EEG-based PD Detection Across Datasetscited by 0
  12. 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEGcited by 0
  13. 2025Calibration-Free EEG-based Driver Drowsiness Detection with Online Test-Time Adaptationcited by 0
  14. 2026SleepBand: Single-Source Domain Generalization for Sleep Staging via Physiologically Structured Spectral Modelingcited by 0
  15. 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasetscited by 0