Self-supervised Contrastive Learning for EEG-based Sleep Staging
Not on the map. Why?
Abstract (arXiv)
EEG signals are usually simple to obtain but expensive to label. Although supervised learning has been widely used in the field of EEG signal analysis, its generalization performance is limited by the amount of annotated data. Self-supervised learning (SSL), as a popular learning paradigm in computer vision (CV) and natural language processing (NLP), can employ unlabeled data to make up for the data shortage of supervised learning. In this paper, we propose a self-supervised contrastive learning method of EEG signals for sleep stage classification. During the training process, we set up a pretext task for the network in order to match the right transformation pairs generated from EEG signals. In this way, the network improves the representation ability by learning the general features of EEG signals. The robustness of the network also gets improved in dealing with diverse data, that is, extracting constant features from changing data. In detail, the network's performance depends on the choice of transformations and the amount of unlabeled data used in the training process of self-supervised learning. Empirical evaluations on the Sleep-edf dataset demonstrate the competitive performance of our method on sleep staging (88.16% accuracy and 81.96% F1 score) and verify the effectiveness of SSL strategy for EEG signal analysis in limited labeled data regimes. All codes are provided publicly online.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 16 Sep 2021.
Builds on
20 of 35 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Colorful Image Colorizationcited by 1,113
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2019Revisiting Self-Supervised Visual Representation Learningcited by 250
- 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
- 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
- 2019U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Stagingcited by 87
8 more
- 2019SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approachcited by 54
- 2018Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classificationcited by 42
- 2020Federated Self-Supervised Learning of Multi-Sensor Representations for Embedded Intelligencecited by 39
- 2019Dreem Open Datasets: Multi-Scored Sleep Datasets to compare Human and Automated sleep stagingcited by 33
- 2019Self-supervised Learning for ECG-based Emotion Recognitioncited by 32
- 2018An Automated System for Epilepsy Detection using EEG Brain Signals based on Deep Learning Approachcited by 16
- 2018DOSED: a deep learning approach to detect multiple sleep micro-events in EEG signalcited by 8
- 2020RED: Deep Recurrent Neural Networks for Sleep EEG Event Detectioncited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 6; 2024: 5; 2025: 9; 2026: 2.
27 papers.
Sort:
By area:
- 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 51
- 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 41
- 2024Self-supervised Learning for Electroencephalogram: A Systematic Surveycited by 19
- 2023Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognitioncited by 17
- 2023Label-efficient Time Series Representation Learning: A Reviewcited by 16
- 2022Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluationcited by 14
- 2022SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learningcited by 7
- 2024Knowledge-guided EEG Representation Learningcited by 7
- 2022Self-supervised Group Meiosis Contrastive Learning for EEG-Based Emotion Recognitioncited by 6
- 2024Guidelines for Augmentation Selection in Contrastive Learning for Time Series Classificationcited by 5
- 2025The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: a preliminary studycited by 4
- 2023A novel dual-stream time-frequency contrastive pretext tasks framework for sleep stage classificationcited by 3
15 more
- 2024A Survey of Spatio-Temporal EEG data Analysis: from Models to Applicationscited by 3
- 2025TS-OOD: Evaluating Time-Series Out-of-Distribution Detection and Prospective Directions for Progresscited by 3
- 2025Deep Learning-Powered Electrical Brain Signals Analysis: Advancing Neurological Diagnosticscited by 3
- 2025MVCNet: Multi-View Contrastive Network for Motor Imagery Classificationcited by 3
- 2025From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Saptiotemporal Dynamics in Brain Signal Analysiscited by 3
- 2023Semi-Supervised End-To-End Contrastive Learning For Time Series Classificationcited by 2
- 2023Domain Invariant Representation Learning and Sleep Dynamics Modeling for Automatic Sleep Stagingcited by 1
- 2022CropCat: Data Augmentation for Smoothing the Feature Distribution of EEG Signalscited by 0
- 2023Contrastive Learning for Sleep Staging based on Inter Subject Correlationcited by 0
- 2025MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classificationcited by 0
- 2025MCLPD:Multi-view Contrastive Learning for EEG-based PD Detection Across Datasetscited by 0
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEGcited by 0
- 2025Calibration-Free EEG-based Driver Drowsiness Detection with Online Test-Time Adaptationcited by 0
- 2026SleepBand: Single-Source Domain Generalization for Sleep Staging via Physiologically Structured Spectral Modelingcited by 0
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasetscited by 0
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasets6 Jul 2026
- 2026SleepBand: Single-Source Domain Generalization for Sleep Staging via Physiologically Structured Spectral Modeling6 Jul 2026
- 2025Calibration-Free EEG-based Driver Drowsiness Detection with Online Test-Time Adaptation27 Nov 2025
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEG9 Oct 2025
- 2025MCLPD:Multi-view Contrastive Learning for EEG-based PD Detection Across Datasets12 Aug 2025
- 2025From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Saptiotemporal Dynamics in Brain Signal Analysis4 Jul 2025
- 2025The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: a preliminary study19 May 2025
- 2025Deep Learning-Powered Electrical Brain Signals Analysis: Advancing Neurological Diagnostics24 Feb 2025
- 2025TS-OOD: Evaluating Time-Series Out-of-Distribution Detection and Prospective Directions for Progress21 Feb 2025
- 2025MVCNet: Multi-View Contrastive Network for Motor Imagery Classification18 Feb 2025
- 2025MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classification13 Feb 2025
- 2024A Survey of Spatio-Temporal EEG data Analysis: from Models to Applications26 Sep 2024
15 more
- 2024Guidelines for Augmentation Selection in Contrastive Learning for Time Series Classification12 Jul 2024
- 2024Knowledge-guided EEG Representation Learning15 Feb 2024
- 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Model11 Jan 2024
- 2024Self-supervised Learning for Electroencephalogram: A Systematic Survey9 Jan 2024
- 2023A novel dual-stream time-frequency contrastive pretext tasks framework for sleep stage classification15 Dec 2023
- 2023Domain Invariant Representation Learning and Sleep Dynamics Modeling for Automatic Sleep Staging6 Dec 2023
- 2023Semi-Supervised End-To-End Contrastive Learning For Time Series Classification13 Oct 2023
- 2023Contrastive Learning for Sleep Staging based on Inter Subject Correlation5 May 2023
- 2023Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognition29 Mar 2023
- 2023Label-efficient Time Series Representation Learning: A Review13 Feb 2023
- 2022CropCat: Data Augmentation for Smoothing the Feature Distribution of EEG Signals13 Dec 2022
- 2022Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluation10 Oct 2022
- 2022SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learning20 Sep 2022
- 2022Self-supervised Group Meiosis Contrastive Learning for EEG-Based Emotion Recognition12 Jul 2022
- 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directions3 Nov 2021
- 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 51
- 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 41
- 2024Self-supervised Learning for Electroencephalogram: A Systematic Surveycited by 19
- 2023Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognitioncited by 17
- 2023Label-efficient Time Series Representation Learning: A Reviewcited by 16
- 2022Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluationcited by 14
- 2022SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learningcited by 7
- 2024Knowledge-guided EEG Representation Learningcited by 7
- 2022Self-supervised Group Meiosis Contrastive Learning for EEG-Based Emotion Recognitioncited by 6
- 2024Guidelines for Augmentation Selection in Contrastive Learning for Time Series Classificationcited by 5
- 2025The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: a preliminary studycited by 4
- 2023A novel dual-stream time-frequency contrastive pretext tasks framework for sleep stage classificationcited by 3
12 most cited of 26 All 26 (JSON)
- 2026SleepBand: Single-Source Domain Generalization for Sleep Staging via Physiologically Structured Spectral Modeling6 Jul 2026
- 2025Calibration-Free EEG-based Driver Drowsiness Detection with Online Test-Time Adaptation27 Nov 2025
- 2025A Systematic Evaluation of Self-Supervised Learning for Label-Efficient Sleep Staging with Wearable EEG9 Oct 2025
- 2025MCLPD:Multi-view Contrastive Learning for EEG-based PD Detection Across Datasets12 Aug 2025
- 2025From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Saptiotemporal Dynamics in Brain Signal Analysis4 Jul 2025
- 2025The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: a preliminary study19 May 2025
- 2025Deep Learning-Powered Electrical Brain Signals Analysis: Advancing Neurological Diagnostics24 Feb 2025
- 2025TS-OOD: Evaluating Time-Series Out-of-Distribution Detection and Prospective Directions for Progress21 Feb 2025
- 2025MVCNet: Multi-View Contrastive Network for Motor Imagery Classification18 Feb 2025
- 2025MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classification13 Feb 2025
- 2024A Survey of Spatio-Temporal EEG data Analysis: from Models to Applications26 Sep 2024
- 2024Guidelines for Augmentation Selection in Contrastive Learning for Time Series Classification12 Jul 2024
12 newest of 26 All 26 (JSON)