SleepPriorCL: Contrastive Representation Learning with Prior Knowledge-based Positive Mining and Adaptive Temperature for Sleep Staging
Not on the map. Why?
Abstract (arXiv)
The objective of this paper is to learn semantic representations for sleep stage classification from raw physiological time series. Although supervised methods have gained remarkable performance, they are limited in clinical situations due to the requirement of fully labeled data. Self-supervised learning (SSL) based on contrasting semantically similar (positive) and dissimilar (negative) pairs of samples have achieved promising success. However, existing SSL methods suffer the problem that many semantically similar positives are still uncovered and even treated as negatives. In this paper, we propose a novel SSL approach named SleepPriorCL to alleviate the above problem. Advances of our approach over existing SSL methods are two-fold: 1) by incorporating prior domain knowledge into the training regime of SSL, more semantically similar positives are discovered without accessing ground-truth labels; 2) via investigating the influence of the temperature in contrastive loss, an adaptive temperature mechanism for each sample according to prior domain knowledge is further proposed, leading to better performance. Extensive experiments demonstrate that our method achieves state-of-the-art performance and consistently outperforms baselines.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 15 Oct 2021.
Builds on
15 of 33 references.
References · 15
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020Supervised Contrastive Learningcited by 2,829
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
- 2020Debiased Contrastive Learningcited by 356
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 269
- 2020Self-supervised Co-training for Video Representation Learningcited by 232
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 224
- 2020Boosting Contrastive Self-Supervised Learning with False Negative Cancellationcited by 119
- 2020Uncovering the structure of clinical EEG signals with self-supervised learningcited by 109
3 more
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 2.
6 papers.
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 99
- 2023A Survey on Time-Series Pre-Trained Modelscited by 52
- 2023REBAR: Retrieval-Based Reconstruction for Time-series Contrastive Learningcited by 21
- 2022Utilizing Expert Features for Contrastive Learning of Time-Series Representationscited by 17
- 2024A Survey of Spatio-Temporal EEG data Analysis: from Models to Applicationscited by 3
- 2024Distillation Enhanced Time Series Forecasting Network with Momentum Contrastive Learningcited by 2
- 2024A Survey of Spatio-Temporal EEG data Analysis: from Models to Applications26 Sep 2024
- 2024Distillation Enhanced Time Series Forecasting Network with Momentum Contrastive Learning31 Jan 2024
- 2023REBAR: Retrieval-Based Reconstruction for Time-series Contrastive Learning1 Nov 2023
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects16 Jun 2023
- 2023A Survey on Time-Series Pre-Trained Models18 May 2023
- 2022Utilizing Expert Features for Contrastive Learning of Time-Series Representations23 Jun 2022