Temporal convolutional networks and transformers for classifying the sleep stage in awake or asleep using pulse oximetry signals
Not on the map. Why?
Abstract (arXiv)
Sleep disorders are very widespread in the world population and suffer from a generalized underdiagnosis, given the complexity of their diagnostic methods. Therefore, there is an increasing interest in developing simpler screening methods. A pulse oximeter is an ideal device for sleep disorder screenings since it is a portable, low-cost and accessible technology. This device can provide an estimation of the heart rate (HR), which can be useful to obtain information regarding the sleep stage. In this work, we developed a network architecture with the aim of classifying the sleep stage in awake or asleep using only HR signals from a pulse oximeter. The proposed architecture has two fundamental parts. The first part has the objective of obtaining a representation of the HR by using temporal convolutional networks. Then, the obtained representation is used to feed the second part, which is based on transformers, a model built solely with attention mechanisms. Transformers are able to model the sequence, learning the transition rules between sleep stages. The performance of the proposed method was evaluated on Sleep Heart Health Study dataset, composed of 5000 healthy and pathological subjects. The dataset was split into three subsets: 2500 for training, 1250 for validating, and 1250 for testing. The overall accuracy, specificity, sensibility, and Cohen's Kappa coefficient were 90.0%, 94.9%, 78.1%, and 0.73.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 42 references that are in the map. First posted on arXiv 29 Jan 2021.
Builds on
13 of 42 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Layer Normalizationcited by 5,579
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2016Wider or Deeper: Revisiting the ResNet Model for Visual Recognitioncited by 184
- 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
- 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 90
- 2019SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approachcited by 54
- 2018Sleep-wake classification via quantifying heart rate variability by convolutional neural networkcited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 1; 2024: 1.
3 papers.
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 70
- 2021TEMGNet: Deep Transformer-based Decoding of Upperlimb sEMG for Hand Gestures Recognitioncited by 7
- 2024A Temporal-Spectral Fusion Transformer with Subject-Specific Adapter for Enhancing RSVP-BCI Decodingcited by 3
- 2024A Temporal-Spectral Fusion Transformer with Subject-Specific Adapter for Enhancing RSVP-BCI Decoding12 Jan 2024
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks11 Jun 2023
- 2021TEMGNet: Deep Transformer-based Decoding of Upperlimb sEMG for Hand Gestures Recognition25 Sep 2021