mlsanityData to 7 Oct 2026

Temporal convolutional networks and transformers for classifying the sleep stage in awake or asleep using pulse oximetry signals

arXiv 2102.03352 ↗First posted 29 Jan 2021eess.SP cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Sleep disorders are very widespread in the world population and suffer from a generalized underdiagnosis, given the complexity of their diagnostic methods. Therefore, there is an increasing interest in developing simpler screening methods. A pulse oximeter is an ideal device for sleep disorder screenings since it is a portable, low-cost and accessible technology. This device can provide an estimation of the heart rate (HR), which can be useful to obtain information regarding the sleep stage. In this work, we developed a network architecture with the aim of classifying the sleep stage in awake or asleep using only HR signals from a pulse oximeter. The proposed architecture has two fundamental parts. The first part has the objective of obtaining a representation of the HR by using temporal convolutional networks. Then, the obtained representation is used to feed the second part, which is based on transformers, a model built solely with attention mechanisms. Transformers are able to model the sequence, learning the transition rules between sleep stages. The performance of the proposed method was evaluated on Sleep Heart Health Study dataset, composed of 5000 healthy and pathological subjects. The dataset was split into three subsets: 2500 for training, 1250 for validating, and 1250 for testing. The overall accuracy, specificity, sensibility, and Cohen's Kappa coefficient were 90.0%, 94.9%, 78.1%, and 0.73.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 42 references that are in the map. First posted on arXiv 29 Jan 2021.

Builds on

13 of 42 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2016Layer Normalizationcited by 5,579
  6. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  7. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  8. 2016Wider or Deeper: Revisiting the ResNet Model for Visual Recognitioncited by 184
  9. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
  10. 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 90
  11. 2019SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approachcited by 54
  12. 2018Sleep-wake classification via quantifying heart rate variability by convolutional neural networkcited by 2
1 more
  1. 2020Classifying sleep-wake stages through recurrent neural networks using pulse oximetry signalscited by 1

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 0; 2023: 1; 2024: 1.

3 papers.