mlsanityData to 7 Oct 2026

Assessing the importance of long-range correlations for deep-learning-based sleep staging

arXiv 2402.17779 ↗First posted 22 Feb 2024eess.SP cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

This study aims to elucidate the significance of long-range correlations for deep-learning-based sleep staging. It is centered around S4Sleep(TS), a recently proposed model for automated sleep staging. This model utilizes electroencephalography (EEG) as raw time series input and relies on structured state space sequence (S4) models as essential model component. Although the model already surpasses state-of-the-art methods for a moderate number of 15 input epochs, recent literature results suggest potential benefits from incorporating very long correlations spanning hundreds of input epochs. In this submission, we explore the possibility of achieving further enhancements by systematically scaling up the model's input size, anticipating potential improvements in prediction accuracy. In contrast to findings in literature, our results demonstrate that augmenting the input size does not yield a significant enhancement in the performance of S4Sleep(TS). These findings, coupled with the distinctive ability of S4 models to capture long-range dependencies in time series data, cast doubt on the diagnostic relevance of very long-range interactions for sleep staging.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 8 of its 16 references that are in the map. First posted on arXiv 22 Feb 2024.

Builds on

8 of 16 references.

References · 8

  1. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  2. 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 696
  3. 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 187
  4. 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 90
  5. 2020XSleepNet: Multi-View Sequential Model for Automatic Sleep Stagingcited by 87
  6. 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 83
  7. 2023L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Stagingcited by 21
  8. 2023S4Sleep: Elucidating the design space of deep-learning-based sleep stage classification modelscited by 7

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Input
  2. 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasets
  3. 2026LightSleepX: A Lightweight, Inception-Based Dual-Modal Network for Sleep Staging
  4. 2024BiT-MamSleep: Bidirectional Temporal Mamba for EEG Sleep Staging
  5. 2024NeuroNet: A Novel Hybrid Self-Supervised Learning Framework for Sleep Stage Classification Using Single-Channel EEG
  6. 2023ZzzGPT: An Interactive GPT Approach to Enhance Sleep Quality
  7. 2025EEG-VLM: A Hierarchical Vision-Language Model with Multi-Level Feature Alignment and Visually Enhanced Language-Guided Reasoning for EEG Image-Based Sleep Stage Prediction
  8. 2026SleepVLM: A Rule-Grounded Vision-Language Model for Auditable Sleep Staging