L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Staging
Not on the map. Why?
Abstract (arXiv)
Human sleep is cyclical with a period of approximately 90 minutes, implying long temporal dependency in the sleep data. Yet, exploring this long-term dependency when developing sleep staging models has remained untouched. In this work, we show that while encoding the logic of a whole sleep cycle is crucial to improve sleep staging performance, the sequential modelling approach in existing state-of-the-art deep learning models are inefficient for that purpose. We thus introduce a method for efficient long sequence modelling and propose a new deep learning model, L-SeqSleepNet, which takes into account whole-cycle sleep information for sleep staging. Evaluating L-SeqSleepNet on four distinct databases of various sizes, we demonstrate state-of-the-art performance obtained by the model over three different EEG setups, including scalp EEG in conventional Polysomnography (PSG), in-ear EEG, and around-the-ear EEG (cEEGrid), even with a single EEG channel input. Our analyses also show that L-SeqSleepNet is able to alleviate the predominance of N2 sleep (the major class in terms of classification) to bring down errors in other sleep stages. Moreover the network becomes much more robust, meaning that for all subjects where the baseline method had exceptionally poor performance, their performance are improved significantly. Finally, the computation time only grows at a sub-linear rate when the sequence length increases.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 21 of its 56 references that are in the map. First posted on arXiv 9 Jan 2023.
Builds on
21 of 56 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Layer Normalizationcited by 5,579
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2020What is being transferred in transfer learning?cited by 365
- 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 154
- 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 90
- 2020XSleepNet: Multi-View Sequential Model for Automatic Sleep Stagingcited by 87
- 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 83
- 2019SleepEEGNet: Automated Sleep Stage Scoring with Sequence to Sequence Deep Learning Approachcited by 54
- 2021Automatic Sleep Staging of EEG Signals: Recent Development, Challenges, and Future Directionscited by 41
- 2016Recurrent Batch Normalizationcited by 35
9 more
- 2019Dreem Open Datasets: Multi-Scored Sleep Datasets to compare Human and Automated sleep stagingcited by 33
- 2019Towards More Accurate Automatic Sleep Staging via Deep Transfer Learningcited by 31
- 2021SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Stagingcited by 31
- 2021DeepSleepNet-Lite: A Simplified Automatic Sleep Stage Scoring Model with Uncertainty Estimatescited by 26
- 2021RobustSleepNet: Transfer learning for automated sleep staging at scalecited by 24
- 2016Mixed Neural Network Approach for Temporal Sleep Stage Classificationcited by 23
- 2020Automatic sleep stage classification with deep residual networks in a mixed-cohort settingcited by 15
- 2022TransSleep: Transitioning-aware Attention-based Deep Neural Network for Sleep Stagingcited by 8
- 2021Feature matching as improved transfer learning technique for wearable EEGcited by 1
Built on by
Citing papers per year: 2023: 4; 2024: 5; 2025: 4; 2026: 8.
21 papers.
Sort:
By area:
- 2024Self-supervised Learning for Electroencephalogram: A Systematic Surveycited by 19
- 2024Brant-X: A Unified Physiological Signal Alignment Frameworkcited by 16
- 2023CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalitiescited by 10
- 2023S4Sleep: Elucidating the design space of deep-learning-based sleep stage classification modelscited by 7
- 2025SLEEPYLAND: trust begins with fair evaluation of automatic sleep staging modelscited by 7
- 2023Structure-Preserving Transformers for Sequences of SPD Matricescited by 4
- 2026sleep2vec: Unified Cross-Modal Alignment for Heterogeneous Nocturnal Biosignalscited by 3
- 2023SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced Classification of Sleep Stagescited by 2
- 2024Assessing the importance of long-range correlations for deep-learning-based sleep stagingcited by 2
- 2024Evaluating the Influence of Temporal Context on Automatic Mouse Sleep Staging through the Application of Human Modelscited by 2
- 2026Demographic-Aware Transfer Learning for Sleep Stage Classification in Clinical Polysomnographycited by 2
- 2025PSDNorm: Test-Time Temporal Normalization for Deep Learning in Sleep Stagingcited by 1
9 more
- 2026Rethinking Random Transformers as Adaptive Sequence Smoothers for Sleep Stagingcited by 1
- 2024Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networkscited by 0
- 2025MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classificationcited by 0
- 2025NAPS: Attention-Based Fusion of Heterogeneous Physiological Signalscited by 0
- 2026Fully-automated sleep staging: multicenter validation of a generalizable deep neural network for Parkinson's disease and isolated REM sleep behavior disordercited by 0
- 2026Staging by the Book: Automatic Sleep Stage Classification Using Scoring Rulescited by 0
- 2026Efficient Temporal Modeling for Mobile Sleep Staging via Lightweight Random Attentioncited by 0
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasetscited by 0
- 2026Rethinking PPG-based Sleep Staging: Datasets, Metrics, and Benchmarkscited by 0
- 2026Rethinking PPG-based Sleep Staging: Datasets, Metrics, and Benchmarks2 Aug 2026
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasets6 Jul 2026
- 2026Efficient Temporal Modeling for Mobile Sleep Staging via Lightweight Random Attention31 May 2026
- 2026Staging by the Book: Automatic Sleep Stage Classification Using Scoring Rules19 May 2026
- 2026Rethinking Random Transformers as Adaptive Sequence Smoothers for Sleep Staging11 May 2026
- 2026Demographic-Aware Transfer Learning for Sleep Stage Classification in Clinical Polysomnography4 May 2026
- 2026sleep2vec: Unified Cross-Modal Alignment for Heterogeneous Nocturnal Biosignals14 Feb 2026
- 2026Fully-automated sleep staging: multicenter validation of a generalizable deep neural network for Parkinson's disease and isolated REM sleep behavior disorder10 Feb 2026
- 2025NAPS: Attention-Based Fusion of Heterogeneous Physiological Signals5 Nov 2025
- 2025SLEEPYLAND: trust begins with fair evaluation of automatic sleep staging models10 Jun 2025
- 2025PSDNorm: Test-Time Temporal Normalization for Deep Learning in Sleep Staging6 Mar 2025
- 2025MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classification13 Feb 2025
9 more
- 2024Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networks18 Oct 2024
- 2024Brant-X: A Unified Physiological Signal Alignment Framework28 Aug 2024
- 2024Evaluating the Influence of Temporal Context on Automatic Mouse Sleep Staging through the Application of Human Models6 Jun 2024
- 2024Assessing the importance of long-range correlations for deep-learning-based sleep staging22 Feb 2024
- 2024Self-supervised Learning for Electroencephalogram: A Systematic Survey9 Jan 2024
- 2023S4Sleep: Elucidating the design space of deep-learning-based sleep stage classification models10 Oct 2023
- 2023Structure-Preserving Transformers for Sequences of SPD Matrices14 Sep 2023
- 2023SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced Classification of Sleep Stages4 Jul 2023
- 2023CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalities27 Mar 2023
- 2024Self-supervised Learning for Electroencephalogram: A Systematic Surveycited by 19
- 2024Brant-X: A Unified Physiological Signal Alignment Frameworkcited by 16
- 2023CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalitiescited by 10
- 2023S4Sleep: Elucidating the design space of deep-learning-based sleep stage classification modelscited by 7
- 2025SLEEPYLAND: trust begins with fair evaluation of automatic sleep staging modelscited by 7
- 2023Structure-Preserving Transformers for Sequences of SPD Matricescited by 4
- 2026sleep2vec: Unified Cross-Modal Alignment for Heterogeneous Nocturnal Biosignalscited by 3
- 2023SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced Classification of Sleep Stagescited by 2
- 2024Assessing the importance of long-range correlations for deep-learning-based sleep stagingcited by 2
- 2024Evaluating the Influence of Temporal Context on Automatic Mouse Sleep Staging through the Application of Human Modelscited by 2
- 2026Demographic-Aware Transfer Learning for Sleep Stage Classification in Clinical Polysomnographycited by 2
- 2025PSDNorm: Test-Time Temporal Normalization for Deep Learning in Sleep Stagingcited by 1
12 most cited of 20 All 20 (JSON)
- 2026Rethinking PPG-based Sleep Staging: Datasets, Metrics, and Benchmarks2 Aug 2026
- 2026Efficient Temporal Modeling for Mobile Sleep Staging via Lightweight Random Attention31 May 2026
- 2026Staging by the Book: Automatic Sleep Stage Classification Using Scoring Rules19 May 2026
- 2026Rethinking Random Transformers as Adaptive Sequence Smoothers for Sleep Staging11 May 2026
- 2026Demographic-Aware Transfer Learning for Sleep Stage Classification in Clinical Polysomnography4 May 2026
- 2026sleep2vec: Unified Cross-Modal Alignment for Heterogeneous Nocturnal Biosignals14 Feb 2026
- 2026Fully-automated sleep staging: multicenter validation of a generalizable deep neural network for Parkinson's disease and isolated REM sleep behavior disorder10 Feb 2026
- 2025NAPS: Attention-Based Fusion of Heterogeneous Physiological Signals5 Nov 2025
- 2025SLEEPYLAND: trust begins with fair evaluation of automatic sleep staging models10 Jun 2025
- 2025PSDNorm: Test-Time Temporal Normalization for Deep Learning in Sleep Staging6 Mar 2025
- 2025MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classification13 Feb 2025
- 2024Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networks18 Oct 2024
12 newest of 20 All 20 (JSON)