Toward Foundational Model for Sleep Analysis Using a Multimodal Hybrid Self-Supervised Learning Framework
Not on the map. Why?
Abstract (arXiv)
Sleep is essential for maintaining human health and quality of life. Analyzing physiological signals during sleep is critical in assessing sleep quality and diagnosing sleep disorders. However, manual diagnoses by clinicians are time-intensive and subjective. Despite advances in deep learning that have enhanced automation, these approaches remain heavily dependent on large-scale labeled datasets. This study introduces SynthSleepNet, a multimodal hybrid self-supervised learning framework designed for analyzing polysomnography (PSG) data. SynthSleepNet effectively integrates masked prediction and contrastive learning to leverage complementary features across multiple modalities, including electroencephalogram (EEG), electrooculography (EOG), electromyography (EMG), and electrocardiogram (ECG). This approach enables the model to learn highly expressive representations of PSG data. Furthermore, a temporal context module based on Mamba was developed to efficiently capture contextual information across signals. SynthSleepNet achieved superior performance compared to state-of-the-art methods across three downstream tasks: sleep-stage classification, apnea detection, and hypopnea detection, with accuracies of 89.89%, 99.75%, and 89.60%, respectively. The model demonstrated robust performance in a semi-supervised learning environment with limited labels, achieving accuracies of 87.98%, 99.37%, and 77.52% in the same tasks. These results underscore the potential of the model as a foundational tool for the comprehensive analysis of PSG data. SynthSleepNet demonstrates comprehensively superior performance across multiple downstream tasks compared to other methodologies, making it expected to set a new standard for sleep disorder monitoring and diagnostic systems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 18 of its 48 references that are in the map. First posted on arXiv 18 Feb 2025.
Builds on
18 of 48 references.
References · 18
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2022MultiMAE: Multi-modal Multi-task Masked Autoencoderscited by 287
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
- 2022On The Computational Complexity of Self-Attentioncited by 137
- 2020XSleepNet: Multi-View Sequential Model for Automatic Sleep Stagingcited by 87
- 2024SleepFM: Multi-modal Representation Learning for Sleep Across Brain Activity, ECG and Respiratory Signalscited by 38
- 2021SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Stagingcited by 31
6 more
- 2022A simple, efficient and scalable contrastive masked autoencoder for learning visual representationscited by 25
- 2023CroSSL: Cross-modal Self-Supervised Learning for Time-series through Latent Maskingcited by 18
- 2024Brant-X: A Unified Physiological Signal Alignment Frameworkcited by 16
- 2022mulEEG: A Multi-View Representation Learning on EEG Signalscited by 11
- 2022TransSleep: Transitioning-aware Attention-based Deep Neural Network for Sleep Stagingcited by 8
- 2024NeuroNet: A Novel Hybrid Self-Supervised Learning Framework for Sleep Stage Classification Using Single-Channel EEGcited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signalcited by 5
- 2025PhysioME: A Robust Multimodal Self-Supervised Framework for Physiological Signals with Missing Modalitiescited by 1
- 2026Pretraining on Sleep Data Improves non-Sleep Biosignal Taskscited by 1
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Modelscited by 0
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Models28 Sep 2026
- 2026Pretraining on Sleep Data Improves non-Sleep Biosignal Tasks4 May 2026
- 2026Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signal12 Feb 2026
- 2025PhysioME: A Robust Multimodal Self-Supervised Framework for Physiological Signals with Missing Modalities13 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026LightSleepX: A Lightweight, Inception-Based Dual-Modal Network for Sleep Staging
- 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Input
- 2025Sleep Apnea Detection on a Wireless Multimodal Wearable Device Without Oxygen Flow Using a Mamba-based Deep Learning Approach
- 2024Mamba-based Deep Learning Approach for Sleep Staging on a Wireless Multimodal Wearable System without Electroencephalography
- 2023S4Sleep: Elucidating the design space of deep-learning-based sleep stage classification models
- 2026Agentic AI-enabled discovery across large-scale sleep physiology ↗
- 2025Smarter Together: Combining Large Language Models and Small Models for Physiological Signals Visual Inspection
- 2026Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasets