SleepLM: Natural-Language Intelligence for Human Sleep
Not on the map. Why?
Abstract (arXiv)
We present SleepLM, a family of sleep-language foundation models that enable human sleep alignment, interpretation, and interaction with natural language. Despite the critical role of sleep, learning-based sleep analysis systems operate in closed label spaces (e.g., predefined stages or events) and fail to describe, query, or generalize to novel sleep phenomena. SleepLM bridges natural language and multimodal polysomnography, enabling language-grounded representations of sleep physiology. To support this alignment, we introduce a multilevel sleep caption generation pipeline that enables the curation of the first large-scale sleep-text dataset, comprising over 100K hours of data from more than 10,000 individuals. Furthermore, we present a unified pretraining objective that combines contrastive alignment, caption generation, and signal reconstruction to better capture physiological fidelity and cross-modal interactions. Extensive experiments on real-world sleep understanding tasks verify that SleepLM outperforms state-of-the-art in zero-shot and few-shot learning, cross-modal retrieval, and sleep captioning. Importantly, SleepLM also exhibits intriguing capabilities including language-guided event localization, targeted insight generation, and zero-shot generalization to unseen tasks. All code and data will be open-sourced.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 27 of its 57 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
27 of 57 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2016Wide Residual Networkscited by 3,057
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2024Chronos: Learning the Language of Time Seriescited by 712
15 more
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
- 2023Image Captioners Are Scalable Vision Learners Toocited by 89
- 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
- 2025SensorLM: Learning the Language of Wearable Sensorscited by 44
- 2024SleepFM: Multi-modal Representation Learning for Sleep Across Brain Activity, ECG and Respiratory Signalscited by 38
- 2025OpenTSLM: Time-Series Language Models for Reasoning over Multivariate Medical Text- and Time-Series Datacited by 30
- 2024Towards a Personal Health Large Language Modelcited by 25
- 2021RobustSleepNet: Transfer learning for automated sleep staging at scalecited by 24
- 2022Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluationcited by 14
- 2026HEARTS: Benchmarking LLM Reasoning on Health Time Seriescited by 8
- 2024wav2sleep: A Unified Multi-Modal Approach to Sleep Stage Classification from Physiological Signalscited by 5
- 2024PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signalscited by 4
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoringcited by 4
- 2026TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Healthcited by 2
- 2026WEQA: Wearable hEalth Question Answering with Query-Adaptive Agentic Reasoningcited by 2
- 2026Inertia-1: An Open Exploration of Wearable Motion Foundation Modelscited by 1
- 2026SleepVLM: A Rule-Grounded Vision-Language Model for Auditable Sleep Stagingcited by 0
- 2026Test-Time Adaptation for EEG Foundation Models: A Systematic Study under Real-World Distribution Shiftscited by 0
- 2026Signal or Noise? Understanding Generative Models for Real-World Sensor Time Seriescited by 0
- 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understandingcited by 0
- 2026PPG-LM: A Photoplethysmography-Language Model with Multi-Level Clinical Alignmentcited by 0
- 2026SemPSG: A Semantic Channel-Aware Foundation Model for Polysomnography Analysiscited by 0
- 2026SemPSG: A Semantic Channel-Aware Foundation Model for Polysomnography Analysis29 Sep 2026
- 2026PPG-LM: A Photoplethysmography-Language Model with Multi-Level Clinical Alignment27 Sep 2026
- 2026BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understanding4 Aug 2026
- 2026Inertia-1: An Open Exploration of Wearable Motion Foundation Models7 Jul 2026
- 2026Signal or Noise? Understanding Generative Models for Real-World Sensor Time Series5 Jul 2026
- 2026WEQA: Wearable hEalth Question Answering with Query-Adaptive Agentic Reasoning16 Jun 2026
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoring29 May 2026
- 2026TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Health20 May 2026
- 2026Test-Time Adaptation for EEG Foundation Models: A Systematic Study under Real-World Distribution Shifts18 Apr 2026
- 2026SleepVLM: A Rule-Grounded Vision-Language Model for Auditable Sleep Staging22 Mar 2026