mlsanityData to 7 Oct 2026

SleepLM: Natural-Language Intelligence for Human Sleep

arXiv 2602.23605 ↗First posted 27 Feb 2026cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

We present SleepLM, a family of sleep-language foundation models that enable human sleep alignment, interpretation, and interaction with natural language. Despite the critical role of sleep, learning-based sleep analysis systems operate in closed label spaces (e.g., predefined stages or events) and fail to describe, query, or generalize to novel sleep phenomena. SleepLM bridges natural language and multimodal polysomnography, enabling language-grounded representations of sleep physiology. To support this alignment, we introduce a multilevel sleep caption generation pipeline that enables the curation of the first large-scale sleep-text dataset, comprising over 100K hours of data from more than 10,000 individuals. Furthermore, we present a unified pretraining objective that combines contrastive alignment, caption generation, and signal reconstruction to better capture physiological fidelity and cross-modal interactions. Extensive experiments on real-world sleep understanding tasks verify that SleepLM outperforms state-of-the-art in zero-shot and few-shot learning, cross-modal retrieval, and sleep captioning. Importantly, SleepLM also exhibits intriguing capabilities including language-guided event localization, targeted insight generation, and zero-shot generalization to unseen tasks. All code and data will be open-sourced.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 27 of its 57 references that are in the map. First posted on arXiv 27 Feb 2026.

Builds on

27 of 57 references.

References · 27

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  8. 2016Wide Residual Networkscited by 3,057
  9. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  10. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  11. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  12. 2024Chronos: Learning the Language of Time Seriescited by 712
15 more
  1. 2023A decoder-only foundation model for time-series forecastingcited by 650
  2. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  3. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
  4. 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
  5. 2023Image Captioners Are Scalable Vision Learners Toocited by 89
  6. 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
  7. 2025SensorLM: Learning the Language of Wearable Sensorscited by 44
  8. 2024SleepFM: Multi-modal Representation Learning for Sleep Across Brain Activity, ECG and Respiratory Signalscited by 38
  9. 2025OpenTSLM: Time-Series Language Models for Reasoning over Multivariate Medical Text- and Time-Series Datacited by 30
  10. 2024Towards a Personal Health Large Language Modelcited by 25
  11. 2021RobustSleepNet: Transfer learning for automated sleep staging at scalecited by 24
  12. 2022Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluationcited by 14
  13. 2026HEARTS: Benchmarking LLM Reasoning on Health Time Seriescited by 8
  14. 2024wav2sleep: A Unified Multi-Modal Approach to Sleep Stage Classification from Physiological Signalscited by 5
  15. 2024PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signalscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.