SleepVLM: A Rule-Grounded Vision-Language Model for Auditable Sleep Staging
On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs
Abstract (arXiv)
Sleep staging is essential for sleep assessment and disorder diagnosis. In recent years, automatic sleep staging systems have achieved accuracy approaching that of human experts, but the black-box nature of their predictions hinders clinical adoption. Existing interpretability methods offer partial insight into model behavior, but their outputs still require expert reinterpretation and do not provide a direct basis for auditing individual predictions. To improve trustworthiness, we propose the task of auditable sleep staging. To solve this task, we present SleepVLM, a vision-language model that casts sleep staging as visual reasoning over rendered polysomnography (PSG) waveform images. For each epoch, SleepVLM outputs a stage together with the applicable American Academy of Sleep Medicine (AASM) rules and an auditable rationale. The model is trained using a two-stage framework: Waveform-Perceptual Pre-training followed by Rule-Grounded Supervised Fine-tuning over a mixture of fine-grained and coarse annotations. Experiments on four datasets show that SleepVLM outperforms state-of-the-art methods on average. An automated AASM-feature audit shows broad coverage of stage-defining evidence in the rationales, and independent experts validate their reasoning quality. To facilitate further research, we construct and release MASS-EX, an expert-annotated dataset for rule-grounded sleep staging with AASM rule annotations and expert-written rationales.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 46 references that are in the map. First posted on arXiv 22 Mar 2026.
Builds on
13 of 46 references.
References · 13
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Stagingcited by 91
- 2019U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Stagingcited by 88
- 2023Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMscited by 50
- 2021SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Stagingcited by 32
- 2024Hidden flaws behind expert-level accuracy of multimodal GPT-4 vision in medicinecited by 31
- 2021RobustSleepNet: Transfer learning for automated sleep staging at scalecited by 24
- 2023Generalizable Sleep Staging via Multi-Level Domain Alignmentcited by 17
- 2026SleepLM: Natural-Language Intelligence for Human Sleepcited by 12
- 2025SLEEPYLAND: trust begins with fair evaluation of automatic sleep staging modelscited by 8
- 2022A multi-level interpretable sleep stage scoring system by infusing experts' knowledge into a deep network architecturecited by 4
- 2025EEG-VLM: A Hierarchical Vision-Language Model with Multi-Level Feature Alignment and Visually Enhanced Language-Guided Reasoning for EEG Image-Based Sleep Stage Predictioncited by 3
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Input
- 2025sDREAMER: Self-distilled Mixture-of-Modality-Experts Transformer for Automatic Sleep Staging
- 2023S4Sleep: Elucidating the design space of deep-learning-based sleep stage classification models
- 2025Smarter Together: Combining Large Language Models and Small Models for Physiological Signals Visual Inspection
- 2026LightSleepX: A Lightweight, Inception-Based Dual-Modal Network for Sleep Staging
- 2026Structured Visual Evidence Decomposition for Evidence-Grounded Multimodal Screening of Obstructive Sleep Apnea-Hypopnea Syndrome
- 2024SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillation
- 2022A Knowledge Distillation Framework For Enhancing Ear-EEG Based Sleep Staging With Scalp-EEG Data