mlsanityData to 14 Oct 2026

Subject-Relative Micro-Motion and Sleep Dynamics for Near-Infrared Video Sleep Staging

arXiv 2609.05550 ↗First posted 3 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Near-infrared (NIR) video is a promising modality for contactless sleep monitoring, but recent video-based sleep staging methods often use it as a route to reconstructed respiratory/cardiac proxies or cross-modal physiological representations. We study video-only sleep staging under labels defined by polysomnography (PSG), where the model infers sleep stages from NIR video alone without explicit physiological proxy reconstruction or auxiliary physiological signal supervision. This tests whether NIR video itself can provide informative sleep-stage evidence, rather than only serving as an input for recovering physiological proxies. We propose ViNUSS (Video-Native Unmediated Sleep Staging), a framework that combines subject-relative micro-motion learning with full-night sleep dynamics modeling. Spatially anchored pre-spatial micro-motion encoding preserves localized temporal variation together with its spatial context. Within-subject stage contrast learns stage cues with respect to each subject's night-specific baseline. Two-scale sleep dynamics modeling captures within-epoch motion evolution and organizes epoch-level evidence into a coherent full-night sleep-stage trajectory. On 475 overnight NIR recordings (~3,250 hours), ViNUSS achieves 0.80 accuracy and 0.78 macro-F1 for four-class sleep staging. Interpretability analysis suggests attention to thoraco-abdominal periodic motion and gross body movements associated with arousals and position changes. These results support NIR video as an independently informative and complementary modality for PSG-defined sleep-stage estimation

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 47 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

22 of 47 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  5. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  6. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  7. 2021Video Swin Transformercited by 1,091
  8. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
  9. 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 786
  10. 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
  11. 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 189
  12. 2020TDN: Temporal Difference Networks for Efficient Action Recognitioncited by 183
10 more
  1. 2020TEA: Temporal Excitation and Aggregation for Action Recognitioncited by 165
  2. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 157
  3. 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
  4. 2020XSleepNet: Multi-View Sequential Model for Automatic Sleep Stagingcited by 88
  5. 2021SleepTransformer: Automatic Sleep Staging with Interpretability and Uncertainty Quantificationcited by 84
  6. 2016Fast Optical Flow using Dense Inverse Searchcited by 71
  7. 2021Camera Measurement of Physiological Vital Signscited by 49
  8. 2021Algorithmic Principles of Camera-based Respiratory Motion Extractioncited by 6
  9. 2023Privacy-Preserving Remote Heart Rate Estimation from Facial Videoscited by 4
  10. 2024SleepVST: Sleep Staging from Near-Infrared Video Signals using Pre-Trained Transformerscited by 4

Built on by

Not cited yet.