mlsanityData to 14 Oct 2026

MIS-LSTM: Multichannel Image-Sequence LSTM for Sleep Quality and Stress Prediction

arXiv 2509.11232 ↗First posted 14 Sep 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents MIS-LSTM, a hybrid framework that joins CNN encoders with an LSTM sequence model for sleep quality and stress prediction at the day level from multimodal lifelog data. Continuous sensor streams are first partitioned into N-hour blocks and rendered as multi-channel images, while sparse discrete events are encoded with a dedicated 1D-CNN. A Convolutional Block Attention Module fuses the two modalities into refined block embeddings, which an LSTM then aggregates to capture long-range temporal dependencies. To further boost robustness, we introduce UALRE, an uncertainty-aware ensemble that overrides lowconfidence majority votes with high-confidence individual predictions. Experiments on the 2025 ETRI Lifelog Challenge dataset show that Our base MISLSTM achieves Macro-F1 0.615; with the UALRE ensemble, the score improves to 0.647, outperforming strong LSTM, 1D-CNN, and CNN baselines. Ablations confirm (i) the superiority of multi-channel over stacked-vertical imaging, (ii) the benefit of a 4-hour block granularity, and (iii) the efficacy of modality-specific discrete encoding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 18 references that are in the map. First posted on arXiv 14 Sep 2025.

Builds on

8 of 18 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  3. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  4. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  5. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
  6. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
  7. 2024TraM : Enhancing User Sleep Prediction with Transformer-based Multivariate Time Series Modeling and Machine Learning Ensemblescited by 3
  8. 2025PixleepFlow: A Pixel-Based Lifelog Framework for Predicting Sleep Quality and Stress Levelcited by 3

Built on by

Not cited yet.