mlsanityData to 14 Oct 2026

Wearable data from subjects playing Super Mario, sitting university exams, or performing physical exercise help detect acute mood episodes via self-supervised learning

arXiv 2311.04215 ↗First posted 7 Nov 2023cs.LG cs.AI eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

Personal sensing, leveraging data passively and near-continuously collected with wearables from patients in their ecological environment, is a promising paradigm to monitor mood disorders (MDs), a major determinant of worldwide disease burden. However, collecting and annotating wearable data is very resource-intensive. Studies of this kind can thus typically afford to recruit only a couple dozens of patients. This constitutes one of the major obstacles to applying modern supervised machine learning techniques to MDs detection. In this paper, we overcome this data bottleneck and advance the detection of MDs acute episode vs stable state from wearables data on the back of recent advances in self-supervised learning (SSL). This leverages unlabelled data to learn representations during pre-training, subsequently exploited for a supervised task. First, we collected open-access datasets recording with an Empatica E4 spanning different, unrelated to MD monitoring, personal sensing tasks -- from emotion recognition in Super Mario players to stress detection in undergraduates -- and devised a pre-processing pipeline performing on-/off-body detection, sleep-wake detection, segmentation, and (optionally) feature extraction. With 161 E4-recorded subjects, we introduce E4SelfLearning, the largest to date open access collection, and its pre-processing pipeline. Second, we show that SSL confidently outperforms fully-supervised pipelines using either our novel E4-tailored Transformer architecture (E4mer) or classical baseline XGBoost: 81.23% against 75.35% (E4mer) and 72.02% (XGBoost) correctly classified recording segments from 64 (half acute, half stable) patients. Lastly, we illustrate that SSL performance is strongly associated with the specific surrogate task employed for pre-training as well as with unlabelled data availability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 78 references that are in the map. First posted on arXiv 7 Nov 2023.

Builds on

19 of 78 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  6. 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 699
  7. 2018Deep learning for time series classification: a reviewcited by 576
  8. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
  9. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
  10. 2021Are Large-scale Datasets Necessary for Self-Supervised Pre-training?cited by 117
  11. 2016Multi-Scale Convolutional Neural Networks for Time Series Classificationcited by 99
  12. 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 99
7 more
  1. 2020Subject-Aware Contrastive Learning for Biosignalscited by 76
  2. 2023Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognitioncited by 17
  3. 2021A multimodal sensor dataset for continuous stress detection of nurses in a hospitalcited by 14
  4. 2021Understanding occupants' behaviour, engagement, emotion, and comfort indoors with heterogeneous sensors and wearablescited by 4
  5. 2022ADARP: A Multi Modal Dataset for Stress and Alcohol Relapse Quantification in Real Life Settingcited by 4
  6. 2021Long-Short Ensemble Network for Bipolar Manic-Euthymic State Recognition Based on Wrist-worn Sensorscited by 1
  7. 2022The Lean Data Scientist: Recent Advances towards Overcoming the Data Bottleneckcited by 1

Built on by

Not cited yet.