mlsanityData to 7 Oct 2026

Self-supervision of wearable sensors time-series data for influenza detection

arXiv 2112.13755 ↗First posted 27 Dec 2021cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Self-supervision may boost model performance in downstream tasks. However, there is no principled way of selecting the self-supervised objectives that yield the most adaptable models. Here, we study this problem on daily time-series data generated from wearable sensors used to detect onset of influenza-like illness (ILI). We first show that using self-supervised learning to predict next-day time-series values allows us to learn rich representations which can be adapted to perform accurate ILI prediction. Second, we perform an empirical analysis of three different self-supervised objectives to assess their adaptability to ILI prediction. Our results show that predicting the next day's resting heart rate or time-in-bed during sleep provides better representations for ILI prediction. These findings add to previous work demonstrating the practical application of self-supervised learning from activity data to improve health predictions.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 14 references that are in the map. First posted on arXiv 27 Dec 2021.

Builds on

13 of 14 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  7. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  8. 2020On Layer Normalization in the Transformer Architecturecited by 906
  9. 2019Why gradient clipping accelerates training: A theoretical justification for adaptivitycited by 335
  10. 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
  11. 2020GENNI: Visualising the Geometry of Equivalences for Neural Network Identifiabilitycited by 6
  12. 2018Learning Individualized Cardiovascular Responses from Large-scale Wearable Sensors Datacited by 5
1 more
  1. 2021Transformer-Based Behavioral Representation Learning Enables Transfer Learning for Mobile Sensing in Small Datasetscited by 2

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1.

2 papers.