Self-supervision of wearable sensors time-series data for influenza detection
Not on the map. Why?
Abstract (arXiv)
Self-supervision may boost model performance in downstream tasks. However, there is no principled way of selecting the self-supervised objectives that yield the most adaptable models. Here, we study this problem on daily time-series data generated from wearable sensors used to detect onset of influenza-like illness (ILI). We first show that using self-supervised learning to predict next-day time-series values allows us to learn rich representations which can be adapted to perform accurate ILI prediction. Second, we perform an empirical analysis of three different self-supervised objectives to assess their adaptability to ILI prediction. Our results show that predicting the next day's resting heart rate or time-in-bed during sleep provides better representations for ILI prediction. These findings add to previous work demonstrating the practical application of self-supervised learning from activity data to improve health predictions.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 14 references that are in the map. First posted on arXiv 27 Dec 2021.
Builds on
13 of 14 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2019Why gradient clipping accelerates training: A theoretical justification for adaptivitycited by 335
- 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
- 2020GENNI: Visualising the Geometry of Equivalences for Neural Network Identifiabilitycited by 6
- 2018Learning Individualized Cardiovascular Responses from Large-scale Wearable Sensors Datacited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 1.
2 papers.