Evaluation of self-supervised pre-training for automatic infant movement classification using wearable movement sensors
Not on the map. Why?
Abstract (arXiv)
The recently-developed infant wearable MAIJU provides a means to automatically evaluate infants' motor performance in an objective and scalable manner in out-of-hospital settings. This information could be used for developmental research and to support clinical decision-making, such as detection of developmental problems and guiding of their therapeutic interventions. MAIJU-based analyses rely fully on the classification of infant's posture and movement; it is hence essential to study ways to increase the accuracy of such classifications, aiming to increase the reliability and robustness of the automated analysis. Here, we investigated how self-supervised pre-training improves performance of the classifiers used for analyzing MAIJU recordings, and we studied whether performance of the classifier models is affected by context-selective quality-screening of pre-training data to exclude periods of little infant movement or with missing sensors. Our experiments show that i) pre-training the classifier with unlabeled data leads to a robust accuracy increase of subsequent classification models, and ii) selecting context-relevant pre-training data leads to substantial further improvements in the classifier performance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 27 references that are in the map. First posted on arXiv 16 May 2023.
Builds on
23 of 27 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Layer Normalizationcited by 5,579
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
11 more
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
- 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
- 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
- 2017Unsupervised Representation Learning by Sorting Sequencescited by 219
- 2022Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Languagecited by 108
- 2022Assessing the State of Self-Supervised Human Activity Recognition using Wearablescited by 63
- 2021SelfHAR: Improving Human Activity Recognition through Self-training with Unlabeled Datacited by 31
- 2020Sense and Learn: Self-Supervision for Omnipresent Sensorscited by 21
- 2019Automatic Posture and Movement Tracking of Infants with Wearable Movement Sensorscited by 10
- 2021Comparison of end-to-end neural network architectures and data augmentation methods for automatic infant motility assessment using wearable sensorscited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.