mlsanityData to 7 Oct 2026

Evaluation of self-supervised pre-training for automatic infant movement classification using wearable movement sensors

arXiv 2305.09366 ↗First posted 16 May 2023cs.LG eess.SPcited by 1

Not on the map. Why?

Abstract (arXiv)

The recently-developed infant wearable MAIJU provides a means to automatically evaluate infants' motor performance in an objective and scalable manner in out-of-hospital settings. This information could be used for developmental research and to support clinical decision-making, such as detection of developmental problems and guiding of their therapeutic interventions. MAIJU-based analyses rely fully on the classification of infant's posture and movement; it is hence essential to study ways to increase the accuracy of such classifications, aiming to increase the reliability and robustness of the automated analysis. Here, we investigated how self-supervised pre-training improves performance of the classifiers used for analyzing MAIJU recordings, and we studied whether performance of the classifier models is affected by context-selective quality-screening of pre-training data to exclude periods of little infant movement or with missing sensors. Our experiments show that i) pre-training the classifier with unlabeled data leads to a robust accuracy increase of subsequent classification models, and ii) selecting context-relevant pre-training data leads to substantial further improvements in the classifier performance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 27 references that are in the map. First posted on arXiv 16 May 2023.

Builds on

23 of 27 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2016Layer Normalizationcited by 5,579
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  10. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  11. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  12. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
11 more
  1. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  2. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  3. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
  4. 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
  5. 2017Unsupervised Representation Learning by Sorting Sequencescited by 219
  6. 2022Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Languagecited by 108
  7. 2022Assessing the State of Self-Supervised Human Activity Recognition using Wearablescited by 63
  8. 2021SelfHAR: Improving Human Activity Recognition through Self-training with Unlabeled Datacited by 31
  9. 2020Sense and Learn: Self-Supervision for Omnipresent Sensorscited by 21
  10. 2019Automatic Posture and Movement Tracking of Infants with Wearable Movement Sensorscited by 10
  11. 2021Comparison of end-to-end neural network architectures and data augmentation methods for automatic infant motility assessment using wearable sensorscited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.