Self-Supervised Learning for Data Scarcity in a Fatigue Damage Prognostic Problem
Not on the map. Why?
Abstract (arXiv)
With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life (RUL) predictions. However, one of the major challenges for DL techniques resides in the difficulty of obtaining large amounts of labelled data on industrial systems. To overcome this lack of labelled data, an emerging learning technique is considered in our work: Self-Supervised Learning, a sub-category of unsupervised learning approaches. This paper aims to investigate whether pre-training DL models in a self-supervised way on unlabelled sensors data can be useful for RUL estimation with only Few-Shots Learning, i.e. with scarce labelled data. In this research, a fatigue damage prognostics problem is addressed, through the estimation of the RUL of aluminum alloy panels (typical of aerospace structures) subject to fatigue cracks from strain gauge data. Synthetic datasets composed of strain data are used allowing to extensively investigate the influence of the dataset size on the predictive performance. Results show that the self-supervised pre-trained models are able to significantly outperform the non-pre-trained models in downstream RUL prediction task, and with less computational expense, showing promising results in prognostic tasks when only limited labelled data is available.
Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 30 of its 79 references that are in the map. First posted on arXiv 20 Jan 2023.
Builds on
30 of 79 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2020Language Models are Few-Shot Learnerscited by 32,320
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
- 2016Layer Normalizationcited by 5,624
- 2013Auto-Encoding Variational Bayescited by 4,024
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,024
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,378
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
- 2020A Survey on Contrastive Self-supervised Learningcited by 553
- 2020A Survey of Deep Active Learningcited by 550
18 more
- 2020Jukebox: A Generative Model for Musiccited by 537
- 2019Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directionscited by 172
- 2022Self-Supervised Learning for Recommender Systems: A Surveycited by 95
- 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
- 2020Potential, Challenges and Future Directions for Deep Learning in Prognostics and Health Management Applicationscited by 64
- 2020S3VAE: Self-Supervised Sequential VAE for Representation Disentanglement and Data Generationcited by 63
- 2021Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functionscited by 49
- 2022How important are activation functions in regression and classification? A survey, performance comparison, and future directionscited by 29
- 2019Tensorized Embedding Layers for Efficient Model Compressioncited by 27
- 2018Less is More: Surgical Phase Recognition with Less Annotations through Self-Supervised Pre-training of CNN-LSTM Networkscited by 24
- 2022GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimationcited by 11
- 2021Audacity of huge: overcoming challenges of data scarcity and data quality for machine learning in computational materials discoverycited by 10
- 2021COVID-19 detection from scarce chest x-ray image data using few-shot deep learning approachcited by 8
- 2017Semi-supervised Learning with Deep Generative Models for Asset Failure Predictioncited by 5
- 2022Masked Self-Supervision for Remaining Useful Lifetime Prediction in Machine Toolscited by 4
- 2016Gated Recurrent Unit (GRU) for Emotion Classification from Noisy Speechcited by 3
- 2021Improving Semi-Supervised Learning for Remaining Useful Lifetime Estimation Through Self-Supervisioncited by 3
- 2020Improving Maritime Traffic Emission Estimations on Missing Data with CRBMscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.
- 2026A Dual-Stream Physics-Augmented Unsupervised Architecture for Runtime Embedded Vehicle Health Monitoring11 Feb 2026
- 2025Unsupervised Contrastive Learning Using Out-Of-Distribution Data for Long-Tailed Dataset15 Jun 2025
- 2024Self-Supervised Learning for Text Recognition: A Critical Survey29 Jul 2024