Few-Shot Learning for Industrial Time Series: A Comparative Analysis Using the Example of Screw-Fastening Process Monitoring
Not on the map. Why?
Abstract (arXiv)
Few-shot learning (FSL) has shown promise in vision but remains largely unexplored for industrial time-series data, where annotating every new defect is prohibitively expensive. We present a systematic FSL study on screw-fastening process monitoring, using a 2,300-sample multivariate torque dataset that covers 16 uni- and multi-factorial defect types. Beyond benchmarking, we introduce a label-aware episodic sampler that collapses multi-label sequences into multiple single-label tasks, keeping the output dimensionality fixed while preserving combinatorial label information. Two FSL paradigms are investigated: the metric-based Prototypical Network and the gradient-based Model-Agnostic Meta-Learning (MAML), each paired with three backbones: 1D CNN, InceptionTime and the 341 M-parameter transformer Moment. On 10-shot, 3-way evaluation, the InceptionTime + Prototypical Network combination achieves a 0.944 weighted F1 in the multi-class regime and 0.935 in the multi-label regime, outperforming finetuned Moment by up to 5.3% while requiring two orders of magnitude fewer parameters and training time. Across all backbones, metric learning consistently surpasses MAML, and our label-aware sampling yields an additional 1.7% F1 over traditional class-based sampling. These findings challenge the assumption that large foundation models are always superior: when data are scarce, lightweight CNN architectures augmented with simple metric learning not only converge faster but also generalize better. We release code, data splits and pre-trained weights to foster reproducible research and to catalyze the adoption of FSL in high-value manufacturing inspection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 81 references that are in the map. First posted on arXiv 16 Jun 2025.
Builds on
30 of 81 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2018Deep learning for time series classification: a reviewcited by 576
18 more
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2018The UCR Time Series Archivecited by 431
- 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
- 2019Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examplescited by 315
- 2016FMA: A Dataset For Music Analysiscited by 207
- 2019Deep learning with noisy labels: exploring techniques and remedies in medical image analysiscited by 173
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2020learn2learn: A Library for Meta-Learning Researchcited by 69
- 2022Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learningcited by 58
- 2019MetaPred: Meta-Learning for Clinical Risk Prediction with Limited Patient Electronic Health Recordscited by 33
- 2024Towards Few-Shot Adaptation of Foundation Models via Multitask Finetuningcited by 31
- 2021LibFewShot: A Comprehensive Library for Few-shot Learningcited by 21
- 2019BETA: A Large Benchmark Database Toward SSVEP-BCI Applicationcited by 15
- 2020Memory-Augmented Relation Network for Few-Shot Learningcited by 10
- 2022A Dataset for Greek Traditional and Folk Music: Lyracited by 9
- 2022Learning from Taxonomy: Multi-label Few-Shot Classification for Everyday Sound Recognitioncited by 8
- 2024LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Taggingcited by 7
- 2019One-Way Prototypical Networkscited by 5
Built on by
Not cited yet.