mlsanityData to 14 Oct 2026

Few-Shot Learning for Industrial Time Series: A Comparative Analysis Using the Example of Screw-Fastening Process Monitoring

arXiv 2506.13909 ↗First posted 16 Jun 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Few-shot learning (FSL) has shown promise in vision but remains largely unexplored for industrial time-series data, where annotating every new defect is prohibitively expensive. We present a systematic FSL study on screw-fastening process monitoring, using a 2,300-sample multivariate torque dataset that covers 16 uni- and multi-factorial defect types. Beyond benchmarking, we introduce a label-aware episodic sampler that collapses multi-label sequences into multiple single-label tasks, keeping the output dimensionality fixed while preserving combinatorial label information. Two FSL paradigms are investigated: the metric-based Prototypical Network and the gradient-based Model-Agnostic Meta-Learning (MAML), each paired with three backbones: 1D CNN, InceptionTime and the 341 M-parameter transformer Moment. On 10-shot, 3-way evaluation, the InceptionTime + Prototypical Network combination achieves a 0.944 weighted F1 in the multi-class regime and 0.935 in the multi-label regime, outperforming finetuned Moment by up to 5.3% while requiring two orders of magnitude fewer parameters and training time. Across all backbones, metric learning consistently surpasses MAML, and our label-aware sampling yields an additional 1.7% F1 over traditional class-based sampling. These findings challenge the assumption that large foundation models are always superior: when data are scarce, lightweight CNN architectures augmented with simple metric learning not only converge faster but also generalize better. We release code, data splits and pre-trained weights to foster reproducible research and to catalyze the adoption of FSL in high-value manufacturing inspection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 81 references that are in the map. First posted on arXiv 16 Jun 2025.

Builds on

30 of 81 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  8. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  9. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  10. 2016Matching Networks for One Shot Learningcited by 2,255
  11. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  12. 2018Deep learning for time series classification: a reviewcited by 576
18 more
  1. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  2. 2018The UCR Time Series Archivecited by 431
  3. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
  4. 2019Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examplescited by 315
  5. 2016FMA: A Dataset For Music Analysiscited by 207
  6. 2019Deep learning with noisy labels: exploring techniques and remedies in medical image analysiscited by 173
  7. 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
  8. 2020learn2learn: A Library for Meta-Learning Researchcited by 69
  9. 2022Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learningcited by 58
  10. 2019MetaPred: Meta-Learning for Clinical Risk Prediction with Limited Patient Electronic Health Recordscited by 33
  11. 2024Towards Few-Shot Adaptation of Foundation Models via Multitask Finetuningcited by 31
  12. 2021LibFewShot: A Comprehensive Library for Few-shot Learningcited by 21
  13. 2019BETA: A Large Benchmark Database Toward SSVEP-BCI Applicationcited by 15
  14. 2020Memory-Augmented Relation Network for Few-Shot Learningcited by 10
  15. 2022A Dataset for Greek Traditional and Folk Music: Lyracited by 9
  16. 2022Learning from Taxonomy: Multi-label Few-Shot Classification for Everyday Sound Recognitioncited by 8
  17. 2024LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Taggingcited by 7
  18. 2019One-Way Prototypical Networkscited by 5

Built on by

Not cited yet.