Meta-learning to Address Data Shift in Time Series Classification
Not on the map. Why?
Abstract (arXiv)
Across engineering and scientific domains, traditional deep learning (TDL) models perform well when training and test data share the same distribution. However, the dynamic nature of real-world data, broadly termed textitdata shift, renders TDL models prone to rapid performance degradation, requiring costly relabeling and inefficient retraining. Meta-learning, which enables models to adapt quickly to new data with few examples, offers a promising alternative for mitigating these challenges. Here, we systematically compare TDL with fine-tuning and optimization-based meta-learning algorithms to assess their ability to address data shift in time-series classification. We introduce a controlled, task-oriented seismic benchmark (SeisTask) and show that meta-learning typically achieves faster and more stable adaptation with reduced overfitting in data-scarce regimes and smaller model architectures. As data availability and model capacity increase, its advantages diminish, with TDL with fine-tuning performing comparably. Finally, we examine how task diversity influences meta-learning and find that alignment between training and test distributions, rather than diversity alone, drives performance gains. Overall, this work provides a systematic evaluation of when and why meta-learning outperforms TDL under data shift and contributes SeisTask as a benchmark for advancing adaptive learning research in time-series domains.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
30 of 44 references.
References · 30
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 2019A Closer Look at Few-shot Classificationcited by 679
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
18 more
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2019Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examplescited by 312
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2018Do CIFAR-10 Classifiers Generalize to CIFAR-10?cited by 197
- 2019Meta-Learning Representations for Continual Learningcited by 189
- 2020Adaptive Risk Minimization: Learning to Adapt to Domain Shiftcited by 183
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2020Learning to Continually Learncited by 82
- 2017Meta-Learning and Universality: Deep Representations and Gradient Descent can Approximate any Learning Algorithmcited by 65
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2024Domain Generalization through Meta-Learning: A Surveycited by 28
- 2019Meta-Learning for Few-Shot Time Series Classificationcited by 23
- 2020Is Support Set Diversity Necessary for Meta-Learning?cited by 14
- 2022The Effect of Diversity in Meta-Learningcited by 13
- 2023Towards Task Sampler Learning for Meta-Learningcited by 11
- 2021ProtoTransformer: A Meta-Learning Approach to Providing Student Feedbackcited by 8
- 2020When does MAML Work the Best? An Empirical Study on Model-Agnostic Meta-Learning in NLP Applicationscited by 5
- 2020Model-Agnostic Learning to Meta-Learncited by 1
Built on by
Not cited yet.