mlsanityData to 14 Oct 2026

TS-ACL: Closed-Form Solution for Time Series-oriented Continual Learning

arXiv 2410.15954 ↗First posted 21 Oct 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Time series classification underpins critical applications such as healthcare diagnostics and gesture-driven interactive systems in multimedia scenarios. However, time series class-incremental learning (TSCIL) faces two major challenges: catastrophic forgetting and intra-class variations. Catastrophic forgetting occurs because gradient-based parameter update strategies inevitably erase past knowledge. And unlike images, time series data exhibits subject-specific patterns, also known as intra-class variations, which refer to differences in patterns observed within the same class. While exemplar-based methods fail to cover diverse variation with limited samples, existing exemplar-free methods lack explicit mechanisms to handle intra-class variations. To address these two challenges, we propose TS-ACL, which leverages a gradient-free closed-form solution to avoid the catastrophic forgetting problem inherent in gradient-based optimization methods while simultaneously learning global distributions to resolve intra-class variations. Additionally, it provides privacy protection and efficiency. Extensive experiments on five benchmark datasets covering various sensor modalities and tasks demonstrate that TS-ACL achieves performance close to joint training on four datasets, outperforming existing methods and establishing a new state-of-the-art (SOTA) for TSCIL.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 37 references that are in the map. First posted on arXiv 21 Oct 2024.

Builds on

20 of 37 references.

References · 20

  1. 2016Learning without Forgettingcited by 2,496
  2. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  3. 2017Continual Learning with Deep Generative Replaycited by 1,158
  4. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
  5. 2018Experience Replay for Continual Learningcited by 1,095
  6. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
  7. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
  8. 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 722
  9. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  10. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  11. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
  12. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
8 more
  1. 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
  2. 2021TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generationcited by 142
  3. 2021HIVE-COTE 2.0: a new meta ensemble for time series classificationcited by 118
  4. 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
  5. 2024DS-AL: A Dual-Stream Analytic Learning for Exemplar-Free Class-Incremental Learningcited by 28
  6. 2022Open Access Dataset for Electromyography based Multi-code Biometric Authenticationcited by 12
  7. 2021FastICARL: Fast Incremental Classifier and Representation Learning with Efficient Budget Allocation in Audio Sensing Applicationscited by 9
  8. 2024Class-incremental Learning for Time Series: Benchmark and Evaluationcited by 9

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.