FIC-TSC: Learning Time Series Classification with Fisher Information Constraint
Not on the map. Why?
Abstract (arXiv)
Analyzing time series data is crucial to a wide spectrum of applications, including economics, online marketplaces, and human healthcare. In particular, time series classification plays an indispensable role in segmenting different phases in stock markets, predicting customer behavior, and classifying worker actions and engagement levels. These aspects contribute significantly to the advancement of automated decision-making and system optimization in real-world applications. However, there is a large consensus that time series data often suffers from domain shifts between training and test sets, which dramatically degrades the classification performance. Despite the success of (reversible) instance normalization in handling the domain shifts for time series regression tasks, its performance in classification is unsatisfactory. In this paper, we propose textitFIC-TSC, a training framework for time series classification that leverages Fisher information as the constraint. We theoretically and empirically show this is an efficient and effective solution to guide the model converge toward flatter minima, which enhances its generalizability to distribution shifts. We rigorously evaluate our method on 30 UEA multivariate and 85 UCR univariate datasets. Our empirical results demonstrate the superiority of the proposed method over 14 recent state-of-the-art methods.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 43 of its 73 references that are in the map. First posted on arXiv 9 May 2025.
Builds on
43 of 73 references.
References · 43
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2015Optimizing Neural Networks with Kronecker-factored Approximate Curvaturecited by 796
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2017Exploring Generalization in Deep Learningcited by 600
- 2019Fantastic Generalization Measures and Where to Find Themcited by 513
31 more
- 2017Sharp Minima Can Generalize For Deep Netscited by 466
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
- 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 339
- 2018The UEA multivariate time series classification archive, 2018cited by 338
- 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 273
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
- 2015On Wasserstein Two Sample Testing and Related Families of Nonparametric Testscited by 166
- 2020Domain Adaptive Ensemble Learningcited by 156
- 2022Towards Understanding Sharpness-Aware Minimizationcited by 146
- 2020Benchmarking Multivariate Time Series Classification Algorithmscited by 145
- 2018Multivariate LSTM-FCNs for Time Series Classificationcited by 120
- 2021HIVE-COTE 2.0: a new meta ensemble for time series classificationcited by 118
- 2020Relative Flatness and Generalizationcited by 88
- 2022Fisher SAM: Information Geometry and Sharpness Aware Minimisationcited by 84
- 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 74
- 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
- 2022HYDRA: Competing convolutional kernels for fast and accurate time series classificationcited by 54
- 2024Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classificationcited by 53
- 2023Improving Position Encoding of Transformers for Multivariate Time Series Classificationcited by 45
- 2024SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attentioncited by 44
- 2022Implicit regularization of dropoutcited by 25
- 2023Inherently Interpretable Time Series Classification via Multiple Instance Learningcited by 23
- 2015Multivariate Time Series Classification Using Dynamic Time Warping Template Selection for Human Activity Recognitioncited by 22
- 2023NuTime: Numerically Multi-Scaled Embedding for Large-Scale Time-Series Pretrainingcited by 20
- 2023TodyNet: Temporal Dynamic Graph Neural Network for Multivariate Time Series Classificationcited by 16
- 2024TimeMIL: Advancing Multivariate Time Series Classification via a Time-aware Multiple Instance Learningcited by 12
- 2023MTS-LOF: Medical Time-Series Representation Learning via Occlusion-Invariant Featurescited by 5
- 2022A multi-level interpretable sleep stage scoring system by infusing experts' knowledge into a deep network architecturecited by 4
- 2024What Causes Performance Degradation in Cross-Subject EEG Classification?cited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.