mlsanityData to 7 Oct 2026

Interpretable time series neural representation for classification purposes

arXiv 2310.16696 ↗First posted 25 Oct 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning has made significant advances in creating efficient representations of time series data by automatically identifying complex patterns. However, these approaches lack interpretability, as the time series is transformed into a latent vector that is not easily interpretable. On the other hand, Symbolic Aggregate approximation (SAX) methods allow the creation of symbolic representations that can be interpreted but do not capture complex patterns effectively. In this work, we propose a set of requirements for a neural representation of univariate time series to be interpretable. We propose a new unsupervised neural architecture that meets these requirements. The proposed model produces consistent, discrete, interpretable, and visualizable representations. The model is learned independently of any downstream tasks in an unsupervised setting to ensure robustness. As a demonstration of the effectiveness of the proposed model, we propose experiments on classification tasks using UCR archive datasets. The obtained results are extensively compared to other interpretable models and state-of-the-art neural representation learning models. The experiments show that the proposed model yields, on average better results than other interpretable approaches on multiple datasets. We also present qualitative experiments to asses the interpretability of the approach.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 39 references that are in the map. First posted on arXiv 25 Oct 2023.

Builds on

18 of 39 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  5. 2016Group Equivariant Convolutional Networkscited by 1,154
  6. 2016The Mythos of Model Interpretabilitycited by 716
  7. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  8. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
  9. 2018The UCR Time Series Archivecited by 421
  10. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
  11. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
  12. 2017Beyond Sparsity: Tree Regularization of Deep Models for Interpretabilitycited by 68
6 more
  1. 2018SOM-VAE: Interpretable Discrete Representation Learning on Time Seriescited by 59
  2. 2017TimeNet: Pre-trained deep recurrent neural network for time series classificationcited by 46
  3. 2018Exploiting Kernel Sparsity and Entropy for Interpretable CNN Compressioncited by 40
  4. 2020Interpretable Time Series Classification using Linear Models and Multi-resolution Multi-domain Symbolic Representationscited by 31
  5. 2021Truly shift-equivariant convolutional neural networks with adaptive polyphase upsamplingcited by 10
  6. 2022Learning Differential Operators for Interpretable Time Series Modelingcited by 7

Built on by

Not cited yet.