Capturing Temporal Components for Time Series Classification
Not on the map. Why?
Abstract (arXiv)
Analyzing sequential data is crucial in many domains, particularly due to the abundance of data collected from the Internet of Things paradigm. Time series classification, the task of categorizing sequential data, has gained prominence, with machine learning approaches demonstrating remarkable performance on public benchmark datasets. However, progress has primarily been in designing architectures for learning representations from raw data at fixed (or ideal) time scales, which can fail to generalize to longer sequences. This work introduces a textitcompositional representation learning approach trained on statistically coherent components extracted from sequential data. Based on a multi-scale change space, an unsupervised approach is proposed to segment the sequential data into chunks with similar statistical properties. A sequence-based encoder model is trained in a multi-task setting to learn compositional representations from these temporal components for time series classification. We demonstrate its effectiveness through extensive experiments on publicly available time series classification benchmarks. Evaluating the coherence of segmented components shows its competitive performance on the unsupervised segmentation task.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 48 references that are in the map. First posted on arXiv 20 Jun 2024.
Builds on
21 of 48 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2018The UCR Time Series Archivecited by 421
- 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 358
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
9 more
- 2020UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Trainingcited by 204
- 20191D Convolutional Neural Networks and Applications: A Surveycited by 152
- 2016Multi-Scale Convolutional Neural Networks for Time Series Classificationcited by 99
- 2019TS-CHIEF: A Scalable and Accurate Forest Algorithm for Time Series Classificationcited by 67
- 2020Omni-Scale CNNs: a simple and effective kernel size configuration for time series classificationcited by 47
- 2018Proximity Forest: An effective and scalable distance-based classifier for time seriescited by 46
- 2022On Data Scaling in Masked Image Modelingcited by 45
- 2018Towards a universal neural network encoder for time seriescited by 28
- 2021Towards Active Vision for Action Localization with Reactive Control and Predictive Learningcited by 5
Built on by
Citing papers per year: 2025: 2.
2 papers.