Multi-Granularity Framework for Unsupervised Representation Learning of Time Series
Not on the map. Why?
Abstract (arXiv)
Representation learning plays a critical role in the analysis of time series data and has high practical value across a wide range of applications. including trend analysis, time series data retrieval and forecasting. In practice, data confusion is a significant issue as it can considerably impact the effectiveness and accuracy of data analysis, machine learning models and decision-making processes. In general, previous studies did not consider the variability at various levels of granularity, thus resulting in inadequate information utilization, which further exacerbated the issue of data confusion. This paper proposes an unsupervised framework to realize multi-granularity representation learning for time series. Specifically, we employed a cross-granularity transformer to develop an association between fine- and coarse-grained representations. In addition, we introduced a retrieval task as an unsupervised training task to learn the multi-granularity representation of time series. Moreover, a novel loss function was designed to obtain the comprehensive multi-granularity representation of the time series via unsupervised learning. The experimental results revealed that the proposed framework demonstrates significant advantages over alternative representation learning models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 12 Dec 2023.
Builds on
14 of 32 references.
References · 14
- 2017Attention Is All You Needcited by 59,932
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2018The UCR Time Series Archivecited by 421
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
- 2020Exploring Self-attention for Image Recognitioncited by 313
- 2019Time2Vec: Learning a Vector Representation of Timecited by 208
- 2020ImageBERT: Cross-modal Pre-training with Large-scale Weak-supervised Image-Text Datacited by 136
- 2017LSTM Fully Convolutional Networks for Time Series Classificationcited by 135
- 2019TS-CHIEF: A Scalable and Accurate Forest Algorithm for Time Series Classificationcited by 67
- 2022Vision Transformers in Medical Computer Vision -- A Contemplative Retrospectioncited by 22
Built on by
Citing papers per year: 2026: 1.
1 paper.