Higher-order Cross-structural Embedding Model for Time Series Analysis
Not on the map. Why?
Abstract (arXiv)
Time series analysis has gained significant attention due to its critical applications in diverse fields such as healthcare, finance, and sensor networks. The complexity and non-stationarity of time series make it challenging to capture the interaction patterns across different timestamps. Current approaches struggle to model higher-order interactions within time series, and focus on learning temporal or spatial dependencies separately, which limits performance in downstream tasks. To address these gaps, we propose Higher-order Cross-structural Embedding Model for Time Series (High-TS), a novel framework that jointly models both temporal and spatial perspectives by combining multiscale Transformer with Topological Deep Learning (TDL). Meanwhile, High-TS utilizes contrastive learning to integrate these two structures for generating robust and discriminative representations. Extensive experiments show that High-TS outperforms state-of-the-art methods in various time series tasks and demonstrate the importance of higher-order cross-structural information in improving model performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 68 references that are in the map. First posted on arXiv 30 Oct 2024.
Builds on
33 of 68 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
21 more
- 2018Hypergraph Neural Networkscited by 482
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
- 2020Simplicial Neural Networkscited by 105
- 2022Topological Deep Learning: Going Beyond Graph Datacited by 92
- 2018Random Walks on Simplicial Complexes and the normalized Hodge 1-Laplaciancited by 84
- 2021Principled Simplicial Neural Networks for Trajectory Predictioncited by 77
- 2022Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecastingcited by 54
- 2022Simplicial Attention Networkscited by 40
- 2020Approaches and Applications of Early Classification of Time Series: A Reviewcited by 39
- 2022Cell Attention Networkscited by 34
- 2020Persistent Laplacians: properties, algorithms and implicationscited by 28
- 2023Fully-Connected Spatial-Temporal Graph for Multivariate Time-Series Datacited by 23
- 2021Signal processing on simplicial complexescited by 12
- 2023Graph-Aware Contrasting for Multivariate Time-Series Classificationcited by 11
Built on by
Not cited yet.