mlsanityData to 7 Oct 2026

Higher-order Cross-structural Embedding Model for Time Series Analysis

arXiv 2410.22984 ↗First posted 30 Oct 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Time series analysis has gained significant attention due to its critical applications in diverse fields such as healthcare, finance, and sensor networks. The complexity and non-stationarity of time series make it challenging to capture the interaction patterns across different timestamps. Current approaches struggle to model higher-order interactions within time series, and focus on learning temporal or spatial dependencies separately, which limits performance in downstream tasks. To address these gaps, we propose Higher-order Cross-structural Embedding Model for Time Series (High-TS), a novel framework that jointly models both temporal and spatial perspectives by combining multiscale Transformer with Topological Deep Learning (TDL). Meanwhile, High-TS utilizes contrastive learning to integrate these two structures for generating robust and discriminative representations. Extensive experiments show that High-TS outperforms state-of-the-art methods in various time series tasks and demonstrate the importance of higher-order cross-structural information in improving model performance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 68 references that are in the map. First posted on arXiv 30 Oct 2024.

Builds on

33 of 68 references.

References · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  6. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  7. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  8. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  9. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  10. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  11. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  12. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
21 more
  1. 2018Hypergraph Neural Networkscited by 482
  2. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  3. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
  4. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  5. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
  6. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  7. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
  8. 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
  9. 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
  10. 2020Simplicial Neural Networkscited by 105
  11. 2022Topological Deep Learning: Going Beyond Graph Datacited by 92
  12. 2018Random Walks on Simplicial Complexes and the normalized Hodge 1-Laplaciancited by 84
  13. 2021Principled Simplicial Neural Networks for Trajectory Predictioncited by 77
  14. 2022Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecastingcited by 54
  15. 2022Simplicial Attention Networkscited by 40
  16. 2020Approaches and Applications of Early Classification of Time Series: A Reviewcited by 39
  17. 2022Cell Attention Networkscited by 34
  18. 2020Persistent Laplacians: properties, algorithms and implicationscited by 28
  19. 2023Fully-Connected Spatial-Temporal Graph for Multivariate Time-Series Datacited by 23
  20. 2021Signal processing on simplicial complexescited by 12
  21. 2023Graph-Aware Contrasting for Multivariate Time-Series Classificationcited by 11

Built on by

Not cited yet.