mlsanityData to 7 Oct 2026

MSHyper: Multi-Scale Hypergraph Transformer for Long-Range Time Series Forecasting

arXiv 2401.09261 ↗First posted 17 Jan 2024cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

Demystifying interactions between temporal patterns of different scales is fundamental to precise long-range time series forecasting. However, previous works lack the ability to model high-order interactions. To promote more comprehensive pattern interaction modeling for long-range time series forecasting, we propose a Multi-Scale Hypergraph Transformer (MSHyper) framework. Specifically, a multi-scale hypergraph is introduced to provide foundations for modeling high-order pattern interactions. Then by treating hyperedges as nodes, we also build a hyperedge graph to enhance hypergraph modeling. In addition, a tri-stage message passing mechanism is introduced to aggregate pattern information and learn the interaction strength between temporal patterns of different scales. Extensive experiments on five real-world datasets demonstrate that MSHyper achieves state-of-the-art (SOTA) performance across various settings.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 35 of its 63 references that are in the map. First posted on arXiv 17 Jan 2024.

Builds on

35 of 63 references.

References · 35

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  4. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  5. 2020Reformer: The Efficient Transformercited by 1,658
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  8. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  10. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  11. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  12. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
23 more
  1. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  2. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  3. 2022Transformers in Time Series: A Surveycited by 489
  4. 2018Hypergraph Neural Networkscited by 482
  5. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  6. 2019Hypergraph Convolution and Hypergraph Attentioncited by 226
  7. 2021Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encodingcited by 207
  8. 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
  9. 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 100
  10. 2019Star-Transformercited by 94
  11. 2021Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identificationcited by 63
  12. 2022Hypergraph Contrastive Collaborative Filteringcited by 63
  13. 2022Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting--Full Versioncited by 59
  14. 2022Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecastingcited by 54
  15. 2023MSGNet: Learning Multi-Scale Inter-Series Correlations for Multivariate Time Series Forecastingcited by 50
  16. 2022Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecastingcited by 42
  17. 2022Multi-Behavior Hypergraph-Enhanced Transformer for Sequential Recommendationcited by 42
  18. 2022Self-supervised Hypergraph Representation Learning for Sociological Analysiscited by 27
  19. 2023Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distributioncited by 15
  20. 2023WeatherGNN: Exploiting Meteo- and Spatial-Dependencies for Local Numerical Weather Prediction Bias-Correctioncited by 13
  21. 2020Multi-scale Transformer Language Modelscited by 12
  22. 2021Multiwave COVID-19 Prediction from Social Awareness using Web Search and Mobility Datacited by 3
  23. 2023Discovering Predictable Latent Factors for Time Series Forecastingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 5.

12 papers.

  1. 2025Aurora: Towards Universal Generative Multimodal Time Series Forecastingcited by 28
  2. 2024Ada-MSHyper: Adaptive Multi-Scale Hypergraph Transformer for Time Series Forecastingcited by 21
  3. 2026GCGNet: Graph-Consistent Generative Network for Time Series Forecasting with Exogenous Variablescited by 11
  4. 2025ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecastingcited by 7
  5. 2024DECRL: A Deep Evolutionary Clustering Jointed Temporal Knowledge Graph Representation Learning Approachcited by 3
  6. 2026PATRA: Pattern-Aware Alignment and Balanced Reasoning for Time Series Question Answeringcited by 3
  7. 2026Multi-scale hypergraph meets LLMs: Aligning large language models for time series analysiscited by 2
  8. 2025HGTS-Former: Hierarchical HyperGraph Transformer for Multivariate Time Series Analysiscited by 1
  9. 2025FlowMixer: A Depth-Agnostic Neural Architecture for Interpretable Spatiotemporal Forecastingcited by 0
  10. 2025Physics-Informed High-order Graph Dynamics Identification Learning for Predicting Complex Networks Long-term Dynamicscited by 0
  11. 2026The CTLNet for Shanghai Composite Index Predictioncited by 0
  12. 2026XMatch: Enhancing Covariate-Aware Time Series Forecasting through Tree-Structured Exogenous Matchingcited by 0