Multi-scale hypergraph meets LLMs: Aligning large language models for time series analysis
Not on the map. Why?
Abstract (arXiv)
Recently, there has been great success in leveraging pre-trained large language models (LLMs) for time series analysis. The core idea lies in effectively aligning the modality between natural language and time series. However, the multi-scale structures of natural language and time series have not been fully considered, resulting in insufficient utilization of LLMs capabilities. To this end, we propose MSH-LLM, a Multi-Scale Hypergraph method that aligns Large Language Models for time series analysis. Specifically, a hyperedging mechanism is designed to enhance the multi-scale semantic information of time series semantic space. Then, a cross-modality alignment (CMA) module is introduced to align the modality between natural language and time series at different scales. In addition, a mixture of prompts (MoP) mechanism is introduced to provide contextual information and enhance the ability of LLMs to understand the multi-scale temporal patterns of time series. Experimental results on 27 real-world datasets across 5 different applications demonstrate that MSH-LLM achieves the state-of-the-art results.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 68 of its 90 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
68 of 90 references.
References · 68
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
38 more
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2020Reformer: The Efficient Transformercited by 1,658
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 499
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 407
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
- 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
- 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 165
- 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
- 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 146
- 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 143
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2023Large Language Models are Few-Shot Health Learnerscited by 115
- 2024CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuningcited by 105
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 104
- 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 102
- 2024TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignmentcited by 97
- 2021KVT: k-NN Attention for Boosting Vision Transformerscited by 64
- 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Modelscited by 63
- 2018Transfer learning for time series classificationcited by 60
- 2023PerceptionGPT: Effectively Fusing Visual Perception into LLMcited by 59
- 2024Deep Learning for Multivariate Time Series Imputation: A Surveycited by 57
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Understanding Why Large Language Models Can Be Ineffective in Time Series Analysis: The Impact of Modality Alignment
- 2025Context-Alignment: Activating and Enhancing LLM Capabilities in Time Series
- 2025Enhancing LLMs for Time Series Forecasting via Structure-Guided Cross-Modal Alignment
- 2025Enhancing Time Series Forecasting via Multi-Level Text Alignment with LLMs
- 2025Adapting Large Language Models for Time Series Modeling via a Novel Parameter-efficient Adaptation Method
- 2024Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification
- 2024NeST: Neighborhood-aware semantic alignment and temporal modulation for LLM based time series forecasting
- 2025BALM-TSF: Balanced Multimodal Alignment for LLM-Based Time Series Forecasting