mlsanityData to 14 Oct 2026

Enhancing Time Series Forecasting via Multi-Level Text Alignment with LLMs

arXiv 2504.07360 ↗First posted 10 Apr 2025cs.CL cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

The adaptation of large language models (LLMs) to time series forecasting poses unique challenges, as time series data is continuous in nature, while LLMs operate on discrete tokens. Despite the success of LLMs in natural language processing (NLP) and other structured domains, aligning time series data with language-based representations while maintaining both predictive accuracy and interpretability remains a significant hurdle. Existing methods have attempted to reprogram time series data into text-based forms, but these often fall short in delivering meaningful, interpretable results. In this paper, we propose a multi-level text alignment framework for time series forecasting using LLMs that not only improves prediction accuracy but also enhances the interpretability of time series representations. Our method decomposes time series into trend, seasonal, and residual components, which are then reprogrammed into component-specific text representations. We introduce a multi-level alignment mechanism, where component-specific embeddings are aligned with pre-trained word tokens, enabling more interpretable forecasts. Experiments on multiple datasets demonstrate that our method outperforms state-of-the-art models in accuracy while providing good interpretability.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 33 references that are in the map. First posted on arXiv 10 Apr 2025.

Builds on

26 of 33 references.

References · 26

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  8. 2020Reformer: The Efficient Transformercited by 1,668
  9. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  10. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  11. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  12. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
14 more
  1. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  2. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  3. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  4. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  5. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
  6. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 172
  7. 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 169
  8. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
  9. 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148
  10. 2023Large Language Models are Few-Shot Health Learnerscited by 118
  11. 2024Empowering Time Series Analysis with Large Language Models: A Surveycited by 60
  12. 2020RobustTAD: Robust Time Series Anomaly Detection via Decomposition and Convolutional Neural Networkscited by 55
  13. 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
  14. 2023SaDI: A Self-adaptive Decomposed Interpretable Framework for Electric Load Forecasting under Extreme Eventscited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025BALM-TSF: Balanced Multimodal Alignment for LLM-Based Time Series Forecasting
  2. 2025Adapting LLMs to Time Series Forecasting via Temporal Heterogeneity Modeling and Representation Alignment
  3. 2025Enhancing LLMs for Time Series Forecasting via Structure-Guided Cross-Modal Alignment
  4. 2024NeST: Neighborhood-aware semantic alignment and temporal modulation for LLM based time series forecasting
  5. 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters
  6. 2026Rethinking the Role of LLMs in Time Series Forecasting
  7. 2025Exploring the Effectiveness and Interpretability of Texts in LLM-based Time Series Models
  8. 2024TS-HTFA: Advancing Time Series Forecasting via Hierarchical Text-Free Alignment with Large Language Models