mlsanityData to 14 Oct 2026

Univariate to Multivariate: LLMs as Zero-Shot Predictors for Time-Series Forecasting

arXiv 2506.02389 ↗First posted 3 Jun 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Time-series prediction or forecasting is critical across many real-world dynamic systems, and recent studies have proposed using Large Language Models (LLMs) for this task due to their strong generalization capabilities and ability to perform well without extensive pre-training. However, their effectiveness in handling complex, noisy, and multivariate time-series data remains underexplored. To address this, we propose LLMPred which enhances LLM-based time-series prediction by converting time-series sequences into text and feeding them to LLMs for zero shot prediction along with two main data pre-processing techniques. First, we apply time-series sequence decomposition to facilitate accurate prediction on complex and noisy univariate sequences. Second, we extend this univariate prediction capability to multivariate data using a lightweight prompt-processing strategy. Extensive experiments with smaller LLMs such as Llama 2 7B, Llama 3.2 3B, GPT-4o-mini, and DeepSeek 7B demonstrate that LLMPred achieves competitive or superior performance compared to state-of-the-art baselines. Additionally, a thorough ablation study highlights the importance of the key components proposed in LLMPred.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 32 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

20 of 32 references.

References · 20

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  3. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  4. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  5. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
  6. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  7. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
  8. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 172
  9. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
  10. 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasterscited by 129
  11. 2023FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph Perspectivecited by 127
  12. 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 76
8 more
  1. 2024From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examplescited by 57
  2. 2024LLM Processes: Numerical Predictive Distributions Conditioned on Natural Languagecited by 55
  3. 2024How Numerical Precision Affects Arithmetical Reasoning Capabilities of LLMscited by 24
  4. 2024Language Models Encode the Value of Numbers Linearlycited by 20
  5. 2023NetDiffus: Network Traffic Generation by Diffusion Models through Time-Series Imagingcited by 19
  6. 2024Multivariate Probabilistic Time Series Forecasting with Correlated Errorscited by 6
  7. 2024A Survey of Transformer Enabled Time Series Synthesiscited by 5
  8. 2025Large Language Models in Numberland: A Quick Test of Their Numerical Reasoning Abilitiescited by 2

Built on by

Not cited yet.