mlsanityData to 14 Oct 2026

An Evaluation of Standard Statistical Models and LLMs on Time Series Forecasting

arXiv 2408.04867 ↗First posted 9 Aug 2024cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

This research examines the use of Large Language Models (LLMs) in predicting time series, with a specific focus on the LLMTIME model. Despite the established effectiveness of LLMs in tasks such as text generation, language translation, and sentiment analysis, this study highlights the key challenges that large language models encounter in the context of time series prediction. We assess the performance of LLMTIME across multiple datasets and introduce classical almost periodic functions as time series to gauge its effectiveness. The empirical results indicate that while large language models can perform well in zero-shot forecasting for certain datasets, their predictive accuracy diminishes notably when confronted with diverse time series data and traditional signals. The primary finding of this study is that the predictive capacity of LLMTIME, similar to other LLMs, significantly deteriorates when dealing with time series data that contain both periodic and trend components, as well as when the signal comprises complex frequency components.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 9 Aug 2024.

Builds on

21 of 34 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  6. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  7. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  8. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
  9. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  10. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  11. 2018Deep learning for time series classification: a reviewcited by 576
  12. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
9 more
  1. 2022Transformers in Time Series: A Surveycited by 497
  2. 2021Monash Time Series Forecasting Archivecited by 267
  3. 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 100
  4. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  5. 2021Darts: User-Friendly Modern Machine Learning for Time Seriescited by 91
  6. 2017RUBER: An Unsupervised Method for Automatic Evaluation of Open-Domain Dialog Systemscited by 88
  7. 2023Goat: Fine-tuned LLaMA Outperforms GPT-4 on Arithmetic Taskscited by 84
  8. 2020RobustTAD: Robust Time Series Anomaly Detection via Decomposition and Convolutional Neural Networkscited by 55
  9. 2022Forecast Evaluation for Data Scientists: Common Pitfalls and Best Practicescited by 55

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.