An Evaluation of Standard Statistical Models and LLMs on Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
This research examines the use of Large Language Models (LLMs) in predicting time series, with a specific focus on the LLMTIME model. Despite the established effectiveness of LLMs in tasks such as text generation, language translation, and sentiment analysis, this study highlights the key challenges that large language models encounter in the context of time series prediction. We assess the performance of LLMTIME across multiple datasets and introduce classical almost periodic functions as time series to gauge its effectiveness. The empirical results indicate that while large language models can perform well in zero-shot forecasting for certain datasets, their predictive accuracy diminishes notably when confronted with diverse time series data and traditional signals. The primary finding of this study is that the predictive capacity of LLMTIME, similar to other LLMs, significantly deteriorates when dealing with time series data that contain both periodic and trend components, as well as when the signal comprises complex frequency components.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 9 Aug 2024.
Builds on
21 of 34 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2018Deep learning for time series classification: a reviewcited by 576
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
9 more
- 2022Transformers in Time Series: A Surveycited by 497
- 2021Monash Time Series Forecasting Archivecited by 267
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 100
- 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
- 2021Darts: User-Friendly Modern Machine Learning for Time Seriescited by 91
- 2017RUBER: An Unsupervised Method for Automatic Evaluation of Open-Domain Dialog Systemscited by 88
- 2023Goat: Fine-tuned LLaMA Outperforms GPT-4 on Arithmetic Taskscited by 84
- 2020RobustTAD: Robust Time Series Anomaly Detection via Decomposition and Convolutional Neural Networkscited by 55
- 2022Forecast Evaluation for Data Scientists: Common Pitfalls and Best Practicescited by 55
Built on by
Citing papers per year: 2025: 4.
4 papers.
- 2025A Survey of Reasoning and Agentic Systems in Time Series with Large Language Modelscited by 21
- 2025Through the Prism of Culture: Evaluating LLMs' Understanding of Indian Subcultures and Traditionscited by 4
- 2025In-Context and Few-Shots Learning for Forecasting Time Series Data based on Large Language Modelscited by 2
- 2025AR-KAN: Autoregressive-Weight-Enhanced Kolmogorov-Arnold Network for Time Series Forecastingcited by 0
- 2025In-Context and Few-Shots Learning for Forecasting Time Series Data based on Large Language Models8 Dec 2025
- 2025A Survey of Reasoning and Agentic Systems in Time Series with Large Language Models15 Sep 2025
- 2025AR-KAN: Autoregressive-Weight-Enhanced Kolmogorov-Arnold Network for Time Series Forecasting3 Sep 2025
- 2025Through the Prism of Culture: Evaluating LLMs' Understanding of Indian Subcultures and Traditions28 Jan 2025