mlsanityData to 14 Oct 2026

LLMForecaster: Improving Seasonal Event Forecasts with Unstructured Textual Data

arXiv 2412.02525 ↗First posted 3 Dec 2024cs.LG cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Modern time-series forecasting models often fail to make full use of rich unstructured information about the time series themselves. This lack of proper conditioning can lead to obvious model failures; for example, models may be unaware of the details of a particular product, and hence fail to anticipate seasonal surges in customer demand in the lead up to major exogenous events like holidays for clearly relevant products. To address this shortcoming, this paper introduces a novel forecast post-processor -- which we call LLMForecaster -- that fine-tunes large language models (LLMs) to incorporate unstructured semantic and contextual information and historical data to improve the forecasts from an existing demand forecasting pipeline. In an industry-scale retail application, we demonstrate that our technique yields statistically significantly forecast improvements across several sets of products subject to holiday-driven demand surges.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 15 of its 27 references that are in the map. First posted on arXiv 3 Dec 2024.

Builds on

15 of 27 references.

References · 15

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  4. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  5. 2024Chronos: Learning the Language of Time Seriescited by 759
  6. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  7. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  8. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
  9. 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasterscited by 129
  10. 2023Large Language Models are Few-Shot Health Learnerscited by 118
  11. 2023Where Would I Go Next? Large Language Models as Human Mobility Predictorscited by 93
  12. 2023Temporal Data Meets LLM -- Explainable Financial Time Series Forecastingcited by 77
3 more
  1. 2024Empowering Time Series Analysis with Large Language Models: A Surveycited by 60
  2. 2020MQTransformer: Multi-Horizon Forecasts with Context Dependent and Feedback-Aware Attentioncited by 29
  3. 2021Meta-Analysis of Randomized Experiments with Applications to Heavy-Tailed Response Datacited by 4

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.