mlsanityData to 14 Oct 2026

Understanding the Role of Textual Prompts in LLM for Time Series Forecasting: an Adapter View

arXiv 2311.14782 ↗First posted 24 Nov 2023cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

In the burgeoning domain of Large Language Models (LLMs), there is a growing interest in applying LLM to time series forecasting, with multiple studies focused on leveraging textual prompts to further enhance the predictive prowess. This study aims to understand how and why the integration of textual prompts into LLM can effectively improve the prediction accuracy of time series, which is not obvious at the glance, given the significant domain gap between texts and time series. Our extensive examination leads us to believe that (a) adding text prompts is roughly equivalent to introducing additional adapters, and (b) It is the introduction of learnable parameters rather than textual information that aligns the LLM with the time series forecasting task, ultimately enhancing prediction accuracy. Inspired by this discovery, we developed four adapters that explicitly address the gap between LLM and time series, and further improve the prediction accuracy. Overall,our work highlights how textual prompts enhance LLM accuracy in time series forecasting and suggests new avenues for continually improving LLM-based time series analysis.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 24 Nov 2023.

Builds on

31 of 45 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  7. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  8. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  9. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  10. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  11. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  12. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
19 more
  1. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  2. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  3. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  4. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  5. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  6. 2022Transformers in Time Series: A Surveycited by 497
  7. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 410
  8. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
  9. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  10. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 339
  11. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
  12. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 269
  13. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 172
  14. 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 169
  15. 2023TimeGPT-1cited by 158
  16. 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148
  17. 2022N-HiTS: Neural Hierarchical Interpolation for Time Series Forecastingcited by 146
  18. 2023DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detectioncited by 103
  19. 2022TFAD: A Decomposition Time Series Anomaly Detection Architecture with Time-Frequency Analysiscited by 48

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 2.

4 papers.