mlsanityData to 7 Oct 2026

STELLA: Guiding Large Language Models for Time Series Forecasting with Semantic Abstractions

arXiv 2512.04871 ↗First posted 4 Dec 2025cs.AI cs.CL cs.LGcited by 0

On the map: LLM reasoning → Time series reasoning

Abstract (arXiv)

Recent adaptations of Large Language Models (LLMs) for time series forecasting often fail to effectively enhance information for raw series, leaving LLM reasoning capabilities underutilized. Existing prompting strategies rely on static correlations rather than generative interpretations of dynamic behavior, lacking critical global and instance-specific context. To address this, we propose STELLA (Semantic-Temporal Alignment with Language Abstractions), a framework that systematically mines and injects structured supplementary and complementary information. STELLA employs a dynamic semantic abstraction mechanism that decouples input series into trend, seasonality, and residual components. It then translates intrinsic behavioral features of these components into Hierarchical Semantic Anchors: a Corpus-level Semantic Prior (CSP) for global context and a Fine-grained Behavioral Prompt (FBP) for instance-level patterns. Using these anchors as prefix-prompts, STELLA guides the LLM to model intrinsic dynamics. Experiments on eight benchmark datasets demonstrate that STELLA outperforms state-of-the-art methods in long- and short-term forecasting, showing superior generalization in zero-shot and few-shot settings. Ablation studies further validate the effectiveness of our dynamically generated semantic anchors.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Time series reasoning, one of 17 directions in LLM reasoning. Builds on 55 of its 75 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

55 of 75 references.

References · 55

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2020Language Models are Few-Shot Learnerscited by 32,199
  6. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  7. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  8. 2023GPT-4 Technical Reportcited by 18,132
  9. 2022Training language models to follow instructions with human feedbackcited by 15,712
  10. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  11. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  12. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
38 more
  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  3. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  4. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  5. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  6. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  7. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  8. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  9. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  10. 2020Reformer: The Efficient Transformercited by 1,658
  11. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  12. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  13. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  14. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  15. 2021Learning to Prompt for Continual Learningcited by 938
  16. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  17. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  18. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  19. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  20. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
  21. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  22. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  23. 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
  24. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  25. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  26. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
  27. 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
  28. 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
  29. 2023Large Language Models in Finance: A Surveycited by 223
  30. 2023FITS: Modeling Time Series with 10k Parameterscited by 185
  31. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
  32. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
  33. 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 165
  34. 2023TimeGPT-1cited by 149
  35. 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 139
  36. 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 91
  37. 2023Frozen Language Model Helps ECG Zero-Shot Learningcited by 62
  38. 2024Empowering Time Series Analysis with Large Language Models: A Surveycited by 60

50 most cited of 55 All 55 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Context information can be more important than reasoning for time series forecasting with a large language model
  2. 2025Conversational Time Series Foundation Models: Towards Explainable and Effective Forecasting
  3. 2024NeST: Neighborhood-aware semantic alignment and temporal modulation for LLM based time series forecasting
  4. 2026OpenTSLM TeeMoE: A Unified Time-Series Language Model for Forecasting, Contextual Prediction, and Reasoning
  5. 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Models
  6. 2025Enhancing Time Series Forecasting via Multi-Level Text Alignment with LLMs
  7. 2025DualSG: A Dual-Stream Explicit Semantic-Guided Multivariate Time Series Forecasting Framework
  8. 2024LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Prompting