STELLA: Guiding Large Language Models for Time Series Forecasting with Semantic Abstractions
On the map: LLM reasoning → Time series reasoning
Abstract (arXiv)
Recent adaptations of Large Language Models (LLMs) for time series forecasting often fail to effectively enhance information for raw series, leaving LLM reasoning capabilities underutilized. Existing prompting strategies rely on static correlations rather than generative interpretations of dynamic behavior, lacking critical global and instance-specific context. To address this, we propose STELLA (Semantic-Temporal Alignment with Language Abstractions), a framework that systematically mines and injects structured supplementary and complementary information. STELLA employs a dynamic semantic abstraction mechanism that decouples input series into trend, seasonality, and residual components. It then translates intrinsic behavioral features of these components into Hierarchical Semantic Anchors: a Corpus-level Semantic Prior (CSP) for global context and a Fine-grained Behavioral Prompt (FBP) for instance-level patterns. Using these anchors as prefix-prompts, STELLA guides the LLM to model intrinsic dynamics. Experiments on eight benchmark datasets demonstrate that STELLA outperforms state-of-the-art methods in long- and short-term forecasting, showing superior generalization in zero-shot and few-shot settings. Ablation studies further validate the effectiveness of our dynamically generated semantic anchors.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Time series reasoning, one of 17 directions in LLM reasoning. Builds on 55 of its 75 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
55 of 75 references.
References · 55
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
38 more
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2020Reformer: The Efficient Transformercited by 1,658
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2021Learning to Prompt for Continual Learningcited by 938
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 635
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
- 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
- 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
- 2023Large Language Models in Finance: A Surveycited by 223
- 2023FITS: Modeling Time Series with 10k Parameterscited by 185
- 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
- 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 165
- 2023TimeGPT-1cited by 149
- 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 139
- 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 91
- 2023Frozen Language Model Helps ECG Zero-Shot Learningcited by 62
- 2024Empowering Time Series Analysis with Large Language Models: A Surveycited by 60
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Context information can be more important than reasoning for time series forecasting with a large language model
- 2025Conversational Time Series Foundation Models: Towards Explainable and Effective Forecasting
- 2024NeST: Neighborhood-aware semantic alignment and temporal modulation for LLM based time series forecasting
- 2026OpenTSLM TeeMoE: A Unified Time-Series Language Model for Forecasting, Contextual Prediction, and Reasoning
- 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Models
- 2025Enhancing Time Series Forecasting via Multi-Level Text Alignment with LLMs
- 2025DualSG: A Dual-Stream Explicit Semantic-Guided Multivariate Time Series Forecasting Framework
- 2024LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Prompting