LoFT-LLM: Low-Frequency Time-Series Forecasting with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Time-series forecasting in real-world applications such as finance and energy often faces challenges due to limited training data and complex, noisy temporal dynamics. Existing deep forecasting models typically supervise predictions using full-length temporal windows, which include substantial high-frequency noise and obscure long-term trends. Moreover, auxiliary variables containing rich domain-specific information are often underutilized, especially in few-shot settings. To address these challenges, we propose LoFT-LLM, a frequency-aware forecasting pipeline that integrates low-frequency learning with semantic calibration via a large language model (LLM). Firstly, a Patch Low-Frequency forecasting Module (PLFM) extracts stable low-frequency trends from localized spectral patches. Secondly, a residual learner then models high-frequency variations. Finally, a fine-tuned LLM refines the predictions by incorporating auxiliary context and domain knowledge through structured natural language prompts. Extensive experiments on financial and energy datasets demonstrate that LoFT-LLM significantly outperforms strong baselines under both full-data and few-shot regimes, delivering superior accuracy, robustness, and interpretability.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 48 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
34 of 48 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
22 more
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
- 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
- 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 204
- 2023FITS: Modeling Time Series with 10k Parameterscited by 185
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
- 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
- 2023QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Modelscited by 154
- 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
- 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflectioncited by 93
- 2024FreDF: Learning to Forecast in the Frequency Domaincited by 77
- 2022Masked Frequency Modeling for Self-Supervised Visual Pre-Trainingcited by 70
- 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Modelscited by 63
- 2025TimeKAN: KAN-based Frequency Decomposition Learning Architecture for Long-term Time Series Forecastingcited by 27
- 2025Efficient Multivariate Time Series Forecasting via Calibrated Language Models with Privileged Knowledge Distillationcited by 20
- 2023FreMIM: Fourier Transform Meets Masked Image Modeling for Medical Image Segmentationcited by 10
- 2022Robust Time Series Dissimilarity Measure for Outlier Detection and Periodicity Detectioncited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.