mlsanityData to 7 Oct 2026

LoFT-LLM: Low-Frequency Time-Series Forecasting with Large Language Models

arXiv 2512.20002 ↗First posted 23 Dec 2025cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Time-series forecasting in real-world applications such as finance and energy often faces challenges due to limited training data and complex, noisy temporal dynamics. Existing deep forecasting models typically supervise predictions using full-length temporal windows, which include substantial high-frequency noise and obscure long-term trends. Moreover, auxiliary variables containing rich domain-specific information are often underutilized, especially in few-shot settings. To address these challenges, we propose LoFT-LLM, a frequency-aware forecasting pipeline that integrates low-frequency learning with semantic calibration via a large language model (LLM). Firstly, a Patch Low-Frequency forecasting Module (PLFM) extracts stable low-frequency trends from localized spectral patches. Secondly, a residual learner then models high-frequency variations. Finally, a fine-tuned LLM refines the predictions by incorporating auxiliary context and domain knowledge through structured natural language prompts. Extensive experiments on financial and energy datasets demonstrate that LoFT-LLM significantly outperforms strong baselines under both full-data and few-shot regimes, delivering superior accuracy, robustness, and interpretability.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 48 references that are in the map. First posted on arXiv 23 Dec 2025.

Builds on

34 of 48 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  8. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  9. 2018On the Spectral Bias of Neural Networkscited by 1,321
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  11. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  12. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
22 more
  1. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  2. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  3. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  4. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  5. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
  6. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
  7. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
  8. 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
  9. 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 204
  10. 2023FITS: Modeling Time Series with 10k Parameterscited by 185
  11. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
  12. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
  13. 2023QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Modelscited by 154
  14. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
  15. 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflectioncited by 93
  16. 2024FreDF: Learning to Forecast in the Frequency Domaincited by 77
  17. 2022Masked Frequency Modeling for Self-Supervised Visual Pre-Trainingcited by 70
  18. 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Modelscited by 63
  19. 2025TimeKAN: KAN-based Frequency Decomposition Learning Architecture for Long-term Time Series Forecastingcited by 27
  20. 2025Efficient Multivariate Time Series Forecasting via Calibrated Language Models with Privileged Knowledge Distillationcited by 20
  21. 2023FreMIM: Fourier Transform Meets Masked Image Modeling for Medical Image Segmentationcited by 10
  22. 2022Robust Time Series Dissimilarity Measure for Outlier Detection and Periodicity Detectioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.