mlsanityData to 14 Oct 2026

Beyond Data Scarcity: A Frequency-Driven Framework for Zero-Shot Forecasting

arXiv 2411.15743 ↗First posted 24 Nov 2024cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Time series forecasting is critical in numerous real-world applications, requiring accurate predictions of future values based on observed patterns. While traditional forecasting techniques work well in in-domain scenarios with ample data, they struggle when data is scarce or not available at all, motivating the emergence of zero-shot and few-shot learning settings. Recent advancements often leverage large-scale foundation models for such tasks, but these methods require extensive data and compute resources, and their performance may be hindered by ineffective learning from the available training set. This raises a fundamental question: What factors influence effective learning from data in time series forecasting? Toward addressing this, we propose using Fourier analysis to investigate how models learn from synthetic and real-world time series data. Our findings reveal that forecasters commonly suffer from poor learning from data with multiple frequencies and poor generalization to unseen frequencies, which impedes their predictive performance. To alleviate these issues, we present a novel synthetic data generation framework, designed to enhance real data or replace it completely by creating task-specific frequency information, requiring only the sampling rate of the target data. Our approach, Freq-Synth, improves the robustness of both foundation as well as nonfoundation forecast models in zero-shot and few-shot settings, facilitating more reliable time series forecasting under limited data scenarios.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 47 references that are in the map. First posted on arXiv 24 Nov 2024.

Builds on

26 of 47 references.

References · 26

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  4. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  5. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  6. 2024Chronos: Learning the Language of Time Seriescited by 759
  7. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  8. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  9. 2023A decoder-only foundation model for time-series forecastingcited by 692
  10. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  11. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  12. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
14 more
  1. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 299
  2. 2021Monash Time Series Forecasting Archivecited by 267
  3. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
  4. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
  5. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
  6. 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 144
  7. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 127
  8. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 104
  9. 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusioncited by 96
  10. 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
  11. 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Modelscited by 65
  12. 2023A Survey on Deep Learning based Time Series Analysis with Frequency Transformationcited by 40
  13. 2020Zero-shot and few-shot time series forecasting with ordinal regression recurrent neural networkscited by 10
  14. 2024An Unsupervised Approach for Periodic Source Detection in Time Seriescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.