Beyond Data Scarcity: A Frequency-Driven Framework for Zero-Shot Forecasting
Not on the map. Why?
Abstract (arXiv)
Time series forecasting is critical in numerous real-world applications, requiring accurate predictions of future values based on observed patterns. While traditional forecasting techniques work well in in-domain scenarios with ample data, they struggle when data is scarce or not available at all, motivating the emergence of zero-shot and few-shot learning settings. Recent advancements often leverage large-scale foundation models for such tasks, but these methods require extensive data and compute resources, and their performance may be hindered by ineffective learning from the available training set. This raises a fundamental question: What factors influence effective learning from data in time series forecasting? Toward addressing this, we propose using Fourier analysis to investigate how models learn from synthetic and real-world time series data. Our findings reveal that forecasters commonly suffer from poor learning from data with multiple frequencies and poor generalization to unseen frequencies, which impedes their predictive performance. To alleviate these issues, we present a novel synthetic data generation framework, designed to enhance real data or replace it completely by creating task-specific frequency information, requiring only the sampling rate of the target data. Our approach, Freq-Synth, improves the robustness of both foundation as well as nonfoundation forecast models in zero-shot and few-shot settings, facilitating more reliable time series forecasting under limited data scenarios.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 47 references that are in the map. First posted on arXiv 24 Nov 2024.
Builds on
26 of 47 references.
References · 26
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
14 more
- 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 299
- 2021Monash Time Series Forecasting Archivecited by 267
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
- 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 144
- 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 127
- 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 104
- 2022Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusioncited by 96
- 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
- 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Modelscited by 65
- 2023A Survey on Deep Learning based Time Series Analysis with Frequency Transformationcited by 40
- 2020Zero-shot and few-shot time series forecasting with ordinal regression recurrent neural networkscited by 10
- 2024An Unsupervised Approach for Periodic Source Detection in Time Seriescited by 5
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecastingcited by 17
- 2025Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Modelscited by 15
- 2025A Multi-Task Learning Approach to Linear Multivariate Forecastingcited by 3
- 2026XCTFormer: Leveraging Cross-Channel and Cross-Time Dependencies for Enhanced Time-Series Analysiscited by 1
- 2026XCTFormer: Leveraging Cross-Channel and Cross-Time Dependencies for Enhanced Time-Series Analysis18 May 2026
- 2025TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecasting29 Oct 2025
- 2025Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Models14 Mar 2025
- 2025A Multi-Task Learning Approach to Linear Multivariate Forecasting5 Feb 2025