Zero-shot Forecasting by Simulation Alone
Not on the map. Why?
Abstract (arXiv)
Zero-shot time-series forecasting holds great promise, but is still in its infancy, hindered by limited and biased data corpora, leakage-prone evaluation, and privacy and licensing constraints. Motivated by these challenges, we propose the first practical univariate time series simulation pipeline which is simultaneously fast enough for on-the-fly data generation and enables notable zero-shot forecasting performance on M-Series and GiftEval benchmarks that capture trend/seasonality/intermittency patterns, typical of industrial forecasting applications across a variety of domains. Our simulator, which we call SarSim0 (SARIMA Simulator for Zero-Shot Forecasting), is based off of a seasonal autoregressive integrated moving average (SARIMA) model as its core data source. Due to instability in the autoregressive component, naive SARIMA simulation often leads to unusable paths. Instead, we follow a three-step procedure: (1) we sample well-behaved trajectories from its characteristic polynomial stability region; (2) we introduce a superposition scheme that combines multiple paths into rich multi-seasonality traces; and (3) we add rate-based heavy-tailed noise models to capture burstiness and intermittency alongside seasonalities and trends. SarSim0 is orders of magnitude faster than kernel-based generators, and it enables training on circa 1B unique purely simulated series, generated on the fly; after which well-established neural network backbones exhibit strong zero-shot generalization, surpassing strong statistical forecasters and recent foundation baselines, while operating under strict zero-shot protocol. Notably, on GiftEval we observe a "student-beats-teacher" effect: models trained on our simulations exceed the forecasting accuracy of the AutoARIMA generating processes.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 69 references that are in the map. First posted on arXiv 2 Jan 2026.
Builds on
32 of 69 references.
References · 32
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2023A decoder-only foundation model for time-series forecastingcited by 650
20 more
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2021Monash Time Series Forecasting Archivecited by 256
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
- 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
- 2023TimeGPT-1cited by 149
- 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
- 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
- 2013Structure Discovery in Nonparametric Regression through Compositional Kernel Searchcited by 86
- 2021TorchAudio: Building Blocks for Audio and Speech Processingcited by 83
- 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
- 2020A machine learning approach for forecasting hierarchical time seriescited by 28
- 2025TimePFN: Effective Multivariate Time Series Forecasting with Synthetic Datacited by 27
- 2023AutoMixer for Improved Multivariate Time-Series Forecasting on Business and IT Observability Datacited by 17
- 2025Understanding Transformers for Time Series: Rank Structure, Flow-of-ranks, and Compressibilitycited by 8
- 2025Understanding the Implicit Biases of Design Choices for Time Series Foundation Modelscited by 8
- 2021Hierarchical forecasting with a top-down alignment of independent level forecastscited by 6
- 2024Towards Foundation Time Series Model: To Synthesize Or Not To Synthesize?cited by 4
- 2016Diurnal and Weekly Cycles in IPv6 Trafficcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026TiRex-2: Generalizing TiRex to Multivariate Data and Streamingcited by 10
- 2026Post-Training in Time Series Foundation Models: A Unifying Frameworkcited by 3
- 2026XCTFormer: Leveraging Cross-Channel and Cross-Time Dependencies for Enhanced Time-Series Analysiscited by 1
- 2026The Simulacrum: Decision-Theoretic Pretraining for Near-Optimal Time-Series Forecasting and Inferencecited by 0
- 2026Post-Training in Time Series Foundation Models: A Unifying Framework22 Jul 2026
- 2026TiRex-2: Generalizing TiRex to Multivariate Data and Streaming1 Jul 2026
- 2026The Simulacrum: Decision-Theoretic Pretraining for Near-Optimal Time-Series Forecasting and Inference26 Jun 2026
- 2026XCTFormer: Leveraging Cross-Channel and Cross-Time Dependencies for Enhanced Time-Series Analysis18 May 2026