mlsanityData to 7 Oct 2026

Zero-shot Forecasting by Simulation Alone

arXiv 2601.00970 ↗First posted 2 Jan 2026cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Zero-shot time-series forecasting holds great promise, but is still in its infancy, hindered by limited and biased data corpora, leakage-prone evaluation, and privacy and licensing constraints. Motivated by these challenges, we propose the first practical univariate time series simulation pipeline which is simultaneously fast enough for on-the-fly data generation and enables notable zero-shot forecasting performance on M-Series and GiftEval benchmarks that capture trend/seasonality/intermittency patterns, typical of industrial forecasting applications across a variety of domains. Our simulator, which we call SarSim0 (SARIMA Simulator for Zero-Shot Forecasting), is based off of a seasonal autoregressive integrated moving average (SARIMA) model as its core data source. Due to instability in the autoregressive component, naive SARIMA simulation often leads to unusable paths. Instead, we follow a three-step procedure: (1) we sample well-behaved trajectories from its characteristic polynomial stability region; (2) we introduce a superposition scheme that combines multiple paths into rich multi-seasonality traces; and (3) we add rate-based heavy-tailed noise models to capture burstiness and intermittency alongside seasonalities and trends. SarSim0 is orders of magnitude faster than kernel-based generators, and it enables training on circa 1B unique purely simulated series, generated on the fly; after which well-established neural network backbones exhibit strong zero-shot generalization, surpassing strong statistical forecasters and recent foundation baselines, while operating under strict zero-shot protocol. Notably, on GiftEval we observe a "student-beats-teacher" effect: models trained on our simulations exceed the forecasting accuracy of the AutoARIMA generating processes.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 69 references that are in the map. First posted on arXiv 2 Jan 2026.

Builds on

32 of 69 references.

References · 32

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2014How transferable are features in deep neural networks?cited by 1,216
  8. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  9. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  10. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  11. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  12. 2023A decoder-only foundation model for time-series forecastingcited by 650
20 more
  1. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  2. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  3. 2021Monash Time Series Forecasting Archivecited by 256
  4. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
  5. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  6. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
  7. 2023TimeGPT-1cited by 149
  8. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
  9. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
  10. 2013Structure Discovery in Nonparametric Regression through Compositional Kernel Searchcited by 86
  11. 2021TorchAudio: Building Blocks for Audio and Speech Processingcited by 83
  12. 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
  13. 2020A machine learning approach for forecasting hierarchical time seriescited by 28
  14. 2025TimePFN: Effective Multivariate Time Series Forecasting with Synthetic Datacited by 27
  15. 2023AutoMixer for Improved Multivariate Time-Series Forecasting on Business and IT Observability Datacited by 17
  16. 2025Understanding Transformers for Time Series: Rank Structure, Flow-of-ranks, and Compressibilitycited by 8
  17. 2025Understanding the Implicit Biases of Design Choices for Time Series Foundation Modelscited by 8
  18. 2021Hierarchical forecasting with a top-down alignment of independent level forecastscited by 6
  19. 2024Towards Foundation Time Series Model: To Synthesize Or Not To Synthesize?cited by 4
  20. 2016Diurnal and Weekly Cycles in IPv6 Trafficcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.