mlsanityData to 7 Oct 2026

A Scalable and Transferable Time Series Prediction Framework for Demand Forecasting

arXiv 2402.19402 ↗First posted 29 Feb 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Time series forecasting is one of the most essential and ubiquitous tasks in many business problems, including demand forecasting and logistics optimization. Traditional time series forecasting methods, however, have resulted in small models with limited expressive power because they have difficulty in scaling their model size up while maintaining high accuracy. In this paper, we propose Forecasting orchestra (Forchestra), a simple but powerful framework capable of accurately predicting future demand for a diverse range of items. We empirically demonstrate that the model size is scalable to up to 0.8 billion parameters. The proposed method not only outperforms existing forecasting models with a significant margin, but it could generalize well to unseen data points when evaluated in a zero-shot fashion on downstream datasets. Last but not least, we present extensive qualitative and quantitative studies to analyze how the proposed model outperforms baseline models and differs from conventional approaches. The original paper was presented as a full paper at ICDM 2022 and is available at: https://ieeexplore.ieee.org/document/10027662.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 40 references that are in the map. First posted on arXiv 29 Feb 2024.

Builds on

18 of 40 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  6. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  7. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  8. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  9. 2023A decoder-only foundation model for time-series forecastingcited by 650
  10. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  11. 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
  12. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
6 more
  1. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
  2. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  3. 2023TimeGPT-1cited by 149
  4. 2019GluonTS: Probabilistic Time Series Models in Pythoncited by 45
  5. 2021A study on Ensemble Learning for Time Series Forecasting and the need for Meta-Learningcited by 10
  6. 2020A Worrying Analysis of Probabilistic Time-series Models for Sales Forecastingcited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.