mlsanityData to 7 Oct 2026

Forking-Sequences: Statistically and Computationally Efficient Multi-Horizon Forecasting with Reduced Volatility

arXiv 2510.04487 ↗First posted 6 Oct 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

While accuracy is a critical requirement for time series forecasting, an equally important desideratum is reasonable forecast volatility across forecast creation dates (FCDs). Even highly accurate models can produce erratic revisions between FCDs, undermining trust and disrupting downstream decision-making. To improve the volatility of forecast revisions, state-of-the-art models like MQCNN, MQT, and SPADE employ a powerful yet underexplored neural network architectural design: forking-sequences. This architectural design jointly encodes and decodes the entire time series across all FCDs, producing an entire multi-horizon forecast grid in a single forward pass. This approach contrasts with conventional neural forecasting methods that process FCDs independently, generating only a single multi-horizon forecast per forward pass. In this work, we formalize the forking-sequences design and motivate its broader adoption by introducing a metric for quantifying excess volatility in forecast revisions and by providing theoretical and empirical analysis. We theoretically motivate three key benefits of forking-sequences: (i) reduced forecast volatility through ensembling; (ii) gradient variance reduction, improving the statistical efficiency of the training procedure; and (iii) improved inference computational efficiency. We validate the benefits of forking-sequences compared to baseline window-sampling on the M-series benchmark, using 16 datasets from the M1, M3, M4, and Tourism competitions. We observe median sCRPS improvements across datasets of 46.2%, 49.3%, 28.6%, 24.7%, and 6.4% for RNN, LSTM, CNN, Transformer, and State Space-based architectures, respectively. We then show that forecast ensembling during inference can reduce median forecast volatility by 13.2%, 13.0%, 10.9%, 10.2%, and 11.2% for these respective models trained with forking-sequences, while maintaining accuracy.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 55 references that are in the map. First posted on arXiv 6 Oct 2025.

Builds on

22 of 55 references.

References · 22

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  5. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  6. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  7. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  8. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  9. 2023A decoder-only foundation model for time-series forecastingcited by 650
  10. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  11. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  12. 2015Semi-supervised Sequence Learningcited by 198
10 more
  1. 2015Learning to Diagnose with LSTM Recurrent Neural Networkscited by 99
  2. 2021Darts: User-Friendly Modern Machine Learning for Time Seriescited by 90
  3. 2017Dilated Recurrent Neural Networkscited by 83
  4. 2020MQTransformer: Multi-Horizon Forecasts with Context Dependent and Feedback-Aware Attentioncited by 29
  5. 2021Flexible Model Aggregation for Quantile Regressioncited by 22
  6. 2021Probabilistic Hierarchical Forecasting with Deep Poisson Mixturescited by 16
  7. 2024Using dynamic loss weighting to boost improvements in forecast stabilitycited by 4
  8. 2021Threshold Martingales and the Evolution of Forecastscited by 3
  9. 2023Global Deep Forecasting with Patient-Specific Pharmacokineticscited by 2
  10. 2025A More Realistic Evaluation of Cross-Frequency Transfer Learning and Foundation Forecasting Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.