StateFlow: Dual-State Recurrent Modeling for Long-Horizon Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Long-horizon multivariate time series forecasting (LTSF) remains challenging due to non-stationarity, regime shifts, and error accumulation. The Variability-Aware Recursive Neural Network (VARNN) is designed to track such variability by maintaining a residual-memory state driven by one-step prediction errors. However, its original formulation is limited to one-step sequence regression and does not directly support multi-step forecasting. In this work, we extend VARNN to long-horizon forecasting and introduce StateFlow, a recurrent forecasting framework that uses VARNN as a dual-state recurrent backbone to capture two complementary signals from the lookback sequence: a hidden-state trajectory representing primary temporal dynamics, including trend, seasonality, level changes, and recurring patterns, and a residual-memory trajectory representing structured local prediction deviations, driven from a nonlinear recurrent transformation of errors between one-step base predictions and observed values. A chunk-based decoder separately summarizes these trajectories and maps them to the future horizon for direct multi-step forecasting. We further employ a two-stage optimization strategy that first trains the VARNN encoder through a one-step base prediction objective to optimize the internal representations over the lookback sequence, and then trains a horizon-specific decoder for direct multi-step forecasting. Experiments on standard LTSF benchmarks show that StateFlow achieves competitive performance against strong linear, recurrent, convolutional, and Transformer-based baselines while preserving linear recurrent encoding and a compact model design.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
14 of 22 references.
References · 14
- 2017Attention Is All You Needcited by 60,106
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,157
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,016
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,665
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,413
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,206
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,193
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,043
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 918
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 756
- 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
Built on by
Not cited yet.