mlsanityData to 14 Oct 2026

Sequential Reservoir Computing for Efficient High-Dimensional Spatiotemporal Forecasting

arXiv 2601.00172 ↗First posted 1 Jan 2026cs.LG cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

Forecasting high-dimensional spatiotemporal systems remains computationally challenging for recurrent neural networks (RNNs) and long short-term memory (LSTM) models due to gradient-based training and memory bottlenecks. Reservoir Computing (RC) mitigates these challenges by replacing backpropagation with fixed recurrent layers and a convex readout optimization, yet conventional RC architectures still scale poorly with input dimensionality. We introduce a Sequential Reservoir Computing (Sequential RC) architecture that decomposes a large reservoir into a series of smaller, interconnected reservoirs. This design reduces memory and computational costs while preserving long-term temporal dependencies. Using both low-dimensional chaotic systems (Lorenz63) and high-dimensional physical simulations (2D vorticity and shallow-water equations), Sequential RC achieves 15-25% longer valid forecast horizons, 20-30% lower error metrics (SSIM, RMSE), and up to three orders of magnitude lower training cost compared to LSTM and standard RNN baselines. The results demonstrate that Sequential RC maintains the simplicity and efficiency of conventional RC while achieving superior scalability for high-dimensional dynamical systems. This approach provides a practical path toward real-time, energy-efficient forecasting in scientific and engineering applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 39 references that are in the map. First posted on arXiv 1 Jan 2026.

Builds on

14 of 39 references.

References · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  5. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  6. 2019Backpropagation Algorithms and Reservoir Computing in Recurrent Neural Networks for the Forecasting of Complex Spatiotemporal Dynamicscited by 134
  7. 2017Recent Advances in Recurrent Neural Networkscited by 89
  8. 2021On the difficulty of learning chaotic dynamics with RNNscited by 67
  9. 2013How to Construct Deep Recurrent Neural Networkscited by 64
  10. 2022A Systematic Exploration of Reservoir Computing for Forecasting Complex Spatiotemporal Dynamicscited by 30
  11. 2020Are wider nets better given the same number of parameters?cited by 27
  12. 2020Deep Time-Delay Reservoir Computing: Dynamics and Memory Capacitycited by 10
2 more
  1. 2025Robust quantum reservoir computers for forecasting chaotic dynamics: generalized synchronization and stabilitycited by 5
  2. 2017Deep Reservoir Computing Using Cellular Automatacited by 4

Built on by

Not cited yet.