mlsanityData to 7 Oct 2026

SKOLR: Structured Koopman Operator Linear RNN for Time-Series Forecasting

arXiv 2506.14113 ↗First posted 17 Jun 2025cs.LG cs.AI stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Koopman operator theory provides a framework for nonlinear dynamical system analysis and time-series forecasting by mapping dynamics to a space of real-valued measurement functions, enabling a linear operator representation. Despite the advantage of linearity, the operator is generally infinite-dimensional. Therefore, the objective is to learn measurement functions that yield a tractable finite-dimensional Koopman operator approximation. In this work, we establish a connection between Koopman operator approximation and linear Recurrent Neural Networks (RNNs), which have recently demonstrated remarkable success in sequence modeling. We show that by considering an extended state consisting of lagged observations, we can establish an equivalence between a structured Koopman operator and linear RNN updates. Building on this connection, we present SKOLR, which integrates a learnable spectral decomposition of the input signal with a multilayer perceptron (MLP) as the measurement functions and implements a structured Koopman operator via a highly parallel linear RNN stack. Numerical experiments on various forecasting benchmarks and dynamical systems show that this streamlined, Koopman-theory-based design delivers exceptional performance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 54 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

33 of 54 references.

References · 33

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  3. 2020GLU Variants Improve Transformercited by 1,724
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  5. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  6. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  7. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  8. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  9. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  10. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  11. 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 696
  12. 2023A decoder-only foundation model for time-series forecastingcited by 650
21 more
  1. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  2. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  3. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
  4. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  5. 2021Modern Koopman Theory for Dynamical Systemscited by 269
  6. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 156
  7. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  8. 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 125
  9. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 110
  10. 2024Is Mamba Effective for Time Series Forecasting?cited by 110
  11. 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 103
  12. 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 78
  13. 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
  14. 2024SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attentioncited by 43
  15. 2021Koopman Operator Dynamical Models: Learning, Analysis and Controlcited by 42
  16. 2023BasisFormer: Attention-based Time Series Forecasting with Learnable and Interpretable Basiscited by 41
  17. 2023Multi-resolution Time-Series Transformer for Long-term Forecastingcited by 41
  18. 2022Koopman Neural Forecaster for Time Series with Temporal Distribution Shiftscited by 35
  19. 2024DAM: Towards A Foundation Model for Time Series Forecastingcited by 10
  20. 2022Representer Theorem for Learning Koopman Operatorscited by 9
  21. 2018Efficient Time-Series Approximation with Linear Recurrent Neural Networks: Architecture Learning and Predictive Powercited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.