mlsanityData to 7 Oct 2026

Learnable Koopman-Enhanced Transformer-Based Time Series Forecasting with Spectral Control

arXiv 2602.02592 ↗First posted 1 Feb 2026cs.LG cs.AI cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper proposes a unified family of learnable Koopman operator parameterizations that integrate linear dynamical systems theory with modern deep learning forecasting architectures. We introduce four learnable Koopman variants-scalar-gated, per-mode gated, MLP-shaped spectral mapping, and low-rank Koopman operators which generalize and interpolate between strictly stable Koopman operators and unconstrained linear latent dynamics. Our formulation enables explicit control over the spectrum, stability, and rank of the linear transition operator while retaining compatibility with expressive nonlinear backbones such as Patchtst, Autoformer, and Informer. We evaluate the proposed operators in a large-scale benchmark that also includes LSTM, DLinear, and simple diagonal State-Space Models (SSMs), as well as lightweight transformer variants. Experiments across multiple horizons and patch lengths show that learnable Koopman models provide a favorable bias-variance trade-off, improved conditioning, and more interpretable latent dynamics. We provide a full spectral analysis, including eigenvalue trajectories, stability envelopes, and learned spectral distributions. Our results demonstrate that learnable Koopman operators are effective, stable, and theoretically principled components for deep forecasting.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 57 references that are in the map. First posted on arXiv 1 Feb 2026.

Builds on

31 of 57 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  8. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  9. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  10. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  11. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  12. 2022Simplified State Space Layers for Sequence Modelingcited by 776
19 more
  1. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
  2. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  3. 2021Modern Koopman Theory for Dynamical Systemscited by 269
  4. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  5. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  6. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 156
  7. 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 134
  8. 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 125
  9. 2020Forecasting Sequential Data using Consistent Koopman Autoencoderscited by 114
  10. 2019Deep Factors for Forecastingcited by 86
  11. 2018Deep Dynamical Modeling and Control of Unsteady Fluid Flowscited by 67
  12. 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
  13. 2020Dissipative Deep Neural Dynamical Systemscited by 12
  14. 2021Constrained Block Nonlinear Neural Dynamical Modelscited by 9
  15. 2022Representer Theorem for Learning Koopman Operatorscited by 9
  16. 2020A Shooting Formulation of Deep Learningcited by 8
  17. 2024Climate Aware Deep Neural Networks (CADNN) for Wind Power Simulationcited by 5
  18. 2020Parsimonious Quantile Regression of Financial Asset Tail Dynamics via Sequential Learningcited by 4
  19. 2021On the Stochastic Stability of Deep Markov Modelscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Principled Koopman Representations with Kalman Inference for Efficient Time-Series Prediction
  2. 2026Deep Spectral Learning of Embedded Latent Transfer Operators for Stochastic Dynamical Systems
  3. 2026Bilinear Mamba-Koopman Neural MPC for Varying Dynamics
  4. 2026Invertible continuous latent dynamic for long-term data assimilation in complex physical systems
  5. 2024Learning Stable Koopman Embeddings for Identification and Control
  6. 2025A Mechanistic Analysis of Transformers for Dynamical Systems
  7. 2026From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learning
  8. 2021Stochastic Adversarial Koopman Model for Dynamical Systems