mlsanityData to 14 Oct 2026

Efficient Parametric SVD of Koopman Operator for Stochastic Dynamical Systems

arXiv 2507.07222 ↗First posted 9 Jul 2025cs.LG cs.NA math.DScited by 5

Not on the map. Why?

Abstract (arXiv)

The Koopman operator provides a principled framework for analyzing nonlinear dynamical systems through linear operator theory. Recent advances in dynamic mode decomposition (DMD) have shown that trajectory data can be used to identify dominant modes of a system in a data-driven manner. Building on this idea, deep learning methods such as VAMPnet and DPNet have been proposed to learn the leading singular subspaces of the Koopman operator. However, these methods require backpropagation through potentially numerically unstable operations on empirical second moment matrices, such as singular value decomposition and matrix inversion, during objective computation, which can introduce biased gradient estimates and hinder scalability to large systems. In this work, we propose a scalable and conceptually simple method for learning the top-k singular functions of the Koopman operator for stochastic dynamical systems based on the idea of low-rank approximation. Our approach eliminates the need for unstable linear-algebraic operations and integrates easily into modern deep learning pipelines. Empirical results demonstrate that the learned singular subspaces are both reliable and effective for downstream tasks such as eigen-analysis and multi-step prediction.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 23 of its 57 references that are in the map. First posted on arXiv 9 Jul 2025.

Builds on

23 of 57 references.

References · 23

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  3. 2015An Introduction to Matrix Concentration Inequalitiescited by 397
  4. 2021Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Losscited by 313
  5. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 158
  6. 2017VAMPnets: Deep learning of molecular kineticscited by 136
  7. 2020Forecasting Sequential Data using Consistent Koopman Autoencoderscited by 115
  8. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 113
  9. 2022Learning Dynamical Systems via Koopman Operator Regression in Reproducing Kernel Hilbert Spacescited by 67
  10. 2017Variational approach for learning Markov processes from time series datacited by 52
  11. 2022Koopman Neural Forecaster for Time Series with Temporal Distribution Shiftscited by 37
  12. 2022Residual Dynamic Mode Decomposition: Robust and verified Koopmanismcited by 36
11 more
  1. 2023Sharp Spectral Rates for Koopman Operator Learningcited by 36
  2. 2022SchNetPack 2.0: A neural network toolbox for atomistic machine learningcited by 29
  3. 2022NeuralEF: Deconstructing Kernels by Deep Neural Networkscited by 27
  4. 2020Neural Methods for Point-wise Dependency Estimationcited by 22
  5. 2018An Efficient Approach to Informative Feature Extraction from Multimodal Datacited by 21
  6. 2023Learning invariant representations of time-homogeneous stochastic dynamical systemscited by 17
  7. 2024Neural Conditional Probability for Uncertainty Quantificationcited by 14
  8. 2024Operator SVD with Neural Networks via Nested Low-Rank Approximationcited by 13
  9. 2022Spectral Representation Learning for Conditional Moment Modelscited by 12
  10. 2023Neural Feature Learning in Function Spacecited by 12
  11. 2025Self-Supervised Evolution Operator Learning for High-Dimensional Dynamical Systemscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.