mlsanityData to 7 Oct 2026

Estimating Koopman operators with sketching to provably learn large scale dynamical systems

arXiv 2306.04520 ↗First posted 7 Jun 2023stat.ML cs.LG math.DScited by 15

Not on the map. Why?

Abstract (arXiv)

The theory of Koopman operators allows to deploy non-parametric machine learning algorithms to predict and analyze complex dynamical systems. Estimators such as principal component regression (PCR) or reduced rank regression (RRR) in kernel spaces can be shown to provably learn Koopman operators from finite empirical observations of the system's time evolution. Scaling these approaches to very long trajectories is a challenge and requires introducing suitable approximations to make computations feasible. In this paper, we boost the efficiency of different kernel-based Koopman operator estimators using random projections (sketching). We derive, implement and test the new "sketched" estimators with extensive experiments on synthetic and large-scale molecular dynamics datasets. Further, we establish non asymptotic error bounds giving a sharp characterization of the trade-offs between statistical learning rates and computational efficiency. Our empirical and theoretical analysis shows that the proposed estimators provide a sound and efficient way to learn large scale dynamical systems. In particular our experiments indicate that the proposed estimators retain the same accuracy of PCR or RRR, while being much faster.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 24 of its 70 references that are in the map. First posted on arXiv 7 Jun 2023.

Builds on

24 of 70 references.

References · 24

  1. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  2. 2016Kernel Mean Embedding of Distributions: A Review and Beyondcited by 360
  3. 2021Modern Koopman Theory for Dynamical Systemscited by 269
  4. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 156
  5. 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 125
  6. 2017Sobolev Norm Learning Rates for Regularized Least-Squares Algorithmcited by 113
  7. 2015Less is More: Nystr"om Computational Regularizationcited by 89
  8. 2020Kernel methods through the roof: handling billions of points efficientlycited by 88
  9. 2017FALKON: An Optimal Large Scale Kernel Methodcited by 82
  10. 2013Revisiting the Nystrom Method for Improved Large-Scale Machine Learningcited by 76
  11. 2022Learning Dynamical Systems via Koopman Operator Regression in Reproducing Kernel Hilbert Spacescited by 66
  12. 2017Time-lagged autoencoders: Deep learning of slow collective variables for molecular kineticscited by 64
12 more
  1. 2022Optimal Rates for Regularized Conditional Mean Embedding Learningcited by 50
  2. 2017Eigendecompositions of Transfer Operators in Reproducing Kernel Hilbert Spacescited by 48
  3. 2018On Fast Leverage Score Sampling and Optimal Learningcited by 40
  4. 2020A General Framework for Consistent Structured Prediction with Implicit Loss Embeddingscited by 35
  5. 2016A Consistent Regularization Approach for Structured Predictioncited by 33
  6. 2018Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithmscited by 22
  7. 2021Kernel Learning for Robust Dynamic Mode Decomposition: Linear and Nonlinear Disambiguation Optimization (LANDO)cited by 22
  8. 2022Nystr"om Kernel Mean Embeddingscited by 21
  9. 2021Learning to Forecast Dynamical Systems from Streaming Datacited by 17
  10. 2018Singular Value Decomposition of Operators on Reproducing Kernel Hilbert Spacescited by 14
  11. 2023Toward Large Kernel Modelscited by 12
  12. 2023Sketch In, Sketch Out: Accelerating both Learning and Inference for Structured Prediction with Kernelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 7; 2025: 3; 2026: 3.

15 papers.

Sort:

By area: