mlsanityData to 14 Oct 2026

Score the Algebra, Not the Span: Dimension Reduction for Transfer Operator Models of Dynamical Systems

arXiv 2608.18918 ↗First posted 19 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Dimension reduction for dynamical systems is standard practice, and the standard route is spectral: model the transfer (Koopman) operator by its leading modes. We show that on systems assembled from several weakly interacting components --- a structure common in physical and biological settings --- this may either require an exponential number of modes, or drop an entire component: the component is absent from the model rather than modeled coarsely, and no function of it can be predicted at any accuracy. We call this linear masking. The cause is that a rank-based model pays one coordinate per mode. We propose to score instead the σ-algebra the coordinates generate, so that products and powers come free and a component's cost is governed only by its generators rather than by all its interactions. The criterion is a chi2-divergence between the embedded present and future, and it carries a budget guarantee: twice the intrinsic dimension of the dynamics is enough coordinates for an embedding whose algebra carries the operator's entire spectrum, with its full infinite rank. In variational form the criterion admits off-the-shelf estimators, and restricting its critic to the bilinear class returns the VAMP score on the span, so rank-based methods are one end of the same family. We demonstrate the proposed objective on a composite of published benchmark systems. We exhibit examples where the rank-based methods completely miss the masked components at all ranks k<100, while ten algebra coordinates recover all of them. In addition, the resulting algebra representation supports predicting the masked components from few labels, while direct regression from the high-dimensional observation or from the VAMP features fail.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 68 references that are in the map. First posted on arXiv 19 Aug 2026.

Builds on

23 of 68 references.

References · 23

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 506
  4. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  5. 2021Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Losscited by 313
  6. 2021Modern Koopman Theory for Dynamical Systemscited by 276
  7. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 158
  8. 2017VAMPnets: Deep learning of molecular kineticscited by 136
  9. 2019Data-driven approximation of the Koopman generator: Model reduction, system identification, and controlcited by 85
  10. 2022Learning Dynamical Systems via Koopman Operator Regression in Reproducing Kernel Hilbert Spacescited by 67
  11. 2017Variational approach for learning Markov processes from time series datacited by 52
  12. 2017Eigendecompositions of Transfer Operators in Reproducing Kernel Hilbert Spacescited by 48
11 more
  1. 2018Spectral Inference Networks: Unifying Deep and Spectral Learningcited by 35
  2. 2022NeuralEF: Deconstructing Kernels by Deep Neural Networkscited by 27
  3. 2015Nonparametric Canonical Correlation Analysiscited by 22
  4. 2018An Efficient Approach to Informative Feature Extraction from Multimodal Datacited by 21
  5. 2023Learning invariant representations of time-homogeneous stochastic dynamical systemscited by 17
  6. 2024Neural Conditional Probability for Uncertainty Quantificationcited by 14
  7. 2025Self-Supervised Evolution Operator Learning for High-Dimensional Dynamical Systemscited by 7
  8. 2023Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneckcited by 6
  9. 2025Efficient Parametric SVD of Koopman Operator for Stochastic Dynamical Systemscited by 5
  10. 2020Discovering Causal Structure with Reproducing-Kernel Hilbert Space ε-Machinescited by 4
  11. 2023Information theory for dimensionality reduction in dynamical systemscited by 4

Built on by

Not cited yet.