mlsanityData to 7 Oct 2026

Deep learning for universal linear embeddings of nonlinear dynamics

arXiv 1712.09707 ↗First posted 27 Dec 2017math.DS cs.LG stat.MLcited by 491

Not on the map. Why?

Abstract (arXiv)

Identifying coordinate transformations that make strongly nonlinear dynamics approximately linear is a central challenge in modern dynamical systems. These transformations have the potential to enable prediction, estimation, and control of nonlinear systems using standard linear theory. The Koopman operator has emerged as a leading data-driven embedding, as eigenfunctions of this operator provide intrinsic coordinates that globally linearize the dynamics. However, identifying and representing these eigenfunctions has proven to be mathematically and computationally challenging. This work leverages the power of deep learning to discover representations of Koopman eigenfunctions from trajectory data of dynamical systems. Our network is parsimonious and interpretable by construction, embedding the dynamics on a low-dimensional manifold that is of the intrinsic rank of the dynamics and parameterized by the Koopman eigenfunctions. In particular, we identify nonlinear coordinates on which the dynamics are globally linear using a modified auto-encoder. We also generalize Koopman representations to include a ubiquitous class of systems that exhibit continuous spectra, ranging from the simple pendulum to nonlinear optics and broadband turbulence. Our framework parametrizes the continuous frequency using an auxiliary network, enabling a compact and efficient embedding at the intrinsic rank, while connecting our models to half a century of asymptotics. In this way, we benefit from the power and generality of deep learning, while retaining the physical interpretability of Koopman embeddings.

Key facts. Cited by 491 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Dec 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 66; 2022: 67; 2023: 79; 2024: 74; 2025: 103; 2026: 102.

491 papers.

Sort:

By area:

  1. 2021Machine learning accelerated computational fluid dynamicscited by 461
  2. 2026Causal World Modeling for Robot Controlcited by 289
  3. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  4. 2021Modern Koopman Theory for Dynamical Systemscited by 269
  5. 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
  6. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 110
  7. 2021Learned Coarse Models for Efficient Turbulence Simulationcited by 90
  8. 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
  9. 2021Chaos as an interpretable benchmark for forecasting and data-driven modellingcited by 87
  10. 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 82
  11. 2022Rediscovering orbital mechanics with machine learningcited by 71
  12. 2022Learning Dynamical Systems via Koopman Operator Regression in Reproducing Kernel Hilbert Spacescited by 66
38 more
  1. 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulationcited by 65
  2. 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
  3. 2021Encoding physics to learn reaction-diffusion processescited by 61
  4. 2022Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoderscited by 58
  5. 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 56
  6. 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
  7. 2022Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systemscited by 50
  8. 2023Generative Modeling of Regular and Irregular Time Series Data via Koopman VAEscited by 48
  9. 2021Data-driven discovery of intrinsic dynamicscited by 45
  10. 2024Frequency Adaptive Normalization For Non-stationary Time Series Forecastingcited by 45
  11. 2021Towards extraction of orthogonal and parsimonious non-linear modes from turbulent flowscited by 44
  12. 2021Rigorous data-driven computation of spectral properties of Koopman operators for dynamical systemscited by 44
  13. 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
  14. 2021Solving PDE-constrained Control Problems Using Operator Learningcited by 41
  15. 2024ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Predictioncited by 40
  16. 2022Learned Turbulence Modelling with Differentiable Fluid Solvers: Physics-based Loss-functions and Optimisation Horizonscited by 39
  17. 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37
  18. 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
  19. 2021Deeptime: a Python library for machine learning dynamical models from time series datacited by 36
  20. 2023Interpretable Machine Learning for Science with PySR and SymbolicRegression.jlcited by 36
  21. 2022Koopman Neural Forecaster for Time Series with Temporal Distribution Shiftscited by 35
  22. 2023Deep networks for system identification: a Surveycited by 35
  23. 2023Discovering Causal Relations and Equations from Datacited by 33
  24. 2024Out-of-Domain Generalization in Dynamical Systems Reconstructioncited by 33
  25. 2026Temporal Straightening for Latent Planningcited by 32
  26. 2026Native Video-Action Pretraining for Generalizable Robot Controlcited by 30
  27. 2022Learning Sparse Nonlinear Dynamics via Mixed-Integer Optimizationcited by 29
  28. 2022Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutionscited by 29
  29. 2023Koopman neural operator as a mesh-free solver of non-linear partial differential equationscited by 29
  30. 2023Self-Supervised Learning with Lie Symmetries for Partial Differential Equationscited by 29
  31. 2024How JEPA Avoids Noisy Features: The Implicit Bias of Deep Linear Self Distillation Networkscited by 29
  32. 2021Data-Driven Reduced-Order Modeling of Spatiotemporal Chaos with Neural Ordinary Differential Equationscited by 28
  33. 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
  34. 2024Wavelet Diffusion Neural Operatorcited by 28
  35. 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
  36. 2023Predicting Ordinary Differential Equations with Transformerscited by 26
  37. 2021Discovering Sparse Interpretable Dynamics from Partial Observationscited by 25
  38. 2022Data-Driven Modeling and Prediction of Non-Linearizable Dynamics via Spectral Submanifoldscited by 25

50 most cited of 491 All 491 (JSON)