mlsanityData to 7 Oct 2026

Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoders

arXiv 2201.05136 ↗First posted 13 Jan 2022cs.LG cs.CE math.DScited by 58

Not on the map. Why?

Abstract (arXiv)

A central challenge in data-driven model discovery is the presence of hidden, or latent, variables that are not directly measured but are dynamically important. Takens' theorem provides conditions for when it is possible to augment these partial measurements with time delayed information, resulting in an attractor that is diffeomorphic to that of the original full-state system. However, the coordinate transformation back to the original attractor is typically unknown, and learning the dynamics in the embedding space has remained an open challenge for decades. Here, we design a custom deep autoencoder network to learn a coordinate transformation from the delay embedded space into a new space where it is possible to represent the dynamics in a sparse, closed form. We demonstrate this approach on the Lorenz, R"ossler, and Lotka-Volterra systems, learning dynamics from a single measurement variable. As a challenging example, we learn a Lorenz analogue from a single scalar variable extracted from a video of a chaotic waterwheel experiment. The resulting modeling framework combines deep learning to uncover effective coordinates and the sparse identification of nonlinear dynamics (SINDy) for interpretable modeling. Thus, we show that it is possible to simultaneously learn a closed-form model and the associated coordinate system for partially observed dynamics.

Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 23 of its 105 references that are in the map. First posted on arXiv 13 Jan 2022.

Builds on

23 of 105 references.

References · 23

  1. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  2. 2019Machine Learning for Fluid Mechanicscited by 380
  3. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 156
  4. 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
  5. 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 142
  6. 2017Sparse identification of nonlinear dynamics for model predictive control in the low-data limitcited by 139
  7. 2017VAMPnets: Deep learning of molecular kineticscited by 135
  8. 2021Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and controlcited by 134
  9. 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 125
  10. 2021PySINDy: A comprehensive Python package for robust sparse system identificationcited by 88
  11. 2017Sparse learning of stochastic dynamic equationscited by 76
  12. 2017Time-lagged autoencoders: Deep learning of slow collective variables for molecular kineticscited by 64
11 more
  1. 2014Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decompositioncited by 49
  2. 2019Deep learning to discover and predict dynamics on an inertial manifoldcited by 42
  3. 2021Discovering Sparse Interpretable Dynamics from Partial Observationscited by 25
  4. 2018Data-driven Discovery of Closure Modelscited by 19
  5. 2018Deep Generative Markov State Modelscited by 19
  6. 2021Learning normal form autoencoders for data-driven discovery of universal,parameter-dependent governing equationscited by 15
  7. 2020Data-Driven Discovery of Coarse-Grained Equationscited by 14
  8. 2020Uncovering differential equations from data with hidden variablescited by 8
  9. 2018Linking Gaussian Process regression with data-driven manifold embeddings for nonlinear data fusioncited by 6
  10. 2020Bayesian Hidden Physics Models: Uncertainty Quantification for Discovery of Nonlinear Partial Differential Operators from Datacited by 4
  11. 2020Deep reconstruction of strange attractors from time seriescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 12; 2023: 12; 2024: 17; 2025: 9; 2026: 8.

58 papers.

Sort:

  1. 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
  2. 2022Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systemscited by 34
  3. 2022Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutionscited by 29
  4. 2023Predicting Ordinary Differential Equations with Transformerscited by 26
  5. 2022Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constantscited by 24
  6. 2024SINDy-RL: Interpretable and Efficient Model-Based Reinforcement Learningcited by 24
  7. 2022Dimensionally Consistent Learning with Buckingham Picited by 20
  8. 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
  9. 2025Sparse identification of nonlinear dynamics and Koopman operators with Shallow Recurrent Decoder Networkscited by 19
  10. 2023Multi-fidelity reduced-order surrogate modelingcited by 18
  11. 2022Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effectscited by 15
  12. 2023Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discoverycited by 15
38 more
  1. 2024On latent dynamics learning in nonlinear reduced order modelingcited by 14
  2. 2022Deep Learning of Chaotic Systems from Partially-Observed Datacited by 9
  3. 2023AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regressioncited by 9
  4. 2024Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Expertscited by 9
  5. 2024Learning Physics Informed Neural ODEs With Partial Measurementscited by 9
  6. 2022Recognition Models to Learn Dynamics from Partial Observations with Neural ODEscited by 8
  7. 2023Simultaneous identification of models and parameters of scientific simulatorscited by 8
  8. 2024Shallow Recurrent Decoder for Reduced Order Modeling of Plasma Dynamicscited by 8
  9. 2024VENI, VINDy, VICI: a generative reduced-order modeling framework with uncertainty quantificationcited by 8
  10. 2024Learning Governing Equations of Unobserved States in Dynamical Systemscited by 7
  11. 2022Expressive architectures enhance interpretability of dynamics-based neural population modelscited by 6
  12. 2023Low-dimensional Data-based Surrogate Model of a Continuum-mechanical Musculoskeletal System Based on Non-intrusive Model Order Reductioncited by 6
  13. 2022Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learningcited by 5
  14. 2023Recurrences reveal shared causal drivers of complex time seriescited by 5
  15. 2024Data Assimilation in Chaotic Systems Using Deep Reinforcement Learningcited by 5
  16. 2024Statistical Mechanics of Dynamical System Identificationcited by 5
  17. 2023On the effectiveness of neural priors in modeling dynamical systemscited by 4
  18. 2026Explainable AI: Learning from the Learnerscited by 4
  19. 2024Data-driven identification of latent port-Hamiltonian systemscited by 3
  20. 2024Learning Macroscopic Dynamics from Partial Microscopic Observationscited by 3
  21. 2022Data-driven synchronization-avoiding algorithms in the explicit distributed structural analysis of soft tissuecited by 2
  22. 2023MOCK: an Algorithm for Learning Nonparametric Differential Equations via Multivariate Occupation Kernel Functionscited by 2
  23. 2024Measure-Theoretic Time-Delay Embeddingcited by 2
  24. 2024Interpretable and Efficient Data-driven Discovery and Control of Distributed Systemscited by 2
  25. 2025Data-efficient Kernel Methods for Learning Hamiltonian Systemscited by 2
  26. 2023Inferring Inferencecited by 1
  27. 2024Sparse identification of nonlinear dynamics in the presence of library and system uncertaintycited by 1
  28. 2024Recurrent Deep Kernel Learning of Dynamical Systemscited by 1
  29. 2024Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddingscited by 1
  30. 2025SODAs: Sparse Optimization for the Discovery of Differential and Algebraic Equationscited by 1
  31. 2025ROCK: A variational formulation for occupation kernel methods in Reproducing Kernel Hilbert Spacescited by 1
  32. 2025Variational Rank Reduction Autoencoders for Generative Thermal Designcited by 1
  33. 2025Learning Physically Consistent Lagrangian Control Models Without Acceleration Measurementscited by 1
  34. 2026Fourier Weak SINDy: Spectral Test Function Selection for Robust Model Identificationcited by 1
  35. 2026Discovering Latent Response Laws in Forced Physical Systemscited by 1
  36. 2022Dynamic Structure Estimation from Bandit Feedback using Nonvanishing Exponential Sumscited by 0
  37. 2022Borch: A Deep Universal Probabilistic Programming Languagecited by 0
  38. 2024SINDy vs Hard Nonlinearities and Hidden Dynamics: a Benchmarking Studycited by 0

50 most cited of 58 All 58 (JSON)