Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoders
Not on the map. Why?
Abstract (arXiv)
A central challenge in data-driven model discovery is the presence of hidden, or latent, variables that are not directly measured but are dynamically important. Takens' theorem provides conditions for when it is possible to augment these partial measurements with time delayed information, resulting in an attractor that is diffeomorphic to that of the original full-state system. However, the coordinate transformation back to the original attractor is typically unknown, and learning the dynamics in the embedding space has remained an open challenge for decades. Here, we design a custom deep autoencoder network to learn a coordinate transformation from the delay embedded space into a new space where it is possible to represent the dynamics in a sparse, closed form. We demonstrate this approach on the Lorenz, R"ossler, and Lotka-Volterra systems, learning dynamics from a single measurement variable. As a challenging example, we learn a Lorenz analogue from a single scalar variable extracted from a video of a chaotic waterwheel experiment. The resulting modeling framework combines deep learning to uncover effective coordinates and the sparse identification of nonlinear dynamics (SINDy) for interpretable modeling. Thus, we show that it is possible to simultaneously learn a closed-form model and the associated coordinate system for partially observed dynamics.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 23 of its 105 references that are in the map. First posted on arXiv 13 Jan 2022.
Builds on
23 of 105 references.
References · 23
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
- 2019Machine Learning for Fluid Mechanicscited by 380
- 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 156
- 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
- 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 142
- 2017Sparse identification of nonlinear dynamics for model predictive control in the low-data limitcited by 139
- 2017VAMPnets: Deep learning of molecular kineticscited by 135
- 2021Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and controlcited by 134
- 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 125
- 2021PySINDy: A comprehensive Python package for robust sparse system identificationcited by 88
- 2017Sparse learning of stochastic dynamic equationscited by 76
- 2017Time-lagged autoencoders: Deep learning of slow collective variables for molecular kineticscited by 64
11 more
- 2014Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decompositioncited by 49
- 2019Deep learning to discover and predict dynamics on an inertial manifoldcited by 42
- 2021Discovering Sparse Interpretable Dynamics from Partial Observationscited by 25
- 2018Data-driven Discovery of Closure Modelscited by 19
- 2018Deep Generative Markov State Modelscited by 19
- 2021Learning normal form autoencoders for data-driven discovery of universal,parameter-dependent governing equationscited by 15
- 2020Data-Driven Discovery of Coarse-Grained Equationscited by 14
- 2020Uncovering differential equations from data with hidden variablescited by 8
- 2018Linking Gaussian Process regression with data-driven manifold embeddings for nonlinear data fusioncited by 6
- 2020Bayesian Hidden Physics Models: Uncertainty Quantification for Discovery of Nonlinear Partial Differential Operators from Datacited by 4
- 2020Deep reconstruction of strange attractors from time seriescited by 1
Built on by
Citing papers per year: 2022: 12; 2023: 12; 2024: 17; 2025: 9; 2026: 8.
58 papers.
Sort:
- 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
- 2022Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systemscited by 34
- 2022Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutionscited by 29
- 2023Predicting Ordinary Differential Equations with Transformerscited by 26
- 2022Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constantscited by 24
- 2024SINDy-RL: Interpretable and Efficient Model-Based Reinforcement Learningcited by 24
- 2022Dimensionally Consistent Learning with Buckingham Picited by 20
- 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
- 2025Sparse identification of nonlinear dynamics and Koopman operators with Shallow Recurrent Decoder Networkscited by 19
- 2023Multi-fidelity reduced-order surrogate modelingcited by 18
- 2022Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effectscited by 15
- 2023Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discoverycited by 15
38 more
- 2024On latent dynamics learning in nonlinear reduced order modelingcited by 14
- 2022Deep Learning of Chaotic Systems from Partially-Observed Datacited by 9
- 2023AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regressioncited by 9
- 2024Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Expertscited by 9
- 2024Learning Physics Informed Neural ODEs With Partial Measurementscited by 9
- 2022Recognition Models to Learn Dynamics from Partial Observations with Neural ODEscited by 8
- 2023Simultaneous identification of models and parameters of scientific simulatorscited by 8
- 2024Shallow Recurrent Decoder for Reduced Order Modeling of Plasma Dynamicscited by 8
- 2024VENI, VINDy, VICI: a generative reduced-order modeling framework with uncertainty quantificationcited by 8
- 2024Learning Governing Equations of Unobserved States in Dynamical Systemscited by 7
- 2022Expressive architectures enhance interpretability of dynamics-based neural population modelscited by 6
- 2023Low-dimensional Data-based Surrogate Model of a Continuum-mechanical Musculoskeletal System Based on Non-intrusive Model Order Reductioncited by 6
- 2022Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learningcited by 5
- 2023Recurrences reveal shared causal drivers of complex time seriescited by 5
- 2024Data Assimilation in Chaotic Systems Using Deep Reinforcement Learningcited by 5
- 2024Statistical Mechanics of Dynamical System Identificationcited by 5
- 2023On the effectiveness of neural priors in modeling dynamical systemscited by 4
- 2026Explainable AI: Learning from the Learnerscited by 4
- 2024Data-driven identification of latent port-Hamiltonian systemscited by 3
- 2024Learning Macroscopic Dynamics from Partial Microscopic Observationscited by 3
- 2022Data-driven synchronization-avoiding algorithms in the explicit distributed structural analysis of soft tissuecited by 2
- 2023MOCK: an Algorithm for Learning Nonparametric Differential Equations via Multivariate Occupation Kernel Functionscited by 2
- 2024Measure-Theoretic Time-Delay Embeddingcited by 2
- 2024Interpretable and Efficient Data-driven Discovery and Control of Distributed Systemscited by 2
- 2025Data-efficient Kernel Methods for Learning Hamiltonian Systemscited by 2
- 2023Inferring Inferencecited by 1
- 2024Sparse identification of nonlinear dynamics in the presence of library and system uncertaintycited by 1
- 2024Recurrent Deep Kernel Learning of Dynamical Systemscited by 1
- 2024Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddingscited by 1
- 2025SODAs: Sparse Optimization for the Discovery of Differential and Algebraic Equationscited by 1
- 2025ROCK: A variational formulation for occupation kernel methods in Reproducing Kernel Hilbert Spacescited by 1
- 2025Variational Rank Reduction Autoencoders for Generative Thermal Designcited by 1
- 2025Learning Physically Consistent Lagrangian Control Models Without Acceleration Measurementscited by 1
- 2026Fourier Weak SINDy: Spectral Test Function Selection for Robust Model Identificationcited by 1
- 2026Discovering Latent Response Laws in Forced Physical Systemscited by 1
- 2022Dynamic Structure Estimation from Bandit Feedback using Nonvanishing Exponential Sumscited by 0
- 2022Borch: A Deep Universal Probabilistic Programming Languagecited by 0
- 2024SINDy vs Hard Nonlinearities and Hidden Dynamics: a Benchmarking Studycited by 0
50 most cited of 58 All 58 (JSON)
- 2026Retracing Hodgkin and Huxley: State Recovery Does Not Certify Mechanism28 Sep 2026
- 2026Learning Prognostic Variables for AI Convective Parameterizations via Symbolic Distillation21 Sep 2026
- 2026An Introduction to Sparse Identification of Nonlinear Dynamics for Engineering Applications16 Jul 2026
- 2026Discovering Latent Response Laws in Forced Physical Systems9 Jul 2026
- 2026Learning Control-Affine Reduced-Order Models via Autoencoders3 Jun 2026
- 2026Fourier Weak SINDy: Spectral Test Function Selection for Robust Model Identification22 Apr 2026
- 2026Deep Invertible Autoencoders for Dimensionality Reduction of Dynamical Systems13 Mar 2026
- 2026Explainable AI: Learning from the Learners9 Jan 2026
- 2025Learning Physically Consistent Lagrangian Control Models Without Acceleration Measurements2 Dec 2025
- 2025A joint optimization approach to identifying sparse dynamics using least squares kernel collocation23 Nov 2025
- 2025Data-efficient Kernel Methods for Learning Hamiltonian Systems21 Sep 2025
- 2025Variational Rank Reduction Autoencoders for Generative Thermal Design10 Sep 2025
38 more
- 2025SINDy on slow manifolds1 Jul 2025
- 2025Automated Manifold Learning for Reduced Order Modeling2 Jun 2025
- 2025ROCK: A variational formulation for occupation kernel methods in Reproducing Kernel Hilbert Spaces18 Mar 2025
- 2025SODAs: Sparse Optimization for the Discovery of Differential and Algebraic Equations8 Mar 2025
- 2025Sparse identification of nonlinear dynamics and Koopman operators with Shallow Recurrent Decoder Networks23 Jan 2025
- 2024Learning Physics Informed Neural ODEs With Partial Measurements11 Dec 2024
- 2024Interpretable and Efficient Data-driven Discovery and Control of Distributed Systems6 Nov 2024
- 2024Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddings1 Nov 2024
- 2024Learning Macroscopic Dynamics from Partial Microscopic Observations31 Oct 2024
- 2024Measure-Theoretic Time-Delay Embedding13 Sep 2024
- 2024On latent dynamics learning in nonlinear reduced order modeling27 Aug 2024
- 2024Data-driven identification of latent port-Hamiltonian systems15 Aug 2024
- 2024VENI, VINDy, VICI: a generative reduced-order modeling framework with uncertainty quantification31 May 2024
- 2024Recurrent Deep Kernel Learning of Dynamical Systems30 May 2024
- 2024Shallow Recurrent Decoder for Reduced Order Modeling of Plasma Dynamics20 May 2024
- 2024Learning Governing Equations of Unobserved States in Dynamical Systems29 Apr 2024
- 2024SINDy-RL: Interpretable and Efficient Model-Based Reinforcement Learning14 Mar 2024
- 2024Statistical Mechanics of Dynamical System Identification4 Mar 2024
- 2024SINDy vs Hard Nonlinearities and Hidden Dynamics: a Benchmarking Study1 Mar 2024
- 2024Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Experts6 Feb 2024
- 2024Sparse identification of nonlinear dynamics in the presence of library and system uncertainty23 Jan 2024
- 2024Data Assimilation in Chaotic Systems Using Deep Reinforcement Learning1 Jan 2024
- 2023AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regression21 Dec 2023
- 2023Inferring Inference4 Oct 2023
- 2023Multi-fidelity reduced-order surrogate modeling1 Sep 2023
- 2023Predicting Ordinary Differential Equations with Transformers24 Jul 2023
- 2023MOCK: an Algorithm for Learning Nonparametric Differential Equations via Multivariate Occupation Kernel Functions16 Jun 2023
- 2023Generalized Teacher Forcing for Learning Chaotic Dynamics7 Jun 2023
- 2023Simultaneous identification of models and parameters of scientific simulators24 May 2023
- 2023On the effectiveness of neural priors in modeling dynamical systems10 Mar 2023
- 2023Low-dimensional Data-based Surrogate Model of a Continuum-mechanical Musculoskeletal System Based on Non-intrusive Model Order Reduction13 Feb 2023
- 2023Benchmarking sparse system identification with low-dimensional chaos4 Feb 2023
- 2023Recurrences reveal shared causal drivers of complex time series31 Jan 2023
- 2023Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discovery30 Jan 2023
- 2022Expressive architectures enhance interpretability of dynamics-based neural population models7 Dec 2022
- 2022Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constants19 Nov 2022
- 2022Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutions13 Nov 2022
- 2022Borch: A Deep Universal Probabilistic Programming Language13 Sep 2022
50 newest of 58 All 58 (JSON)
- 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
- 2022Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systemscited by 34
- 2022Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutionscited by 29
- 2023Predicting Ordinary Differential Equations with Transformerscited by 26
- 2022Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constantscited by 24
- 2024SINDy-RL: Interpretable and Efficient Model-Based Reinforcement Learningcited by 24
- 2022Dimensionally Consistent Learning with Buckingham Picited by 20
- 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
- 2025Sparse identification of nonlinear dynamics and Koopman operators with Shallow Recurrent Decoder Networkscited by 19
- 2023Multi-fidelity reduced-order surrogate modelingcited by 18
- 2022Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effectscited by 15
- 2023Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discoverycited by 15
12 most cited of 58 All 58 (JSON)
- 2026Retracing Hodgkin and Huxley: State Recovery Does Not Certify Mechanism28 Sep 2026
- 2026Learning Prognostic Variables for AI Convective Parameterizations via Symbolic Distillation21 Sep 2026
- 2026An Introduction to Sparse Identification of Nonlinear Dynamics for Engineering Applications16 Jul 2026
- 2026Discovering Latent Response Laws in Forced Physical Systems9 Jul 2026
- 2026Learning Control-Affine Reduced-Order Models via Autoencoders3 Jun 2026
- 2026Fourier Weak SINDy: Spectral Test Function Selection for Robust Model Identification22 Apr 2026
- 2026Deep Invertible Autoencoders for Dimensionality Reduction of Dynamical Systems13 Mar 2026
- 2026Explainable AI: Learning from the Learners9 Jan 2026
- 2025Learning Physically Consistent Lagrangian Control Models Without Acceleration Measurements2 Dec 2025
- 2025A joint optimization approach to identifying sparse dynamics using least squares kernel collocation23 Nov 2025
- 2025Data-efficient Kernel Methods for Learning Hamiltonian Systems21 Sep 2025
- 2025Variational Rank Reduction Autoencoders for Generative Thermal Design10 Sep 2025
12 newest of 58 All 58 (JSON)