Extracting Sparse High-Dimensional Dynamics from Limited Data
Not on the map. Why?
Abstract (arXiv)
Extracting governing equations from dynamic data is an essential task in model selection and parameter estimation. The form of the governing equation is rarely known a priori; however, based on the sparsity-of-effect principle one may assume that the number of candidate functions needed to represent the dynamics is very small. In this work, we leverage the sparse structure of the governing equations along with recent results from random sampling theory to develop methods for selecting dynamical systems from under-sampled data. In particular, we detail three sampling strategies that lead to the exact recovery of first-order dynamical systems when we are given fewer samples than unknowns. The first method makes no assumptions on the behavior of the data, and requires a certain number of random initial samples. The second method utilizes the structure of the governing equation to limit the number of random initializations needed. The third method leverages chaotic behavior in the data to construct a nearly deterministic sampling strategy. Using results from compressive sensing, we show that the strategies lead to exact recovery, which is stable to the sparse structure of the governing equations and robust to noise in the estimation of the velocity. Computational results validate each of the sampling strategies and highlight potential applications.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 11; 2023: 10; 2024: 8; 2025: 5; 2026: 2.
50 papers.
Sort:
- 2024Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolationcited by 45
- 2021Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Mapscited by 41
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2021Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Spacecited by 25
- 2021An Extensible Benchmark Suite for Learning to Simulate Physical Systemscited by 24
- 2023Learning Stochastic Dynamical System via Flow Map Operatorcited by 24
- 2021Generalization Bounds for Sparse Random Feature Expansionscited by 22
- 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
- 2023Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarkscited by 18
- 2023PROSE: Predicting Operators and Symbolic Expressions using Multimodal Transformerscited by 16
- 2024LeMON: Learning to Learn Multi-Operator Networkscited by 13
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filterscited by 12
38 more
- 2022Operator inference with roll outs for learning reduced models from scarce and low-quality datacited by 11
- 2022Random Feature Models for Learning Interacting Dynamical Systemscited by 10
- 2022Deep Learning of Chaotic Systems from Partially-Observed Datacited by 9
- 2022On the sample complexity of stabilizing linear dynamical systems from datacited by 8
- 2022A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterizationcited by 8
- 2024Modeling Unknown Stochastic Dynamical System Subject to External Excitationcited by 7
- 2021Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test casecited by 6
- 2024Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Modelcited by 6
- 2025When is a System Discoverable from Data? Discovery Requires Chaoscited by 6
- 2021Operator inference of non-Markovian terms for learning reduced models from partially observed state trajectoriescited by 5
- 2021Active operator inference for learning low-dimensional dynamical-system models from noisy datacited by 5
- 2022Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learningcited by 5
- 2024Statistical Mechanics of Dynamical System Identificationcited by 5
- 2021Bayesian data-driven discovery of partial differential equations with variable coefficientscited by 4
- 2022Modeling unknown dynamical systems with hidden parameterscited by 4
- 2022SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemicscited by 4
- 2024Dispersion based Recurrent Neural Network Model for Methane Monitoring in Albertan Tailings Pondscited by 4
- 2022Context-aware controller inference for stabilizing dynamical systems from scarce datacited by 3
- 2021Model discovery in the sparse sampling regimecited by 2
- 2021Adaptive Group Lasso Neural Network Models for Functions of Few Variables and Time-Dependent Datacited by 2
- 2023Data-Driven Model Selections of Second-Order Particle Dynamics via Integrating Gaussian Processes with Low-Dimensional Interacting Structurescited by 2
- 2024Minimum Reduced-Order Models via Causal Inferencecited by 2
- 2024System stabilization with policy optimization on unstable latent manifoldscited by 2
- 2025Data-driven Discovery of Digital Twins in Biomedical Researchcited by 2
- 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videoscited by 1
- 2021DeePN2: A deep learning-based non-Newtonian hydrodynamic modelcited by 1
- 2022Learning Fine Scale Dynamics from Coarse Observations via Inner Recurrencecited by 1
- 2026MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Datacited by 1
- 2026The Dynamics of Discoverability: How Trajectories and Priors Shape Equation Recoverycited by 1
- 2021Asymptotic Theory of ℓ1-Regularized PDE Identification from a Single Noisy Trajectorycited by 0
- 2022Deep neural network based adaptive learning for switched systemscited by 0
- 2023Critical Sampling for Robust Evolution Operator Learning of Unknown Dynamical Systemscited by 0
- 2023Automatically identifying ordinary differential equations from datacited by 0
- 2023Deep Learning based Spatially Dependent Acoustical Properties Recoverycited by 0
- 2023Improved identification accuracy in equation learning via comprehensive boldsymbolR2-elimination and Bayesian model selectioncited by 0
- 2025Optimizing Hard Thresholding for Sparse Model Discoverycited by 0
- 2025A Sparse Bayesian Learning Algorithm for Estimation of Interaction Kernels in Motsch-Tadmor Modelcited by 0
- 2025An adaptive data sampling strategy for stabilizing dynamical systems via controller inferencecited by 0
- 2026The Dynamics of Discoverability: How Trajectories and Priors Shape Equation Recovery20 Jul 2026
- 2026MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Data1 Apr 2026
- 2025When is a System Discoverable from Data? Discovery Requires Chaos12 Nov 2025
- 2025Data-driven Discovery of Digital Twins in Biomedical Research29 Aug 2025
- 2025An adaptive data sampling strategy for stabilizing dynamical systems via controller inference2 Jun 2025
- 2025A Sparse Bayesian Learning Algorithm for Estimation of Interaction Kernels in Motsch-Tadmor Model11 May 2025
- 2025Optimizing Hard Thresholding for Sparse Model Discovery28 Apr 2025
- 2024Dispersion based Recurrent Neural Network Model for Methane Monitoring in Albertan Tailings Ponds11 Nov 2024
- 2024Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model17 Sep 2024
- 2024LeMON: Learning to Learn Multi-Operator Networks28 Aug 2024
- 2024System stabilization with policy optimization on unstable latent manifolds8 Jul 2024
- 2024Minimum Reduced-Order Models via Causal Inference29 Jun 2024
38 more
- 2024Modeling Unknown Stochastic Dynamical System Subject to External Excitation22 Jun 2024
- 2024Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolation18 Apr 2024
- 2024Statistical Mechanics of Dynamical System Identification4 Mar 2024
- 2023Improved identification accuracy in equation learning via comprehensive boldsymbolR2-elimination and Bayesian model selection22 Nov 2023
- 2023Data-Driven Model Selections of Second-Order Particle Dynamics via Integrating Gaussian Processes with Low-Dimensional Interacting Structures1 Nov 2023
- 2023Deep Learning based Spatially Dependent Acoustical Properties Recovery17 Oct 2023
- 2023PROSE: Predicting Operators and Symbolic Expressions using Multimodal Transformers28 Sep 2023
- 2023Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarks20 Jul 2023
- 2023Learning Stochastic Dynamical System via Flow Map Operator5 May 2023
- 2023Automatically identifying ordinary differential equations from data21 Apr 2023
- 2023Critical Sampling for Robust Evolution Operator Learning of Unknown Dynamical Systems15 Apr 2023
- 2023Benchmarking sparse system identification with low-dimensional chaos4 Feb 2023
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filters27 Jan 2023
- 2022Random Feature Models for Learning Interacting Dynamical Systems11 Dec 2022
- 2022Operator inference with roll outs for learning reduced models from scarce and low-quality data2 Dec 2022
- 2022SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemics11 Nov 2022
- 2022A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterization19 Aug 2022
- 2022Context-aware controller inference for stabilizing dynamical systems from scarce data22 Jul 2022
- 2022Deep neural network based adaptive learning for switched systems11 Jul 2022
- 2022Learning Fine Scale Dynamics from Coarse Observations via Inner Recurrence3 Jun 2022
- 2022Deep Learning of Chaotic Systems from Partially-Observed Data12 May 2022
- 2022Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learning7 Mar 2022
- 2022On the sample complexity of stabilizing linear dynamical systems from data28 Feb 2022
- 2022Modeling unknown dynamical systems with hidden parameters3 Feb 2022
- 2021DeePN2: A deep learning-based non-Newtonian hydrodynamic model29 Dec 2021
- 2021Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case1 Oct 2021
- 2021Adaptive Group Lasso Neural Network Models for Functions of Few Variables and Time-Dependent Data24 Aug 2021
- 2021An Extensible Benchmark Suite for Learning to Simulate Physical Systems9 Aug 2021
- 2021Active operator inference for learning low-dimensional dynamical-system models from noisy data20 Jul 2021
- 2021A Framework for Machine Learning of Model Error in Dynamical Systems14 Jul 2021
- 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videos9 Jun 2021
- 2021Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Space7 Jun 2021
- 2021Model discovery in the sparse sampling regime2 May 2021
- 2021Asymptotic Theory of ℓ1-Regularized PDE Identification from a Single Noisy Trajectory12 Mar 2021
- 2021Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Maps9 Mar 2021
- 2021Generalization Bounds for Sparse Random Feature Expansions4 Mar 2021
- 2021Operator inference of non-Markovian terms for learning reduced models from partially observed state trajectories1 Mar 2021
- 2021Bayesian data-driven discovery of partial differential equations with variable coefficients2 Feb 2021
- 2024Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolationcited by 45
- 2021Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Mapscited by 41
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2021Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Spacecited by 25
- 2021An Extensible Benchmark Suite for Learning to Simulate Physical Systemscited by 24
- 2023Learning Stochastic Dynamical System via Flow Map Operatorcited by 24
- 2021Generalization Bounds for Sparse Random Feature Expansionscited by 22
- 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
- 2023Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarkscited by 18
- 2023PROSE: Predicting Operators and Symbolic Expressions using Multimodal Transformerscited by 16
- 2024LeMON: Learning to Learn Multi-Operator Networkscited by 13
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filterscited by 12
12 most cited of 50 All 50 (JSON)
- 2026The Dynamics of Discoverability: How Trajectories and Priors Shape Equation Recovery20 Jul 2026
- 2026MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Data1 Apr 2026
- 2025When is a System Discoverable from Data? Discovery Requires Chaos12 Nov 2025
- 2025Data-driven Discovery of Digital Twins in Biomedical Research29 Aug 2025
- 2025An adaptive data sampling strategy for stabilizing dynamical systems via controller inference2 Jun 2025
- 2025A Sparse Bayesian Learning Algorithm for Estimation of Interaction Kernels in Motsch-Tadmor Model11 May 2025
- 2025Optimizing Hard Thresholding for Sparse Model Discovery28 Apr 2025
- 2024Dispersion based Recurrent Neural Network Model for Methane Monitoring in Albertan Tailings Ponds11 Nov 2024
- 2024Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model17 Sep 2024
- 2024LeMON: Learning to Learn Multi-Operator Networks28 Aug 2024
- 2024System stabilization with policy optimization on unstable latent manifolds8 Jul 2024
- 2024Minimum Reduced-Order Models via Causal Inference29 Jun 2024
12 newest of 50 All 50 (JSON)