# Extracting Sparse High-Dimensional Dynamics from Limited Data

arXiv: https://arxiv.org/abs/1707.08528 · HTML: https://mlsanity.com/paper/1707.08528/

## Key facts

- Cited by 50 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Jul 2017.

## Built on by (most cited first, 30 of 50)

- [Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolation](https://mlsanity.com/paper/2404.12355/) (2024)
- [Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Maps](https://mlsanity.com/paper/2103.05632/) (2021)
- [A Framework for Machine Learning of Model Error in Dynamical Systems](https://mlsanity.com/paper/2107.06658/) (2021)
- [Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Space](https://mlsanity.com/paper/2106.03603/) (2021)
- [An Extensible Benchmark Suite for Learning to Simulate Physical Systems](https://mlsanity.com/paper/2108.07799/) (2021)
- [Learning Stochastic Dynamical System via Flow Map Operator](https://mlsanity.com/paper/2305.03874/) (2023)
- [Generalization Bounds for Sparse Random Feature Expansions](https://mlsanity.com/paper/2103.03191/) (2021)
- [Benchmarking sparse system identification with low-dimensional chaos](https://mlsanity.com/paper/2302.10787/) (2023)
- [Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarks](https://mlsanity.com/paper/2307.11013/) (2023)
- [PROSE: Predicting Operators and Symbolic Expressions using Multimodal Transformers](https://mlsanity.com/paper/2309.16816/) (2023)
- [Reduced-Order Autodifferentiable Ensemble Kalman Filters](https://mlsanity.com/paper/2301.11961/) (2023)
- [LeMON: Learning to Learn Multi-Operator Networks](https://mlsanity.com/paper/2408.16168/) (2024)
- [Operator inference with roll outs for learning reduced models from scarce and low-quality data](https://mlsanity.com/paper/2212.01418/) (2022)
- [Random Feature Models for Learning Interacting Dynamical Systems](https://mlsanity.com/paper/2212.05591/) (2022)
- [Deep Learning of Chaotic Systems from Partially-Observed Data](https://mlsanity.com/paper/2205.08384/) (2022)
- [On the sample complexity of stabilizing linear dynamical systems from data](https://mlsanity.com/paper/2203.00474/) (2022)
- [A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterization](https://mlsanity.com/paper/2208.09104/) (2022)
- [Modeling Unknown Stochastic Dynamical System Subject to External Excitation](https://mlsanity.com/paper/2406.15747/) (2024)
- [Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model](https://mlsanity.com/paper/2409.11609/) (2024)
- [Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case](https://mlsanity.com/paper/2110.00546/) (2021)
- [When is a System Discoverable from Data? Discovery Requires Chaos](https://mlsanity.com/paper/2511.08860/) (2025)
- [Operator inference of non-Markovian terms for learning reduced models from partially observed state trajectories](https://mlsanity.com/paper/2103.01362/) (2021)
- [Active operator inference for learning low-dimensional dynamical-system models from noisy data](https://mlsanity.com/paper/2107.09256/) (2021)
- [Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learning](https://mlsanity.com/paper/2203.03458/) (2022)
- [Statistical Mechanics of Dynamical System Identification](https://mlsanity.com/paper/2403.01723/) (2024)
- [Bayesian data-driven discovery of partial differential equations with variable coefficients](https://mlsanity.com/paper/2102.01432/) (2021)
- [Modeling unknown dynamical systems with hidden parameters](https://mlsanity.com/paper/2202.01858/) (2022)
- [SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemics](https://mlsanity.com/paper/2211.08277/) (2022)
- [Dispersion based Recurrent Neural Network Model for Methane Monitoring in Albertan Tailings Ponds](https://mlsanity.com/paper/2411.06741/) (2024)
- [Context-aware controller inference for stabilizing dynamical systems from scarce data](https://mlsanity.com/paper/2207.11049/) (2022)

## Abstract (arXiv)

Extracting governing equations from dynamic data is an essential task in model selection and parameter estimation. The form of the governing equation is rarely known a priori; however, based on the sparsity-of-effect principle one may assume that the number of candidate functions needed to represent the dynamics is very small. In this work, we leverage the sparse structure of the governing equations along with recent results from random sampling theory to develop methods for selecting dynamical systems from under-sampled data. In particular, we detail three sampling strategies that lead to the exact recovery of first-order dynamical systems when we are given fewer samples than unknowns. The first method makes no assumptions on the behavior of the data, and requires a certain number of random initial samples. The second method utilizes the structure of the governing equation to limit the number of random initializations needed. The third method leverages chaotic behavior in the data to construct a nearly deterministic sampling strategy. Using results from compressive sensing, we show that the strategies lead to exact recovery, which is stable to the sparse structure of the governing equations and robust to noise in the estimation of the velocity. Computational results validate each of the sampling strategies and highlight potential applications.