On the Convergence of the SINDy Algorithm
Not on the map. Why?
Abstract (arXiv)
One way to understand time-series data is to identify the underlying dynamical system which generates it. This task can be done by selecting an appropriate model and a set of parameters which best fits the dynamics while providing the simplest representation (i.e. the smallest amount of terms). One such approach is the sparse identification of nonlinear dynamics framework [6] which uses a sparsity-promoting algorithm that iterates between a partial least-squares fit and a thresholding (sparsity-promoting) step. In this work, we provide some theoretical results on the behavior and convergence of the algorithm proposed in [6]. In particular, we prove that the algorithm approximates local minimizers of an unconstrained ℓ0-penalized least-squares problem. From this, we provide sufficient conditions for general convergence, rate of convergence, and conditions for one-step recovery. Examples illustrate that the rates of convergence are sharp. In addition, our results extend to other algorithms related to the algorithm in [6], and provide theoretical verification to several observed phenomena.
Key facts. Cited by 49 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 10; 2023: 6; 2024: 13; 2025: 9; 2026: 4.
49 papers.
Sort:
By area:
- 2021Deeptime: a Python library for machine learning dynamical models from time series datacited by 38
- 2021Discovery of Nonlinear Dynamical Systems using a Runge-Kutta Inspired Dictionary-based Sparse Regression Approachcited by 36
- 2021Learning Mean-Field Equations from Particle Data Using WSINDycited by 29
- 2022Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constantscited by 24
- 2021DySMHO: Data-Driven Discovery of Governing Equations for Dynamical Systems via Moving Horizon Optimizationcited by 19
- 2022WeakIdent: Weak formulation for Identifying Differential Equations using Narrow-fit and Trimmingcited by 18
- 2021A toolkit for data-driven discovery of governing equations in high-noise regimescited by 15
- 2023Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discoverycited by 15
- 2023On sparse regression, Lp-regularization, and automated model discoverycited by 15
- 2024Rapid Bayesian identification of sparse nonlinear dynamics from scarce and noisy datacited by 15
- 2022Asymptotic consistency of the WSINDy algorithm in the limit of continuum datacited by 14
- 2024MODNO: Multi Operator Learning With Distributed Neural Operatorscited by 14
37 more
- 2022Online Weak-form Sparse Identification of Partial Differential Equationscited by 13
- 2022Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified Uncertaintycited by 13
- 2022Convergence of weak-SINDy Surrogate Modelscited by 11
- 2023Coarse-Graining Hamiltonian Systems Using WSINDycited by 11
- 2022Random Feature Models for Learning Interacting Dynamical Systemscited by 10
- 2021SHRIMP: Sparser Random Feature Models via Iterative Magnitude Pruningcited by 9
- 2024Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inferencecited by 9
- 2024Weak-Form Inference for Hybrid Dynamical Systems in Ecologycited by 7
- 2024Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Modelcited by 7
- 2024Fourier PINNs: From Strong Boundary Conditions to Adaptive Fourier Basescited by 7
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysiscited by 7
- 2023A Robust SINDy Approach by Combining Neural Networks and an Integral Formcited by 6
- 2022A Priori Denoising Strategies for Sparse Identification of Nonlinear Dynamical Systems: A Comparative Studycited by 5
- 2024Statistical Mechanics of Dynamical System Identificationcited by 5
- 2024Dynamical system prediction from sparse observations using deep neural networks with Voronoi tessellation and physics constraintcited by 5
- 2024Scalable Sparse Regression for Model Discovery: The Fast Lane to Insightcited by 4
- 2023Multiphysics discovery with moving boundaries using Ensemble SINDy and Peridynamic Differential Operatorcited by 3
- 2024GN-SINDy: Greedy Sampling Neural Network in Sparse Identification of Nonlinear Partial Differential Equationscited by 2
- 2024SINDyG: Sparse Identification of Nonlinear Dynamical Systems from Graph-Structured Data, with Applications to Stuart-Landau Oscillator Networkscited by 2
- 2025Sparse identification of nonlinear dynamics with library optimization mechanism: Recursive long-term prediction perspectivecited by 2
- 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videoscited by 1
- 2022A Symbolic Representation of Human Posture for Interpretable Learning and Reasoningcited by 1
- 2025Weighted Birkhoff Averages Accelerate Data-Driven Methodscited by 1
- 2026Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regressioncited by 1
- 2022A dynamical systems based framework for dimension reductioncited by 0
- 2023Dimensionality Collapse: Optimal Measurement Selection for Low-Error Infinite-Horizon Forecastingcited by 0
- 2024SINDy vs Hard Nonlinearities and Hidden Dynamics: a Benchmarking Studycited by 0
- 2024Machine learning for cerebral blood vessels' malformationscited by 0
- 2025Impilict Runge-Kutta based sparse identification of governing equations in biologically motivated systemscited by 0
- 2025BLADE: Bayesian Langevin Active Discovery with Replica Exchange for Identification of Complex Systemscited by 0
- 2025Identifying Unknown Stochastic Dynamics via Finite expression methodscited by 0
- 2025Optimizing Hard Thresholding for Sparse Model Discoverycited by 0
- 2025Sparse Kalman Identification for Partially Observable Systems via Adaptive Bayesian Learningcited by 0
- 2025From STLS to Projection-based Dictionary Selection in Sparse Regression for System Identificationcited by 0
- 2026Turning mechanistic models into forecasters by using machine learningcited by 0
- 2026From Video-to-PDE: Data-Driven Discovery of Nonlinear Dye Plume Dynamicscited by 0
- 2026Learning the Geometry of Admissible Hypotheses through Inductive Bias in Training Distributionscited by 0
- 2026Learning the Geometry of Admissible Hypotheses through Inductive Bias in Training Distributions31 Aug 2026
- 2026Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regression30 Jun 2026
- 2026From Video-to-PDE: Data-Driven Discovery of Nonlinear Dye Plume Dynamics6 May 2026
- 2026Turning mechanistic models into forecasters by using machine learning4 Feb 2026
- 2025From STLS to Projection-based Dictionary Selection in Sparse Regression for System Identification16 Dec 2025
- 2025Sparse Kalman Identification for Partially Observable Systems via Adaptive Bayesian Learning22 Nov 2025
- 2025Weighted Birkhoff Averages Accelerate Data-Driven Methods21 Nov 2025
- 2025Sparse identification of nonlinear dynamics with library optimization mechanism: Recursive long-term prediction perspective24 Jul 2025
- 2025Optimizing Hard Thresholding for Sparse Model Discovery28 Apr 2025
- 2025Identifying Unknown Stochastic Dynamics via Finite expression methods9 Apr 2025
- 2025BLADE: Bayesian Langevin Active Discovery with Replica Exchange for Identification of Complex Systems4 Mar 2025
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysis2 Mar 2025
37 more
- 2025Impilict Runge-Kutta based sparse identification of governing equations in biologically motivated systems27 Feb 2025
- 2024Machine learning for cerebral blood vessels' malformations25 Nov 2024
- 2024Fourier PINNs: From Strong Boundary Conditions to Adaptive Fourier Bases4 Oct 2024
- 2024Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model17 Sep 2024
- 2024SINDyG: Sparse Identification of Nonlinear Dynamical Systems from Graph-Structured Data, with Applications to Stuart-Landau Oscillator Networks2 Sep 2024
- 2024Dynamical system prediction from sparse observations using deep neural networks with Voronoi tessellation and physics constraint31 Aug 2024
- 2024Weak-Form Inference for Hybrid Dynamical Systems in Ecology31 May 2024
- 2024Scalable Sparse Regression for Model Discovery: The Fast Lane to Insight14 May 2024
- 2024GN-SINDy: Greedy Sampling Neural Network in Sparse Identification of Nonlinear Partial Differential Equations14 May 2024
- 2024MODNO: Multi Operator Learning With Distributed Neural Operators3 Apr 2024
- 2024Statistical Mechanics of Dynamical System Identification4 Mar 2024
- 2024SINDy vs Hard Nonlinearities and Hidden Dynamics: a Benchmarking Study1 Mar 2024
- 2024Rapid Bayesian identification of sparse nonlinear dynamics from scarce and noisy data23 Feb 2024
- 2024Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inference30 Jan 2024
- 2023On sparse regression, Lp-regularization, and automated model discovery9 Oct 2023
- 2023Coarse-Graining Hamiltonian Systems Using WSINDy9 Oct 2023
- 2023A Robust SINDy Approach by Combining Neural Networks and an Integral Form13 Sep 2023
- 2023Multiphysics discovery with moving boundaries using Ensemble SINDy and Peridynamic Differential Operator27 Mar 2023
- 2023Dimensionality Collapse: Optimal Measurement Selection for Low-Error Infinite-Horizon Forecasting27 Mar 2023
- 2023Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discovery30 Jan 2023
- 2022Random Feature Models for Learning Interacting Dynamical Systems11 Dec 2022
- 2022Asymptotic consistency of the WSINDy algorithm in the limit of continuum data29 Nov 2022
- 2022Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constants19 Nov 2022
- 2022WeakIdent: Weak formulation for Identifying Differential Equations using Narrow-fit and Trimming6 Nov 2022
- 2022A Symbolic Representation of Human Posture for Interpretable Learning and Reasoning17 Oct 2022
- 2022Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified Uncertainty14 Oct 2022
- 2022Convergence of weak-SINDy Surrogate Models30 Sep 2022
- 2022A dynamical systems based framework for dimension reduction18 Apr 2022
- 2022Online Weak-form Sparse Identification of Partial Differential Equations8 Mar 2022
- 2022A Priori Denoising Strategies for Sparse Identification of Nonlinear Dynamical Systems: A Comparative Study29 Jan 2022
- 2021SHRIMP: Sparser Random Feature Models via Iterative Magnitude Pruning7 Dec 2021
- 2021A toolkit for data-driven discovery of governing equations in high-noise regimes8 Nov 2021
- 2021Deeptime: a Python library for machine learning dynamical models from time series data28 Oct 2021
- 2021Learning Mean-Field Equations from Particle Data Using WSINDy14 Oct 2021
- 2021DySMHO: Data-Driven Discovery of Governing Equations for Dynamical Systems via Moving Horizon Optimization30 Jul 2021
- 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videos9 Jun 2021
- 2021Discovery of Nonlinear Dynamical Systems using a Runge-Kutta Inspired Dictionary-based Sparse Regression Approach11 May 2021
- 2021Deeptime: a Python library for machine learning dynamical models from time series datacited by 38
- 2021Discovery of Nonlinear Dynamical Systems using a Runge-Kutta Inspired Dictionary-based Sparse Regression Approachcited by 36
- 2021Learning Mean-Field Equations from Particle Data Using WSINDycited by 29
- 2022Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constantscited by 24
- 2021DySMHO: Data-Driven Discovery of Governing Equations for Dynamical Systems via Moving Horizon Optimizationcited by 19
- 2022WeakIdent: Weak formulation for Identifying Differential Equations using Narrow-fit and Trimmingcited by 18
- 2021A toolkit for data-driven discovery of governing equations in high-noise regimescited by 15
- 2023Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discoverycited by 15
- 2023On sparse regression, Lp-regularization, and automated model discoverycited by 15
- 2024Rapid Bayesian identification of sparse nonlinear dynamics from scarce and noisy datacited by 15
- 2022Asymptotic consistency of the WSINDy algorithm in the limit of continuum datacited by 14
- 2024MODNO: Multi Operator Learning With Distributed Neural Operatorscited by 14
12 most cited of 48 All 48 (JSON)
- 2026Learning the Geometry of Admissible Hypotheses through Inductive Bias in Training Distributions31 Aug 2026
- 2026Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regression30 Jun 2026
- 2026From Video-to-PDE: Data-Driven Discovery of Nonlinear Dye Plume Dynamics6 May 2026
- 2026Turning mechanistic models into forecasters by using machine learning4 Feb 2026
- 2025From STLS to Projection-based Dictionary Selection in Sparse Regression for System Identification16 Dec 2025
- 2025Sparse Kalman Identification for Partially Observable Systems via Adaptive Bayesian Learning22 Nov 2025
- 2025Weighted Birkhoff Averages Accelerate Data-Driven Methods21 Nov 2025
- 2025Sparse identification of nonlinear dynamics with library optimization mechanism: Recursive long-term prediction perspective24 Jul 2025
- 2025Optimizing Hard Thresholding for Sparse Model Discovery28 Apr 2025
- 2025Identifying Unknown Stochastic Dynamics via Finite expression methods9 Apr 2025
- 2025BLADE: Bayesian Langevin Active Discovery with Replica Exchange for Identification of Complex Systems4 Mar 2025
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysis2 Mar 2025
12 newest of 48 All 48 (JSON)