# How Entropic Regression Beats the Outliers Problem in Nonlinear System Identification

arXiv: https://arxiv.org/abs/1905.08061 · HTML: https://mlsanity.com/paper/1905.08061/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 May 2019.

## Built on by (most cited first, 14 of 14)

- [Next Generation Reservoir Computing](https://mlsanity.com/paper/2106.07688/) (2021)
- [KNODE-MPC: A Knowledge-based Data-driven Predictive Control Framework for Aerial Robots](https://mlsanity.com/paper/2109.04821/) (2021)
- [Online Dynamics Learning for Predictive Control with an Application to Aerial Robots](https://mlsanity.com/paper/2207.09344/) (2022)
- [Data-driven model discovery with Kolmogorov-Arnold networks](https://mlsanity.com/paper/2409.15167/) (2024)
- [CEBoosting: Online Sparse Identification of Dynamical Systems with Regime Switching by Causation Entropy Boosting](https://mlsanity.com/paper/2304.07863/) (2023)
- [CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation](https://mlsanity.com/paper/2410.20072/) (2024)
- [CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation](https://mlsanity.com/paper/2404.06749/) (2024)
- [Minimum Reduced-Order Models via Causal Inference](https://mlsanity.com/paper/2407.00271/) (2024)
- [Data-driven Discovery of Digital Twins in Biomedical Research](https://mlsanity.com/paper/2508.21484/) (2025)
- [Symbolic Regression via Neural Networks](https://mlsanity.com/paper/2605.04337/) (2026)
- [Nonlinear System Identification of Swarm of UAVs Using Deep Learning Methods](https://mlsanity.com/paper/2311.12906/) (2023)
- [Leveraging Predictive Models for Adaptive Sampling of Spatiotemporal Fluid Processes](https://mlsanity.com/paper/2304.00732/) (2023)
- [Learning Stochastic Dynamical Systems with Structured Noise](https://mlsanity.com/paper/2503.01077/) (2025)
- [CausationEntropy: Pythonic Optimal Causation Entropy](https://mlsanity.com/paper/2601.13365/) (2026)

## Abstract (arXiv)

In this work, we developed a nonlinear System Identification (SID) method that we called Entropic Regression. Our method adopts an information-theoretic measure for the data-driven discovery of the underlying dynamics. Our method shows robustness toward noise and outliers and it outperforms many of the current state-of-the-art methods. Moreover, the method of Entropic Regression overcomes many of the major limitations of the current methods such as sloppy parameters, diverse scale, and SID in high dimensional systems such as complex networks. The use of information-theoretic measures in entropic regression poses unique advantages, due to the Asymptotic Equipartition Property (AEP) of probability distributions, that outliers and other low-occurrence events are conveniently and intrinsically de-emphasized as not-typical, by definition. We provide a numerical comparison with the current state-of-the-art methods in sparse regression, and we apply the methods to different chaotic systems such as the Lorenz System, the Kuramoto-Sivashinsky equations, and the Double Well Potential.