Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networks
Not on the map. Why?
Abstract (arXiv)
We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in their reduced order space and are shown to be an effective set of nonlinear approximators of their attractor. We demonstrate the forecasting performance of the LSTM and compare it with Gaussian processes (GPs) in time series obtained from the Lorenz 96 system, the Kuramoto-Sivashinsky equation and a prototype climate model. The LSTM networks outperform the GPs in short-term forecasting accuracy in all applications considered. A hybrid architecture, extending the LSTM with a mean stochastic model (MSM-LSTM), is proposed to ensure convergence to the invariant measure. This novel hybrid method is fully data-driven and extends the forecasting capabilities of LSTM networks.
Key facts. Cited by 155 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 33; 2022: 33; 2023: 23; 2024: 21; 2025: 20; 2026: 25.
155 papers.
Sort:
By area:
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
- 2021PySINDy: A comprehensive Python package for robust sparse system identificationcited by 88
- 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 82
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2021On the difficulty of learning chaotic dynamics with RNNscited by 64
- 2022Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoderscited by 58
- 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
- 2022Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systemscited by 50
- 2021Data-driven discovery of intrinsic dynamicscited by 45
- 2021Learning Dissipative Dynamics in Chaotic Systemscited by 41
- 2023Deep networks for system identification: a Surveycited by 35
38 more
- 2022Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systemscited by 34
- 2024Out-of-Domain Generalization in Dynamical Systems Reconstructioncited by 33
- 2023Synthetic Lagrangian Turbulence by Generative Diffusion Modelscited by 31
- 2021Latent Space Data Assimilation by using Deep Learningcited by 29
- 2024DySLIM: Dynamics Stable Learning by Invariant Measure for Chaotic Systemscited by 29
- 2021Data-Driven Reduced-Order Modeling of Spatiotemporal Chaos with Neural Ordinary Differential Equationscited by 28
- 2021Robust Optimization and Validation of Echo State Networks for learning chaotic dynamicscited by 27
- 2023The transformative potential of machine learning for experiments in fluid mechanicscited by 26
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2022Physics guided neural networks for modelling of non-linear dynamicscited by 20
- 2025True Zero-Shot Inference of Dynamical Systems Preserving Long-Term Statisticscited by 20
- 2023Benchmarking sparse system identification with low-dimensional chaoscited by 19
- 2022Learning black- and gray-box chemotactic PDEs/closures from agent based Monte Carlo simulation datacited by 18
- 2023Multi-fidelity reduced-order surrogate modelingcited by 18
- 2024Almost-Linear RNNs Yield Highly Interpretable Symbolic Codes in Dynamical Systems Reconstructioncited by 18
- 2023Bifurcations and loss jumps in RNN trainingcited by 17
- 2021Reconstructing Nonlinear Dynamical Systems from Multi-Modal Time Seriescited by 16
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observationscited by 16
- 2021Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformerscited by 15
- 2022Data-driven Control of Agent-based Models: an Equation/Variable-free Machine Learning Approachcited by 15
- 2021Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolutioncited by 14
- 2024On latent dynamics learning in nonlinear reduced order modelingcited by 14
- 2024Learning Interpretable Hierarchical Dynamical Systems Models from Time Series Datacited by 14
- 2021Applying Machine Learning to Study Fluid Mechanicscited by 13
- 2022Integrating Multimodal Data for Joint Generative Modeling of Complex Dynamicscited by 13
- 2022W-Transformers : A Wavelet-based Transformer Framework for Univariate Time Series Forecastingcited by 12
- 2022Flipped Classroom: Effective Teaching for Time Series Forecastingcited by 11
- 2023Learning from Predictions: Fusing Training and Autoregressive Inference for Long-Term Spatiotemporal Forecastscited by 11
- 2022Long-time prediction of nonlinear parametrized dynamical systems by deep learning-based reduced order modelscited by 10
- 2023PyKoopman: A Python Package for Data-Driven Approximation of the Koopman Operatorcited by 10
- 2024Adversarial dynamical systems characterize when data-driven learning succeeds or failscited by 10
- 2022Deep Learning of Chaotic Systems from Partially-Observed Datacited by 9
- 2022Generalized Quadratic Embeddings for Nonlinear Dynamics using Deep Learningcited by 9
- 2023Finite Expression Methods for Discovering Physical Laws from Datacited by 9
- 2024A non-intrusive machine learning framework for debiasing long-time coarse resolution climate simulations and quantifying rare events statisticscited by 9
- 2024A scalable generative model for dynamical system reconstruction from neuroimaging datacited by 9
- 2021Non-intrusive Nonlinear Model Reduction via Machine Learning Approximations to Low-dimensional Operatorscited by 8
- 2022CD-ROM: Complemented Deep-Reduced Order Modelcited by 8
50 most cited of 155 All 155 (JSON)
- 2026Learning Chaos Without Seeing Chaos: Extrapolation of Global Dynamics in Autoregressive Transformers30 Sep 2026
- 2026Continuous-Time Trajectory Generation from Discrete Observations with Stochasticity25 Sep 2026
- 2026Predicting the Unpredictable: LLM-powered Long-term Chaotic Time Series Forecasting under Short-term Observations30 Aug 2026
- 2026Noise-Induced Predictability Redistribution Across Forecast Horizons of Extreme Events in Chaotic Dynamics20 Aug 2026
- 2026Learning piecewise-smooth dynamical systems20 Aug 2026
- 2026A Minimal Interpretable Architecture for Zero-Shot Reconstruction of Dynamical Systems16 Jul 2026
- 2026Discovering Latent Response Laws in Forced Physical Systems9 Jul 2026
- 2026Convolutional Symmetric AutoEncoders: enhancing latent stability via differential geometry1 Jul 2026
- 2026Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regression30 Jun 2026
- 2026Topological Out-of-Domain Generalization in Dynamical Systems Reconstruction22 Jun 2026
- 2026Model discovery for dynamical systems with complex-valued product units26 May 2026
- 2026A comparative study of accuracy and rollout stability of temporal surrogate models24 May 2026
38 more
- 2026Long-horizon prediction of three-dimensional wall-bounded turbulence with CTA-Swin-UNet and resolvent analysis18 May 2026
- 2026Parallel-in-Time Training of Recurrent Neural Networks for Dynamical Systems Reconstruction12 May 2026
- 2026A Hybridizable Neural Time Integrator for Stable Autoregressive Forecasting22 Apr 2026
- 2026LAtent Phase Inference from Short time sequences using SHallow REcurrent Decoders (LAPIS-SHRED)1 Apr 2026
- 2026Storage and selection of multiple chaotic attractors in minimal reservoir computers16 Mar 2026
- 2026Surrogates for Physics-based and Data-driven Modelling of Parametric Systems: Review and New Perspectives13 Mar 2026
- 2026Adaptive Diffusion Posterior Sampling for Data and Model Fusion of Complex Nonlinear Dynamical Systems13 Mar 2026
- 2026Dynamics-Informed Deep Learning for Predicting Extreme Events11 Mar 2026
- 2026Robust Parameter and State Estimation in Multiscale Neuronal Systems Using Physics-Informed Neural Networks27 Feb 2026
- 2026Position: A Dynamical Systems Perspective is Needed to Advance Time Series Modeling18 Feb 2026
- 2026Continuous-Time Piecewise-Linear Recurrent Neural Networks17 Feb 2026
- 2026Stabilizing autoregressive forecasts in chaotic systems via multi-rate latent recurrence20 Jan 2026
- 2026Data-Driven Reduced-Complexity Modeling of Fluid Flows: A Community Challenge7 Jan 2026
- 2025Learning solution operator of dynamical systems with diffusion maps kernel ridge regression19 Dec 2025
- 2025ECO: Energy-Constrained Operator Learning for Chaotic Dynamics with Boundedness Guarantees1 Dec 2025
- 2025Efficient probabilistic surrogate modeling techniques for partially-observed large-scale dynamical systems6 Nov 2025
- 2025Accelerating scientific discovery with the common task framework6 Nov 2025
- 2025A Novel Reservoir Computing Framework for Chaotic Time Series Prediction Using Time Delay Embedding and Random Fourier Features4 Nov 2025
- 2025FNODE: Flow-Matching for data-driven simulation of constrained multibody systems29 Aug 2025
- 2025Blending data and physics for reduced-order modeling of systems with spatiotemporal chaotic dynamics21 Jul 2025
- 2025Artifacts of Numerical Integration in Learning Dynamical Systems19 Jul 2025
- 2025Robust quantum reservoir computers for forecasting chaotic dynamics: generalized synchronization and stability27 Jun 2025
- 2025Beyond Static Models: Hypernetworks for Adaptive and Generalizable Forecasting in Complex Parametric Dynamical Systems24 Jun 2025
- 2025A Survey of Physics-Informed AI for Complex Urban Systems9 Jun 2025
- 2025PMNO: A novel physics guided multi-step neural operator predictor for partial differential equations2 Jun 2025
- 2025A tensor network approach for chaotic time series prediction23 May 2025
- 2025Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders19 May 2025
- 2025True Zero-Shot Inference of Dynamical Systems Preserving Long-Term Statistics19 May 2025
- 2025Data-Driven Forecasting of High-Dimensional Transient and Stationary Processes via Space-Time Projection31 Mar 2025
- 2025Learning Effective Dynamics across Spatio-Temporal Scales of Complex Flows11 Feb 2025
- 2025Al-Khwarizmi: Discovering Physical Laws with Foundation Models3 Feb 2025
- 2025Learning dynamical systems with hit-and-run random feature maps11 Jan 2025
- 2025Slim multi-scale convolutional autoencoder-based reduced-order models for interpretable features of a complex dynamical system6 Jan 2025
- 2024Regional Weather Variable Predictions by Machine Learning with Near-Surface Observational and Atmospheric Numerical Data11 Dec 2024
- 2024On the relationship between Koopman operator approximations and neural ordinary differential equations for data-driven time-evolution predictions20 Nov 2024
- 2024A scalable generative model for dynamical system reconstruction from neuroimaging data5 Nov 2024
- 2024Almost-Linear RNNs Yield Highly Interpretable Symbolic Codes in Dynamical Systems Reconstruction18 Oct 2024
- 2024Learning Interpretable Hierarchical Dynamical Systems Models from Time Series Data7 Oct 2024
50 newest of 155 All 155 (JSON)
- 2023Synthetic Lagrangian Turbulence by Generative Diffusion Modelscited by 31
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observationscited by 16
- 2025Efficient probabilistic surrogate modeling techniques for partially-observed large-scale dynamical systemscited by 1
- 2025FNODE: Flow-Matching for data-driven simulation of constrained multibody systemscited by 0
- 2025Efficient probabilistic surrogate modeling techniques for partially-observed large-scale dynamical systems6 Nov 2025
- 2025FNODE: Flow-Matching for data-driven simulation of constrained multibody systems29 Aug 2025
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observations31 Jul 2024
- 2023Synthetic Lagrangian Turbulence by Generative Diffusion Models17 Jul 2023
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
- 2021PySINDy: A comprehensive Python package for robust sparse system identificationcited by 88
- 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 82
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2021On the difficulty of learning chaotic dynamics with RNNscited by 64
- 2022Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoderscited by 58
- 2023Generalized Teacher Forcing for Learning Chaotic Dynamicscited by 55
- 2022Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systemscited by 50
- 2021Data-driven discovery of intrinsic dynamicscited by 45
- 2021Learning Dissipative Dynamics in Chaotic Systemscited by 41
- 2023Deep networks for system identification: a Surveycited by 35
12 most cited of 151 All 151 (JSON)
- 2026Learning Chaos Without Seeing Chaos: Extrapolation of Global Dynamics in Autoregressive Transformers30 Sep 2026
- 2026Continuous-Time Trajectory Generation from Discrete Observations with Stochasticity25 Sep 2026
- 2026Predicting the Unpredictable: LLM-powered Long-term Chaotic Time Series Forecasting under Short-term Observations30 Aug 2026
- 2026Noise-Induced Predictability Redistribution Across Forecast Horizons of Extreme Events in Chaotic Dynamics20 Aug 2026
- 2026Learning piecewise-smooth dynamical systems20 Aug 2026
- 2026A Minimal Interpretable Architecture for Zero-Shot Reconstruction of Dynamical Systems16 Jul 2026
- 2026Discovering Latent Response Laws in Forced Physical Systems9 Jul 2026
- 2026Convolutional Symmetric AutoEncoders: enhancing latent stability via differential geometry1 Jul 2026
- 2026Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regression30 Jun 2026
- 2026Topological Out-of-Domain Generalization in Dynamical Systems Reconstruction22 Jun 2026
- 2026Model discovery for dynamical systems with complex-valued product units26 May 2026
- 2026A comparative study of accuracy and rollout stability of temporal surrogate models24 May 2026
12 newest of 151 All 151 (JSON)