Interpretable learning of effective dynamics for multiscale systems
Not on the map. Why?
Abstract (arXiv)
The modeling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today's computer advances resolving all spatiotemporal scales described by the governing equations remains a remote target. This realization has prompted intense efforts to develop model order reduction techniques. In recent years, techniques based on deep recurrent neural networks have produced promising results for the modeling and simulation of complex spatiotemporal systems and offer large flexibility in model development as they can incorporate experimental and computational data. However, neural networks lack interpretability, which limits their utility and generalizability across complex systems. Here we propose a novel framework of Interpretable Learning Effective Dynamics (iLED) that offers comparable accuracy to state-of-the-art recurrent neural network-based approaches while providing the added benefit of interpretability. The iLED framework is motivated by Mori-Zwanzig and Koopman operator theory, which justifies the choice of the specific architecture. We demonstrate the effectiveness of the proposed framework in simulations of three benchmark multiscale systems. Our results show that the iLED framework can generate accurate predictions and obtain interpretable dynamics, making it a promising approach for solving high-dimensional multiscale systems.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 26 of its 90 references that are in the map. First posted on arXiv 11 Sep 2023.
Builds on
26 of 90 references.
References · 26
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2015Unsupervised Learning of Video Representations using LSTMscited by 435
- 2021Modern Koopman Theory for Dynamical Systemscited by 276
- 2020Scalable Gradients for Stochastic Differential Equationscited by 271
- 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 145
- 2020Dynamical Variational Autoencoders: A Comprehensive Reviewcited by 128
- 2020SINDy-PI: A Robust Algorithm for Parallel Implicit Sparse Identification of Nonlinear Dynamicscited by 125
- 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
14 more
- 2022Learning Operators with Coupled Attentioncited by 90
- 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
- 2014A Clockwork RNNcited by 72
- 2022Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systemscited by 50
- 2021Data-driven discovery of intrinsic dynamicscited by 45
- 2019Deep learning to discover and predict dynamics on an inertial manifoldcited by 43
- 2022Quadratic Approximation Manifold for Mitigating the Kolmogorov Barrier in Nonlinear Projection-Based Model Order Reductioncited by 30
- 2019Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systemscited by 25
- 2023Autoencoders for discovering manifold dimension and coordinates in data from complex dynamical systemscited by 13
- 2021Physics-aware, probabilistic model order reduction with guaranteed stabilitycited by 12
- 2022CD-ROM: Complemented Deep-Reduced Order Modelcited by 8
- 2019A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regimecited by 7
- 2023Adaptive learning of effective dynamics: Adaptive real-time, online modeling for complex systemscited by 4
- 2023Interpretable reduced-order modeling with time-scale separationcited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 4; 2026: 2.
11 papers.
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observationscited by 16
- 2024On latent dynamics learning in nonlinear reduced order modelingcited by 14
- 2023Mori-Zwanzig latent space Koopman closure for nonlinear autoencodercited by 12
- 2024Generative Learning for Forecasting the Dynamics of Complex Systemscited by 6
- 2024Balanced Neural ODEs: nonlinear model order reduction and Koopman operator approximationscited by 4
- 2025Next Generation Equation-Free Multiscale Modelling of Crowd Dynamics via Machine Learningcited by 2
- 2025A Mechanistic Analysis of Transformers for Dynamical Systemscited by 2
- 2025NeurIPS 2024 ML4CFD Competition: Results and Retrospective Analysiscited by 1
- 2025UP-dROM : Uncertainty-Aware and Parametrised dynamic Reduced-Order Model, application to unsteady flowscited by 0
- 2026Efficient Adaptation of ROMs for Unsteady Flows Using Data Assimilationcited by 0
- 2026Convolutional Symmetric AutoEncoders: enhancing latent stability via differential geometrycited by 0
- 2026Convolutional Symmetric AutoEncoders: enhancing latent stability via differential geometry1 Jul 2026
- 2026Efficient Adaptation of ROMs for Unsteady Flows Using Data Assimilation26 Feb 2026
- 2025A Mechanistic Analysis of Transformers for Dynamical Systems24 Dec 2025
- 2025Next Generation Equation-Free Multiscale Modelling of Crowd Dynamics via Machine Learning5 Aug 2025
- 2025NeurIPS 2024 ML4CFD Competition: Results and Retrospective Analysis10 Jun 2025
- 2025UP-dROM : Uncertainty-Aware and Parametrised dynamic Reduced-Order Model, application to unsteady flows29 Mar 2025
- 2024Balanced Neural ODEs: nonlinear model order reduction and Koopman operator approximations14 Oct 2024
- 2024On latent dynamics learning in nonlinear reduced order modeling27 Aug 2024
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observations31 Jul 2024
- 2024Generative Learning for Forecasting the Dynamics of Complex Systems27 Feb 2024
- 2023Mori-Zwanzig latent space Koopman closure for nonlinear autoencoder16 Oct 2023