mlsanityData to 14 Oct 2026

Interpretable learning of effective dynamics for multiscale systems

arXiv 2309.05812 ↗First posted 11 Sep 2023stat.ML cs.LG physics.comp-phcited by 11

Not on the map. Why?

Abstract (arXiv)

The modeling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today's computer advances resolving all spatiotemporal scales described by the governing equations remains a remote target. This realization has prompted intense efforts to develop model order reduction techniques. In recent years, techniques based on deep recurrent neural networks have produced promising results for the modeling and simulation of complex spatiotemporal systems and offer large flexibility in model development as they can incorporate experimental and computational data. However, neural networks lack interpretability, which limits their utility and generalizability across complex systems. Here we propose a novel framework of Interpretable Learning Effective Dynamics (iLED) that offers comparable accuracy to state-of-the-art recurrent neural network-based approaches while providing the added benefit of interpretability. The iLED framework is motivated by Mori-Zwanzig and Koopman operator theory, which justifies the choice of the specific architecture. We demonstrate the effectiveness of the proposed framework in simulations of three benchmark multiscale systems. Our results show that the iLED framework can generate accurate predictions and obtain interpretable dynamics, making it a promising approach for solving high-dimensional multiscale systems.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 26 of its 90 references that are in the map. First posted on arXiv 11 Sep 2023.

Builds on

26 of 90 references.

References · 26

  1. 2018Neural Ordinary Differential Equationscited by 3,779
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  4. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  5. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  6. 2015Unsupervised Learning of Video Representations using LSTMscited by 435
  7. 2021Modern Koopman Theory for Dynamical Systemscited by 276
  8. 2020Scalable Gradients for Stochastic Differential Equationscited by 271
  9. 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 145
  10. 2020Dynamical Variational Autoencoders: A Comprehensive Reviewcited by 128
  11. 2020SINDy-PI: A Robust Algorithm for Parallel Implicit Sparse Identification of Nonlinear Dynamicscited by 125
  12. 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
14 more
  1. 2022Learning Operators with Coupled Attentioncited by 90
  2. 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
  3. 2014A Clockwork RNNcited by 72
  4. 2022Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systemscited by 50
  5. 2021Data-driven discovery of intrinsic dynamicscited by 45
  6. 2019Deep learning to discover and predict dynamics on an inertial manifoldcited by 43
  7. 2022Quadratic Approximation Manifold for Mitigating the Kolmogorov Barrier in Nonlinear Projection-Based Model Order Reductioncited by 30
  8. 2019Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systemscited by 25
  9. 2023Autoencoders for discovering manifold dimension and coordinates in data from complex dynamical systemscited by 13
  10. 2021Physics-aware, probabilistic model order reduction with guaranteed stabilitycited by 12
  11. 2022CD-ROM: Complemented Deep-Reduced Order Modelcited by 8
  12. 2019A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regimecited by 7
  13. 2023Adaptive learning of effective dynamics: Adaptive real-time, online modeling for complex systemscited by 4
  14. 2023Interpretable reduced-order modeling with time-scale separationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 4; 2025: 4; 2026: 2.

11 papers.