Physics-aware, probabilistic model order reduction with guaranteed stability
Not on the map. Why?
Abstract (arXiv)
Given (small amounts of) time-series' data from a high-dimensional, fine-grained, multiscale dynamical system, we propose a generative framework for learning an effective, lower-dimensional, coarse-grained dynamical model that is predictive of the fine-grained system's long-term evolution but also of its behavior under different initial conditions. We target fine-grained models as they arise in physical applications (e.g. molecular dynamics, agent-based models), the dynamics of which are strongly non-stationary but their transition to equilibrium is governed by unknown slow processes which are largely inaccessible by brute-force simulations. Approaches based on domain knowledge heavily rely on physical insight in identifying temporally slow features and fail to enforce the long-term stability of the learned dynamics. On the other hand, purely statistical frameworks lack interpretability and rely on large amounts of expensive simulation data (long and multiple trajectories) as they cannot infuse domain knowledge. The generative framework proposed achieves the aforementioned desiderata by employing a flexible prior on the complex plane for the latent, slow processes, and an intermediate layer of physics-motivated latent variables that reduces reliance on data and imbues inductive bias. In contrast to existing schemes, it does not require the a priori definition of projection operators from the fine-grained description and addresses simultaneously the tasks of dimensionality reduction and model estimation. We demonstrate its efficacy and accuracy in multiscale physical systems of particle dynamics where probabilistic, long-term predictions of phenomena not contained in the training data are produced.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 21 of its 50 references that are in the map. First posted on arXiv 14 Jan 2021.
Builds on
21 of 50 references.
References · 21
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2019Hamiltonian Neural Networkscited by 712
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2020Scalable Gradients for Stochastic Differential Equationscited by 271
- 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 262
- 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
- 2016Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Datacited by 156
- 2019Hamiltonian Generative Networkscited by 137
- 2019Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stabilitycited by 53
- 2019Equivariant Hamiltonian Flowscited by 39
- 2015Black box variational inference for state space modelscited by 31
9 more
- 2019Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systemscited by 25
- 2018Model Reduction with Memory and the Machine Learning of Dynamical Systemscited by 21
- 2018Deep Generative Markov State Modelscited by 19
- 2016Variational Koopman models: slow collective variables and molecular kinetics from short off-equilibrium simulationscited by 18
- 2020Physics-Aware Gaussian Processes in Remote Sensingcited by 14
- 2019A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regimecited by 7
- 2018Machine Learning for Molecular Dynamics on Long Timescalescited by 4
- 2018Physics-constrained, data-driven discovery of coarse-grained dynamicscited by 3
- 2017Structured Black Box Variational Inference for Latent Time Series Modelscited by 1
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 2; 2024: 3; 2025: 1.
12 papers.
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modelingcited by 59
- 2022Semi-supervised Invertible Neural Operators for Bayesian Inverse Problemscited by 25
- 2022Simulate Time-integrated Coarse-grained Molecular Dynamics with Multi-Scale Graph Networkscited by 23
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observationscited by 16
- 2023Interpretable learning of effective dynamics for multiscale systemscited by 11
- 2024Generative Learning for Forecasting the Dynamics of Complex Systemscited by 6
- 2022From latent dynamics to meaningful representationscited by 5
- 2021Physics-enhanced Neural Networks in the Small Data Regimecited by 3
- 2023Interpretable reduced-order modeling with time-scale separationcited by 2
- 2024Closure Discovery for Coarse-Grained Partial Differential Equations Using Grid-based Reinforcement Learningcited by 2
- 2021Physics-aware, deep probabilistic modeling of multiscale dynamics in the Small Data regimecited by 1
- 2025Reinforcement Learning Closures for Underresolved Partial Differential Equations using Synthetic Datacited by 0
- 2025Reinforcement Learning Closures for Underresolved Partial Differential Equations using Synthetic Data16 May 2025
- 2024Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observations31 Jul 2024
- 2024Generative Learning for Forecasting the Dynamics of Complex Systems27 Feb 2024
- 2024Closure Discovery for Coarse-Grained Partial Differential Equations Using Grid-based Reinforcement Learning1 Feb 2024
- 2023Interpretable learning of effective dynamics for multiscale systems11 Sep 2023
- 2023Interpretable reduced-order modeling with time-scale separation3 Mar 2023
- 2022Semi-supervised Invertible Neural Operators for Bayesian Inverse Problems6 Sep 2022
- 2022From latent dynamics to meaningful representations2 Sep 2022
- 2022Simulate Time-integrated Coarse-grained Molecular Dynamics with Multi-Scale Graph Networks21 Apr 2022
- 2021Physics-enhanced Neural Networks in the Small Data Regime19 Nov 2021
- 2021Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling25 Feb 2021
- 2021Physics-aware, deep probabilistic modeling of multiscale dynamics in the Small Data regime8 Feb 2021