# Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems

arXiv: https://arxiv.org/abs/1912.12976 · HTML: https://mlsanity.com/paper/1912.12976/

## Key facts

- Cited by 25 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Dec 2019.

## Built on by (most cited first, 25 of 25)

- [Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling](https://mlsanity.com/paper/2102.13156/) (2021)
- [Semi-supervised Invertible Neural Operators for Bayesian Inverse Problems](https://mlsanity.com/paper/2209.02772/) (2022)
- [Fully probabilistic deep models for forward and inverse problems in parametric PDEs](https://mlsanity.com/paper/2208.04856/) (2022)
- [Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observations](https://mlsanity.com/paper/2408.00157/) (2024)
- [Physics-aware, probabilistic model order reduction with guaranteed stability](https://mlsanity.com/paper/2101.05834/) (2021)
- [Interpretable learning of effective dynamics for multiscale systems](https://mlsanity.com/paper/2309.05812/) (2023)
- [Generative Learning for Forecasting the Dynamics of Complex Systems](https://mlsanity.com/paper/2402.17157/) (2024)
- [Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media](https://mlsanity.com/paper/2405.19019/) (2024)
- [Weak neural variational inference for solving Bayesian inverse problems without forward models: applications in elastography](https://mlsanity.com/paper/2407.20697/) (2024)
- [DGenNO: A Novel Physics-aware Neural Operator for Solving Forward and Inverse PDE Problems based on Deep, Generative Probabilistic Modeling](https://mlsanity.com/paper/2502.06250/) (2025)
- [SDYN-GANs: Adversarial Learning Methods for Multistep Generative Models for General Order Stochastic Dynamics](https://mlsanity.com/paper/2302.03663/) (2023)
- [Physics-enhanced Neural Networks in the Small Data Regime](https://mlsanity.com/paper/2111.10329/) (2021)
- [Learning to Decouple Complex Systems](https://mlsanity.com/paper/2302.01581/) (2023)
- [A Primer on Variational Inference for Physics-Informed Deep Generative Modelling](https://mlsanity.com/paper/2409.06560/) (2024)
- [Interpretable reduced-order modeling with time-scale separation](https://mlsanity.com/paper/2303.02189/) (2023)
- [Closure Discovery for Coarse-Grained Partial Differential Equations Using Grid-based Reinforcement Learning](https://mlsanity.com/paper/2402.00972/) (2024)
- [Physics-aware, deep probabilistic modeling of multiscale dynamics in the Small Data regime](https://mlsanity.com/paper/2102.04269/) (2021)
- [Predicting and explaining nonlinear material response using deep Physically Guided Neural Networks with Internal Variables](https://mlsanity.com/paper/2308.03915/) (2023)
- [Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder](https://mlsanity.com/paper/2404.12267/) (2024)
- [The Illusion of Fit: Spatially Resolved Assessment of Constitutive Model Validity in Elastography and Physics-Based Inverse Problems](https://mlsanity.com/paper/2502.07415/) (2025)
- [Connecting the geometry and dynamics of many-body complex systems with message passing neural operators](https://mlsanity.com/paper/2502.15913/) (2025)
- [Reinforcement Learning Closures for Underresolved Partial Differential Equations using Synthetic Data](https://mlsanity.com/paper/2505.11308/) (2025)
- [GenPANIS: A Latent-Variable Generative Framework for Forward and Inverse PDE Problems in Multiphase Media](https://mlsanity.com/paper/2602.14642/) (2026)
- [Dynamic Training-Free Fusion of Subject and Style LoRAs](https://mlsanity.com/paper/2602.15539/) (2026)
- [Scalable Bayesian Inference for Nonlinear Conservation Laws](https://mlsanity.com/paper/2605.31127/) (2026)

## Abstract (arXiv)

Data-based discovery of effective, coarse-grained (CG) models of high-dimensional dynamical systems presents a unique challenge in computational physics and particularly in the context of multiscale problems. The present paper offers a data-based, probablistic perspective that enables the quantification of predictive uncertainties. One of the outstanding problems has been the introduction of physical constraints in the probabilistic machine learning objectives. The primary utility of such constraints stems from the undisputed physical laws such as conservation of mass, energy etc. that they represent. Furthermore and apart from leading to physically realistic predictions, they can significantly reduce the requisite amount of training data which for high-dimensional, multiscale systems are expensive to obtain (Small Data regime). We formulate the coarse-graining process by employing a probabilistic state-space model and account for the aforementioned equality constraints as virtual observables in the associated densities. We demonstrate how probabilistic inference tools can be employed to identify the coarse-grained variables in combination with deep neural nets and their evolution model without ever needing to define a fine-to-coarse (restriction) projection and without needing time-derivatives of state variables. Furthermore, it is capable of reconstructing the evolution of the full, fine-scale system and therefore the observables of interest need not be selected a priori. We demonstrate the efficacy of the proposed framework by applying it to systems of interacting particles and an image-series of a nonlinear pendulum.