A Multimodal Conditional Mixture Model with Distribution-Level Physics Priors
Not on the map. Why?
Abstract (arXiv)
Many scientific and engineering systems exhibit intrinsically multimodal behavior arising from latent regime switching and non-unique physical mechanisms. In such settings, learning the full conditional distribution of admissible outcomes in a physically consistent and interpretable manner remains a challenge. While recent advances in machine learning have enabled powerful multimodal generative modeling, their integration with physics-constrained scientific modeling remains nontrivial, particularly when physical structure must be preserved or data are limited. This work develops a physics-informed multimodal conditional modeling framework based on mixture density representations. Mixture density networks (MDNs) provide an explicit and interpretable parameterization of multimodal conditional distributions. Physical knowledge is embedded through component-specific regularization terms that penalize violations of governing equations or physical laws. This formulation naturally accommodates non-uniqueness and stochasticity while remaining computationally efficient and amenable to conditioning on contextual inputs. The proposed framework is evaluated across a range of scientific problems in which multimodality arises from intrinsic physical mechanisms rather than observational noise, including bifurcation phenomena in nonlinear dynamical systems, stochastic partial differential equations, and atomistic-scale shock dynamics. In addition, the proposed method is compared with a conditional flow matching (CFM) model, a representative state-of-the-art generative modeling approach, demonstrating that MDNs can achieve competitive performance while offering a simpler and more interpretable formulation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 58 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
18 of 58 references.
References · 18
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 150
- 2024Physics-Informed Diffusion Modelscited by 88
6 more
- 2023CoCoGen: Physically-Consistent and Conditioned Score-based Generative Models for Forward and Inverse Problemscited by 54
- 2020A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observablescited by 28
- 2021A General Framework Combining Generative Adversarial Networks and Mixture Density Networks for Inverse Modeling in Microstructural Materials Designcited by 4
- 2023Micro-Macro Consistency in Multiscale Modeling: Score-Based Model Assisted Sampling of Fast/Slow Dynamical Systemscited by 4
- 2025Generative Learning for Slow Manifolds and Bifurcation Diagramscited by 3
- 2026Physics-constrained Gaussian Processes for Predicting Shockwave Hugoniot Curvescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2021Physics-aware, deep probabilistic modeling of multiscale dynamics in the Small Data regime
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty
- 2026PHDME: Physics-Informed Diffusion Models without Explicit Governing Equations
- 2024Generating Physical Dynamics under Priors
- 2025Incomplete Data, Complete Dynamics: A Diffusion Approach
- 2026Variational Grey-Box Dynamics Matching
- 2026PILD: Physics-Informed Learning via Diffusion
- 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme