mlsanityData to 7 Oct 2026

A Multimodal Conditional Mixture Model with Distribution-Level Physics Priors

arXiv 2602.10451 ↗First posted 11 Feb 2026cs.LG physics.comp-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Many scientific and engineering systems exhibit intrinsically multimodal behavior arising from latent regime switching and non-unique physical mechanisms. In such settings, learning the full conditional distribution of admissible outcomes in a physically consistent and interpretable manner remains a challenge. While recent advances in machine learning have enabled powerful multimodal generative modeling, their integration with physics-constrained scientific modeling remains nontrivial, particularly when physical structure must be preserved or data are limited. This work develops a physics-informed multimodal conditional modeling framework based on mixture density representations. Mixture density networks (MDNs) provide an explicit and interpretable parameterization of multimodal conditional distributions. Physical knowledge is embedded through component-specific regularization terms that penalize violations of governing equations or physical laws. This formulation naturally accommodates non-uniqueness and stochasticity while remaining computationally efficient and amenable to conditioning on contextual inputs. The proposed framework is evaluated across a range of scientific problems in which multimodality arises from intrinsic physical mechanisms rather than observational noise, including bifurcation phenomena in nonlinear dynamical systems, stochastic partial differential equations, and atomistic-scale shock dynamics. In addition, the proposed method is compared with a conditional flow matching (CFM) model, a representative state-of-the-art generative modeling approach, demonstrating that MDNs can achieve competitive performance while offering a simpler and more interpretable formulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 58 references that are in the map. First posted on arXiv 11 Feb 2026.

Builds on

18 of 58 references.

References · 18

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  6. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  8. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  9. 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
  10. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
  11. 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 150
  12. 2024Physics-Informed Diffusion Modelscited by 88
6 more
  1. 2023CoCoGen: Physically-Consistent and Conditioned Score-based Generative Models for Forward and Inverse Problemscited by 54
  2. 2020A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observablescited by 28
  3. 2021A General Framework Combining Generative Adversarial Networks and Mixture Density Networks for Inverse Modeling in Microstructural Materials Designcited by 4
  4. 2023Micro-Macro Consistency in Multiscale Modeling: Score-Based Model Assisted Sampling of Fast/Slow Dynamical Systemscited by 4
  5. 2025Generative Learning for Slow Manifolds and Bifurcation Diagramscited by 3
  6. 2026Physics-constrained Gaussian Processes for Predicting Shockwave Hugoniot Curvescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Physics-aware, deep probabilistic modeling of multiscale dynamics in the Small Data regime
  2. 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty
  3. 2026PHDME: Physics-Informed Diffusion Models without Explicit Governing Equations
  4. 2024Generating Physical Dynamics under Priors
  5. 2025Incomplete Data, Complete Dynamics: A Diffusion Approach
  6. 2026Variational Grey-Box Dynamics Matching
  7. 2026PILD: Physics-Informed Learning via Diffusion
  8. 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme