# Neural Galerkin Normalizing Flows for Bayesian Inference of Diffusions with Inaccessible Boundaries

arXiv: https://arxiv.org/abs/2606.04324 · HTML: https://mlsanity.com/paper/2606.04324/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models.
- Builds on 18 of its 51 references that are in the map.
- First posted on arXiv 3 Jun 2026.

## Placed in

- Diffusion models / [Diffusion foundations and sampling](https://mlsanity.com/diffusion/diffusion-foundations-and-sampling/)

## Builds on (most cited first, 18 of 18)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Fast Inference from Transformers via Speculative Decoding](https://mlsanity.com/paper/2211.17192/) (2022)
- [DGM: A deep learning algorithm for solving partial differential equations](https://mlsanity.com/paper/1708.07469/) (2017)
- [Characterizing possible failure modes in physics-informed neural networks](https://mlsanity.com/paper/2109.01050/) (2021)
- [Solving high-dimensional partial differential equations using deep learning](https://mlsanity.com/paper/1707.02568/) (2017)
- [Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows](https://mlsanity.com/paper/1805.07226/) (2018)
- [Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) Sampling](https://mlsanity.com/paper/2207.02338/) (2022)
- [Neural Galerkin Schemes with Active Learning for High-Dimensional Evolution Equations](https://mlsanity.com/paper/2203.01360/) (2022)
- [Adaptive deep density approximation for Fokker-Planck equations](https://mlsanity.com/paper/2103.11181/) (2021)
- [Black-box Variational Inference for Stochastic Differential Equations](https://mlsanity.com/paper/1802.03335/) (2018)
- [Learning the temporal evolution of multivariate densities via normalizing flows](https://mlsanity.com/paper/2107.13735/) (2021)
- [Solving time dependent Fokker-Planck equations via temporal normalizing flow](https://mlsanity.com/paper/2112.14012/) (2021)
- [Combining physics-based and data-driven models: advancing the frontiers of research with Scientific Machine Learning](https://mlsanity.com/paper/2501.18708/) (2025)
- [Manifold Markov chain Monte Carlo methods for Bayesian inference in diffusion models](https://mlsanity.com/paper/1912.02982/) (2019)
- [Neural Galerkin Normalizing Flow for Transition Probability Density Functions of Diffusion Models](https://mlsanity.com/paper/2603.18907/) (2026)
- [Augmented pseudo-marginal Metropolis-Hastings for partially observed diffusion processes](https://mlsanity.com/paper/2009.05318/) (2020)
- [Towards Data-Conditional Simulation for ABC Inference in Stochastic Differential Equations](https://mlsanity.com/paper/2310.10329/) (2023)
- [Bayesian Inference for Non-Synchronously Observed Diffusions](https://mlsanity.com/paper/2503.00465/) (2025)

## Built on by (most cited first, 1 of 1)

- [A transition-density-based operator learning method for Fokker-Planck equations with various initial conditions](https://mlsanity.com/paper/2606.09434/) (2026)

## Abstract (arXiv)

One of the primary challenges in Bayesian inference on the parameters of a diffusion model from discrete observations is the unavailability of an analytical expression for the transition density function between consecutive observation times, which is needed to derive the likelihood function. Extending previous studies that solve Fokker-Planck (FP) type partial differential equations with Normalizing Flows, we propose a new Normalizing Flow architecture to learn the transition density function of the diffusion process between two observation times. We do so by solving in a Neural Galerkin framework the associated FP equation with a Dirac mass as initial condition, over a specified training distribution of the initial datum and the coefficients of the diffusion. We specifically focus on processes whose diffusion matrix vanishes in certain inaccessible boundary regions, such as Stochastic Volatility models that satisfy a Feller condition. The product of the obtained transition densities evaluated along the observed trajectory approximates the likelihood function, thereby enabling cheap posterior sampling via Markov chain Monte Carlo (MCMC). After the offline training phase, inference becomes significantly more efficient, as it avoids the need to solve the FP equation in real time for each parameter proposed by the MCMC sampler or to rely on other likelihood-free methods for Bayesian inference that involve repeated simulation of diffusion bridges.
