# Generative Modeling with Bayesian Sample Inference

arXiv: https://arxiv.org/abs/2502.07580 · HTML: https://mlsanity.com/paper/2502.07580/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 37 of its 54 references that are in the map.
- First posted on arXiv 11 Feb 2025.

## Builds on (most cited first, 30 of 37)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [Denoising Diffusion Implicit Models](https://mlsanity.com/paper/2010.02502/) (2020)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [Diffusion Models Beat GANs on Image Synthesis](https://mlsanity.com/paper/2105.05233/) (2021)
- [Deep Unsupervised Learning using Nonequilibrium Thermodynamics](https://mlsanity.com/paper/1503.03585/) (2015)
- [Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding](https://mlsanity.com/paper/2205.11487/) (2022)
- [Scalable Diffusion Models with Transformers](https://mlsanity.com/paper/2212.09748/) (2022)
- [Flow Matching for Generative Modeling](https://mlsanity.com/paper/2210.02747/) (2022)
- [Generative Adversarial Networks](https://mlsanity.com/paper/2203.00667/) (2022)
- [Improved Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2102.09672/) (2021)
- [Elucidating the Design Space of Diffusion-Based Generative Models](https://mlsanity.com/paper/2206.00364/) (2022)
- [Variational Inference with Normalizing Flows](https://mlsanity.com/paper/1505.05770/) (2015)
- [Variational Diffusion Models](https://mlsanity.com/paper/2107.00630/) (2021)
- [Stochastic Interpolants: A Unifying Framework for Flows and Diffusions](https://mlsanity.com/paper/2303.08797/) (2023)
- [Improved Techniques for Training Consistency Models](https://mlsanity.com/paper/2310.14189/) (2023)
- [A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets](https://mlsanity.com/paper/1707.08819/) (2017)
- [A note on the evaluation of generative models](https://mlsanity.com/paper/1511.01844/) (2015)
- [Generative Modelling With Inverse Heat Dissipation](https://mlsanity.com/paper/2206.13397/) (2022)
- [Predict, Refine, Synthesize: Self-Guiding Diffusion Models for Probabilistic Time Series Forecasting](https://mlsanity.com/paper/2307.11494/) (2023)
- [Bayesian Flow Networks](https://mlsanity.com/paper/2308.07037/) (2023)
- [From Zero to Turbulence: Generative Modeling for 3D Flow Simulation](https://mlsanity.com/paper/2306.01776/) (2023)
- [Sequential Controlled Langevin Diffusions](https://mlsanity.com/paper/2412.07081/) (2024)
- [Flow Matching with Gaussian Process Priors for Probabilistic Time Series Forecasting](https://mlsanity.com/paper/2410.03024/) (2024)
- [HiLLoC: Lossless Image Compression with Hierarchical Latent Variable Models](https://mlsanity.com/paper/1912.09953/) (2019)
- [Unifying Bayesian Flow Networks and Diffusion Models through Stochastic Differential Equations](https://mlsanity.com/paper/2404.15766/) (2024)

## Built on by (most cited first, 4 of 4)

- [Edit-Based Flow Matching for Temporal Point Processes](https://mlsanity.com/paper/2510.06050/) (2025)
- [Flow Matching Neural Processes](https://mlsanity.com/paper/2512.23853/) (2025)
- [Information Theoretic Learning for Diffusion Models with Warm Start](https://mlsanity.com/paper/2510.20903/) (2025)
- [Discrete Bayesian Sample Inference for Graph Generation](https://mlsanity.com/paper/2511.03015/) (2025)

## Abstract (arXiv)

We present a novel view of diffusion-like generative modeling from the perspective of iterative Gaussian posterior inference. By treating the generated sample as an unknown variable, we formulate the sampling process in the language of Bayesian probability: at each step, a model predicts the unknown sample from our current belief state and we compute a posterior belief from that prediction. Based on this formulation, we propose the generative model Bayesian Sample Inference (BSI). In addition to a rigorous theoretical analysis, we show that our perspective includes Bayesian Flow Networks (BFNs) and that BSI and BFNs represent the two opposite ends of a range of isotropic hyper-priors over the initial belief state. In our experiments, we demonstrate that BSI improves sample quality over both BFNs and the closely related Variational Diffusion Models on ImageNet32 and ImageNet64, while achieving equivalent log-likelihoods on both datasets.