# Probabilistic Programs with Stochastic Conditioning

arXiv: https://arxiv.org/abs/2010.00282 · HTML: https://mlsanity.com/paper/2010.00282/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Oct 2020.

## Built on by (most cited first, 9 of 9)

- [Particle-based Online Bayesian Sampling](https://mlsanity.com/paper/2302.14796/) (2023)
- [Uncertain Evidence in Probabilistic Models and Stochastic Simulators](https://mlsanity.com/paper/2210.12236/) (2022)
- [Towards More General Control of Diffusion Models Using Jeffrey Guidance](https://mlsanity.com/paper/2606.13240/) (2026)
- [How To Train Your Program: a Probabilistic Programming Pattern for Bayesian Learning From Data](https://mlsanity.com/paper/2105.03650/) (2021)
- [Bob and Alice Go to a Bar: Reasoning About Future With Probabilistic Programs](https://mlsanity.com/paper/2108.03834/) (2021)
- [Mixed Nondeterministic-Probabilistic Automata: Blending graphical probabilistic models with nondeterminism](https://mlsanity.com/paper/2201.07474/) (2022)
- [Efficient Incremental Belief Updates Using Weighted Virtual Observations](https://mlsanity.com/paper/2402.06940/) (2024)
- [Position: AI for Science Should Treat Measurement-to-Dataset Pipelines as Inference Components](https://mlsanity.com/paper/2605.24558/) (2026)
- [A Bayesian Approach to Membership Inference for Statistical Release](https://mlsanity.com/paper/2605.30203/) (2026)

## Abstract (arXiv)

We tackle the problem of conditioning probabilistic programs on distributions of observable variables. Probabilistic programs are usually conditioned on samples from the joint data distribution, which we refer to as deterministic conditioning. However, in many real-life scenarios, the observations are given as marginal distributions, summary statistics, or samplers. Conventional probabilistic programming systems lack adequate means for modeling and inference in such scenarios. We propose a generalization of deterministic conditioning to stochastic conditioning, that is, conditioning on the marginal distribution of a variable taking a particular form. To this end, we first define the formal notion of stochastic conditioning and discuss its key properties. We then show how to perform inference in the presence of stochastic conditioning. We demonstrate potential usage of stochastic conditioning on several case studies which involve various kinds of stochastic conditioning and are difficult to solve otherwise. Although we present stochastic conditioning in the context of probabilistic programming, our formalization is general and applicable to other settings.