Efficient and Unbiased Sampling from Boltzmann Distributions via Variance-Tuned Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Score-based diffusion models (SBDMs) are powerful amortized samplers for Boltzmann distributions; however, imperfect score estimates bias downstream Monte Carlo estimates. Classical importance sampling (IS) can correct this bias, but computing exact likelihoods requires solving the probability-flow ordinary differential equation (PF-ODE), a procedure that is prohibitively costly and scales poorly with dimensionality. We introduce Variance-Tuned Diffusion Importance Sampling (VT-DIS), a lightweight post-training method that adapts the per-step noise covariance of a pretrained SBDM by minimizing the α-divergence (α=2) between its forward diffusion and reverse denoising trajectories. VT-DIS assigns a single trajectory-wise importance weight to the joint forward-reverse process, yielding unbiased expectation estimates at test time with negligible overhead compared to standard sampling. On the DW-4, LJ-13, and alanine-dipeptide benchmarks, VT-DIS achieves effective sample sizes of approximately 80 %, 35 %, and 3.5 %, respectively, while using only a fraction of the computational budget required by vanilla diffusion + IS or PF-ODE-based IS.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 27 of its 36 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
27 of 36 references.
Closest ancestors · 10
Same direction, newest first
- 2024Score-Optimal Diffusion Schedules10 Dec
- 2024Efficient and Unbiased Sampling of Boltzmann Distributions via Consistency Models11 Sep
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Models22 Apr
- 2023Consistency Models2 Mar
- 2023Denoising Diffusion Samplers27 Feb
- 2023Stable Target Field for Reduced Variance Score Estimation in Diffusion Models1 Feb
- 2022Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models15 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 17
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 677
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 516
- 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 250
- 2021Path Integral Sampler: a stochastic control approach for samplingcited by 181
- 2021E(n) Equivariant Normalizing Flowscited by 165
- 2023Equivariant flow matchingcited by 135
- 2022Flow Annealed Importance Sampling Bootstrapcited by 127
5 more
- 2024Iterated Denoising Energy Matching for Sampling from Boltzmann Densitiescited by 116
- 2023Improved sampling via learned diffusionscited by 104
- 2025Scalable Equilibrium Sampling with Sequential Boltzmann Generatorscited by 38
- 2023SE(3) Equivariant Augmented Coupling Flowscited by 37
- 2025No Trick, No Treat: Pursuits and Challenges Towards Simulation-free Training of Neural Samplerscited by 28
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025DriftLite: Lightweight Drift Control for Inference-Time Scaling of Diffusion Modelscited by 23
- 2025Energy-Weighted Flow Matching: Unlocking Continuous Normalizing Flows for Efficient and Scalable Boltzmann Samplingcited by 7
- 2025Boltzmann generators for amorphous particle systemscited by 6
- 2026Efficient Training of Boltzmann Generators Using Off-Policy Log-Dispersion Regularizationcited by 3
- 2025Efficient identification of critical regions via Flow Matching-based Monte Carlo initializationcited by 2
- 2026FUND: Density Flow for Sampling Unnormalised Distributionscited by 0
- 2026FUND: Density Flow for Sampling Unnormalised Distributions26 Sep 2026
- 2026Efficient Training of Boltzmann Generators Using Off-Policy Log-Dispersion Regularization3 Feb 2026
- 2025Boltzmann generators for amorphous particle systems18 Dec 2025
- 2025DriftLite: Lightweight Drift Control for Inference-Time Scaling of Diffusion Models25 Sep 2025
- 2025Energy-Weighted Flow Matching: Unlocking Continuous Normalizing Flows for Efficient and Scalable Boltzmann Sampling3 Sep 2025
- 2025Efficient identification of critical regions via Flow Matching-based Monte Carlo initialization21 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physics
- 2022Score-Based Diffusion meets Annealed Importance Sampling
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions
- 2026Variance-Reduced Diffusion Sampling via Target Score Identity
- 2025Importance Weighted Score Matching for Diffusion Samplers with Enhanced Mode Coverage
- 2026From Scores to Gibbs Correctors: Accelerating Uniform-Rate Discrete Diffusion Models
- 2025Diffusion Models: A Mathematical Introduction
- 2026Diversify Diffusion with Temperature Sampling and Variance-Corrective Time Shifting