mlsanityData to 7 Oct 2026

Flow Perturbation to Accelerate Unbiased Sampling of Boltzmann distribution

arXiv 2407.10666 ↗First posted 15 Jul 2024stat.ML cs.LG physics.chem-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Flow-based generative models have been employed for sampling the Boltzmann distribution, but their application to high-dimensional systems is hindered by the significant computational cost of obtaining the Jacobian of the flow. To overcome this challenge, we introduce the flow perturbation method, which incorporates optimized stochastic perturbations into the flow. By reweighting trajectories generated by the perturbed flow, our method achieves unbiased sampling of the Boltzmann distribution with orders of magnitude speedup compared to both brute force Jacobian calculations and the Hutchinson estimator. Notably, it accurately sampled the Chignolin protein with all atomic Cartesian coordinates explicitly represented, which, to our best knowledge, is the largest molecule ever Boltzmann sampled in such detail using generative models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 15 Jul 2024.

Builds on

30 of 67 references.

References · 30

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2018Neural Ordinary Differential Equationscited by 3,733
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  8. 2015Variational Inference with Normalizing Flowscited by 2,161
  9. 2016Density estimation using Real NVPcited by 2,029
  10. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  11. 2014NICE: Non-linear Independent Components Estimationcited by 1,052
  12. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
18 more
  1. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  2. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
  3. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
  4. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 267
  5. 2023Flow Matching on General Geometriescited by 260
  6. 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 248
  7. 2021Path Integral Sampler: a stochastic control approach for samplingcited by 175
  8. 2020Stochastic Normalizing Flowscited by 156
  9. 2019Flow-based generative models for Markov chain Monte Carlo in lattice field theorycited by 147
  10. 2023Equivariant flow matchingcited by 131
  11. 2022Protein structure generation via folding diffusioncited by 113
  12. 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
  13. 2021Normalizing flows for atomic solidscited by 39
  14. 2023SE(3) Equivariant Augmented Coupling Flowscited by 37
  15. 2021Flow-based sampling for fermionic lattice field theoriescited by 27
  16. 2023Rigid Body Flows for Sampling Molecular Crystal Structurescited by 27
  17. 2023Diffusion Models as Stochastic Quantization in Lattice Field Theorycited by 24
  18. 2024Verlet Flows: Exact-Likelihood Integrators for Flow-Based Generative Modelscited by 2

Built on by

Not cited yet.