mlsanityData to 7 Oct 2026

Flow Perturbation++: Multi-Step Unbiased Jacobian Estimation for High-Dimensional Boltzmann Sampling

arXiv 2601.21177 ↗First posted 29 Jan 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The scalability of continuous normalizing flows (CNFs) for unbiased Boltzmann sampling remains limited in high-dimensional systems due to the cost of Jacobian-determinant evaluation, which requires D backpropagation passes through the flow layers. Existing stochastic Jacobian estimators such as the Hutchinson trace estimator reduce computation but introduce bias, while the recently proposed Flow Perturbation method is unbiased yet suffers from high variance. We present Flow Perturbation++, a variance-reduced extension of Flow Perturbation that discretizes the probability-flow ODE and performs unbiased stepwise Jacobian estimation at each integration step. This multi-step construction retains the unbiasedness of Flow Perturbation while achieves substantially lower estimator variance. Integrated into a Sequential Monte Carlo framework, Flow Perturbation++ achieves significantly improved equilibrium sampling on a 1000D Gaussian Mixture Model and the all-atom Chignolin protein compared with Hutchinson-based and single-step Flow Perturbation baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 52 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

27 of 52 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  6. 2018Neural Ordinary Differential Equationscited by 3,733
  7. 2015Variational Inference with Normalizing Flowscited by 2,161
  8. 2016Density estimation using Real NVPcited by 2,029
  9. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  10. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
  11. 2017Reinforcement Learning with Deep Energy-Based Policiescited by 659
  12. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
15 more
  1. 2018Invertible Residual Networkscited by 364
  2. 2021GFlowNet Foundationscited by 286
  3. 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 248
  4. 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 244
  5. 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
  6. 2023Equivariant flow matchingcited by 131
  7. 2021Annealed Flow Transport Monte Carlocited by 90
  8. 2024Conv-Basis: A New Paradigm for Efficient Attention Inference and Gradient Computation in Transformerscited by 32
  9. 2024Maximum Entropy Reinforcement Learning via Energy-Based Normalizing Flowcited by 25
  10. 2023Diffusion Models as Stochastic Quantization in Lattice Field Theorycited by 24
  11. 2019Soft Policy Gradient Method for Maximum Entropy Deep Reinforcement Learningcited by 18
  12. 2024S2AC: Energy-Based Reinforcement Learning with Stein Soft Actor Criticcited by 18
  13. 2024Sampling from Energy-based Policies using Diffusioncited by 15
  14. 2024Verlet Flows: Exact-Likelihood Integrators for Flow-Based Generative Modelscited by 2
  15. 2022Statistical Distance Based Deterministic Offspring Selection in SMC Methodscited by 1

Built on by

Not cited yet.