mlsanityData to 14 Oct 2026

Asymptotically exact variational flows via involutive MCMC kernels

arXiv 2506.02162 ↗First posted 2 Jun 2025stat.CO stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Most expressive variational families -- such as normalizing flows -- lack practical convergence guarantees, as their theoretical assurances typically hold only at the intractable global optimum. In this work, we present a general recipe for constructing tuning-free, asymptotically exact variational flows on arbitrary state spaces from involutive MCMC kernels. The core methodological component is a novel representation of general involutive MCMC kernels as invertible, measurepreserving iterated random function systems, which act as the flow maps of our variational flows. This leads to three new variational families with provable total variation convergence. Our framework resolves key practical limitations of existing variational families with similar guarantees (e.g., MixFlows), while requiring substantially weaker theoretical assumptions. Finally, we demonstrate the competitive performance of our flows across tasks including posterior approximation, Monte Carlo estimates, and normalization constant estimation, outperforming or matching No-U-Turn sampler (NUTS) and black-box normalizing flows.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 87 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

39 of 87 references.

References · 39

  1. 2015Variational Inference with Normalizing Flowscited by 2,170
  2. 2016Density estimation using Real NVPcited by 2,042
  3. 2016Variational Inference: A Review for Statisticianscited by 1,472
  4. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  5. 2019Neural Spline Flowscited by 596
  6. 2017Variational Sequential Monte Carlocited by 95
  7. 2017Filtering Variational Objectivescited by 91
  8. 2021Annealed Flow Transport Monte Carlocited by 90
  9. 2015Hierarchical Variational Modelscited by 89
  10. 2018Sylvester Normalizing Flows for Variational Inferencecited by 72
  11. 2022Continual Repeated Annealed Flow Transport Monte Carlocited by 66
  12. 2021MCMC Variational Inference via Uncorrected Hamiltonian Annealingcited by 39
27 more
  1. 2016Variational Boosting: Iteratively Refining Posterior Approximationscited by 37
  2. 2020Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and Optimizationcited by 37
  3. 2021Monte Carlo Variational Auto-Encoderscited by 36
  4. 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noisecited by 36
  5. 2020The Expressive Power of a Class of Normalizing Flow Modelscited by 35
  6. 2022Langevin Diffusion Variational Inferencecited by 26
  7. 2020Representational aspects of depth and conditioning in normalizing flowscited by 25
  8. 2016Boosting Variational Inferencecited by 22
  9. 2020Involutive MCMC: a Unifying Frameworkcited by 19
  10. 2016Variational Inference with Hamiltonian Monte Carlocited by 17
  11. 2023A connection between Tempering and Entropic Mirror Descentcited by 16
  12. 2018Boosting Black Box Variational Inferencecited by 14
  13. 2021Surrogate Likelihoods for Variational Annealed Importance Samplingcited by 14
  14. 2019Universal Boosting Variational Inferencecited by 13
  15. 2022MixFlows: principled variational inference via mixed flowscited by 11
  16. 2021Nested hat R: Assessing the convergence of Markov chain Monte Carlo when running many short chainscited by 9
  17. 2021Hamiltonian Dynamics with Non-Newtonian Momentum for Rapid Samplingcited by 9
  18. 2024GIST: Gibbs self-tuning for locally adaptive Hamiltonian Monte Carlocited by 9
  19. 2024Variational Inference in Location-Scale Families: Exact Recovery of the Mean and Correlation Matrixcited by 9
  20. 2017Boosting Variational Inference: an Optimization Perspectivecited by 7
  21. 2024Incorporating Local Step-Size Adaptivity into the No-U-Turn Sampler using Gibbs Self Tuningcited by 7
  22. 2025Tuning Sequential Monte Carlo Samplers via Greedy Incremental Divergence Minimizationcited by 7
  23. 2023Embracing the chaos: analysis and diagnosis of numerical instability in variational flowscited by 6
  24. 2015Geometric ergodicity of the Random Walk Metropolis with position-dependent proposal covariancecited by 5
  25. 2021Deterministic Gibbs Sampling via Ordinary Differential Equationscited by 5
  26. 2023Mixed Variational Flows for Discrete Variablescited by 2
  27. 2024Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distributioncited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.