Variational Inference with Hamiltonian Monte Carlo
Not on the map. Why?
Abstract (arXiv)
Variational inference lies at the core of many state-of-the-art algorithms. To improve the approximation of the posterior beyond parametric families, it was proposed to include MCMC steps into the variational lower bound. In this work we explore this idea using steps of the Hamiltonian Monte Carlo (HMC) algorithm, an efficient MCMC method. In particular, we incorporate the acceptance step of the HMC algorithm, guaranteeing asymptotic convergence to the true posterior. Additionally, we introduce some extensions to the HMC algorithm geared towards faster convergence. The theoretical advantages of these modifications are reflected by performance improvements in our experimental results.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 3; 2024: 1; 2025: 2.
17 papers.
Sort:
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2021MCMC Variational Inference via Uncorrected Hamiltonian Annealingcited by 39
- 2022Langevin Diffusion Variational Inferencecited by 26
- 2021Nested Variational Inferencecited by 14
- 2021Surrogate Likelihoods for Variational Annealed Importance Samplingcited by 14
- 2022Bayesian inference via sparse Hamiltonian flowscited by 12
- 2022MixFlows: principled variational inference via mixed flowscited by 11
- 2022Alleviating Adversarial Attacks on Variational Autoencoders with MCMCcited by 10
- 2022Variational Inference with Locally Enhanced Bounds for Hierarchical Modelscited by 4
- 2021Interpolating between sampling and variational inference with infinite stochastic mixturescited by 3
- 2021Improving Actor-Critic Reinforcement Learning via Hamiltonian Monte Carlo Methodcited by 2
- 2023Reparameterized Variational Rejection Samplingcited by 2
5 more
- 2024Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distributioncited by 2
- 2022Optimization of Annealed Importance Sampling Hyperparameterscited by 1
- 2025Asymptotically exact variational flows via involutive MCMC kernelscited by 1
- 2025Accelerating Hamiltonian Monte Carlo for Bayesian Inference in Neural Networks and Neural Operatorscited by 1
- 2023Learning variational autoencoders via MCMC speed measurescited by 0
- 2025Accelerating Hamiltonian Monte Carlo for Bayesian Inference in Neural Networks and Neural Operators19 Jul 2025
- 2025Asymptotically exact variational flows via involutive MCMC kernels2 Jun 2025
- 2024Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution23 May 2024
- 2023Reparameterized Variational Rejection Sampling26 Sep 2023
- 2023Learning variational autoencoders via MCMC speed measures26 Aug 2023
- 2023A Survey on Uncertainty Quantification Methods for Deep Learning26 Feb 2023
- 2022Optimization of Annealed Importance Sampling Hyperparameters27 Sep 2022
- 2022Langevin Diffusion Variational Inference16 Aug 2022
- 2022MixFlows: principled variational inference via mixed flows16 May 2022
- 2022Alleviating Adversarial Attacks on Variational Autoencoders with MCMC18 Mar 2022
- 2022Bayesian inference via sparse Hamiltonian flows11 Mar 2022
- 2022Variational Inference with Locally Enhanced Bounds for Hierarchical Models8 Mar 2022
5 more
- 2021Surrogate Likelihoods for Variational Annealed Importance Sampling22 Dec 2021
- 2021Interpolating between sampling and variational inference with infinite stochastic mixtures18 Oct 2021
- 2021MCMC Variational Inference via Uncorrected Hamiltonian Annealing8 Jul 2021
- 2021Nested Variational Inference21 Jun 2021
- 2021Improving Actor-Critic Reinforcement Learning via Hamiltonian Monte Carlo Method22 Mar 2021
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
- 2021MCMC Variational Inference via Uncorrected Hamiltonian Annealingcited by 39
- 2022Langevin Diffusion Variational Inferencecited by 26
- 2021Nested Variational Inferencecited by 14
- 2021Surrogate Likelihoods for Variational Annealed Importance Samplingcited by 14
- 2022Bayesian inference via sparse Hamiltonian flowscited by 12
- 2022MixFlows: principled variational inference via mixed flowscited by 11
- 2022Alleviating Adversarial Attacks on Variational Autoencoders with MCMCcited by 10
- 2022Variational Inference with Locally Enhanced Bounds for Hierarchical Modelscited by 4
- 2021Interpolating between sampling and variational inference with infinite stochastic mixturescited by 3
- 2021Improving Actor-Critic Reinforcement Learning via Hamiltonian Monte Carlo Methodcited by 2
- 2023Reparameterized Variational Rejection Samplingcited by 2
12 most cited of 17 All 17 (JSON)
- 2025Accelerating Hamiltonian Monte Carlo for Bayesian Inference in Neural Networks and Neural Operators19 Jul 2025
- 2025Asymptotically exact variational flows via involutive MCMC kernels2 Jun 2025
- 2024Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution23 May 2024
- 2023Reparameterized Variational Rejection Sampling26 Sep 2023
- 2023Learning variational autoencoders via MCMC speed measures26 Aug 2023
- 2023A Survey on Uncertainty Quantification Methods for Deep Learning26 Feb 2023
- 2022Optimization of Annealed Importance Sampling Hyperparameters27 Sep 2022
- 2022Langevin Diffusion Variational Inference16 Aug 2022
- 2022MixFlows: principled variational inference via mixed flows16 May 2022
- 2022Alleviating Adversarial Attacks on Variational Autoencoders with MCMC18 Mar 2022
- 2022Bayesian inference via sparse Hamiltonian flows11 Mar 2022
- 2022Variational Inference with Locally Enhanced Bounds for Hierarchical Models8 Mar 2022
12 newest of 17 All 17 (JSON)