Hierarchical Variational Models
Not on the map. Why?
Abstract (arXiv)
Black box variational inference allows researchers to easily prototype and evaluate an array of models. Recent advances allow such algorithms to scale to high dimensions. However, a central question remains: How to specify an expressive variational distribution that maintains efficient computation? To address this, we develop hierarchical variational models (HVMs). HVMs augment a variational approximation with a prior on its parameters, which allows it to capture complex structure for both discrete and continuous latent variables. The algorithm we develop is black box, can be used for any HVM, and has the same computational efficiency as the original approximation. We study HVMs on a variety of deep discrete latent variable models. HVMs generalize other expressive variational distributions and maintains higher fidelity to the posterior.
Key facts. Cited by 89 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 24; 2022: 14; 2023: 19; 2024: 15; 2025: 8; 2026: 8.
89 papers.
Sort:
By area:
- 2022GFlowNets and variational inferencecited by 106
- 2025DIME:Diffusion-Based Maximum Entropy Reinforcement Learningcited by 58
- 2023Local Search GFlowNetscited by 48
- 2021Monte Carlo Variational Auto-Encoderscited by 36
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusionscited by 29
- 2025Beyond Verifiable Rewards: Scaling Reinforcement Learning for Language Models to Unverifiable Datacited by 29
- 2022Efficient-VDVAE: Less is morecited by 26
- 2022Unifying Generative Models with GFlowNets and Beyondcited by 24
- 2024Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalitiescited by 24
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2023Learning to Jump: Thinning and Thickening Latent Counts for Generative Modelingcited by 18
- 2020Non-Adversarial Imitation Learning and its Connections to Adversarial Methodscited by 17
38 more
- 2021Sparse Uncertainty Representation in Deep Learning with Inducing Weightscited by 16
- 2022Amortized Variational Inference: A Systematic Reviewcited by 16
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Accelerationcited by 14
- 2023Unified Brain MR-Ultrasound Synthesis using Multi-Modal Hierarchical Representationscited by 13
- 2023Order-Preserving GFlowNetscited by 13
- 2023Learning Energy-Based Prior Model with Diffusion-Amortized MCMCcited by 13
- 2021VAE Approximation Error: ELBO and Exponential Familiescited by 12
- 2021A unified view of likelihood ratio and reparameterization gradientscited by 12
- 2021On Incorporating Inductive Biases into VAEscited by 11
- 2022MixFlows: principled variational inference via mixed flowscited by 11
- 2022Alleviating Adversarial Attacks on Variational Autoencoders with MCMCcited by 10
- 2023Tree Variational Autoencoderscited by 10
- 2021Efficient Semi-Implicit Variational Inferencecited by 9
- 2021Automatic variational inference with cascading flowscited by 9
- 2021Variational Predictive Routing with Nested Subjective Timescalescited by 9
- 2024Unified Cross-Modal Medical Image Synthesis with Hierarchical Mixture of Product-of-Expertscited by 9
- 2022Recursive Monte Carlo and Variational Inference with Auxiliary Variablescited by 8
- 2024Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social mediacited by 8
- 2024Hierarchical VAE with a Diffusion-based VampPriorcited by 8
- 2021Structured Dropout Variational Inference for Bayesian Neural Networkscited by 7
- 2021Diagnosing Vulnerability of Variational Auto-Encoders to Adversarial Attackscited by 7
- 2021Variational Inference with NoFAS: Normalizing Flow with Adaptive Surrogate for Computationally Expensive Modelscited by 7
- 2021Multi-Task Neural Processescited by 7
- 2024What's the score? Automated Denoising Score Matching for Nonlinear Diffusionscited by 7
- 2021Variational Marginal Particle Filterscited by 6
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentationcited by 6
- 2025Reinforced sequential Monte Carlo for amortised samplingcited by 6
- 2023Variational Inference for Bayesian Neural Networks under Model and Parameter Uncertaintycited by 5
- 2024A Probabilistic Model Behind Self-Supervised Learningcited by 5
- 2025Neural Stochastic Flows: Solver-Free Modelling and Inference for SDE Solutionscited by 5
- 2021ADAVI: Automatic Dual Amortized Variational Inference Applied To Pyramidal Bayesian Modelscited by 4
- 2022Black-box Coreset Variational Inferencecited by 4
- 2023Predictive World Models from Real-World Partial Observationscited by 4
- 2023Calibrating the Rigged Lottery: Making All Tickets Reliablecited by 4
- 2024Provably Scalable Black-Box Variational Inference with Structured Variational Familiescited by 4
- 2024Probabilistic Programming with Programmable Variational Inferencecited by 4
- 2026f-Trajectory Balance: A Loss Family for Tuning GFlowNets, Generative Models, and LLMs with Off- and On-Policy Datacited by 4
- 2021Interpolating between sampling and variational inference with infinite stochastic mixturescited by 3
50 most cited of 89 All 89 (JSON)
- 2026Large-scale empirical tuning and comparison of default optimizers for variational inference5 Jun 2026
- 2026Hierarchical Variational Policies for Reward-Guided Diffusion20 May 2026
- 2026f-Trajectory Balance: A Loss Family for Tuning GFlowNets, Generative Models, and LLMs with Off- and On-Policy Data14 May 2026
- 2026Anchored Variational Inference for Personalized Sequential Latent-State Models25 Apr 2026
- 2026Variational Learning of Fractional Posteriors29 Mar 2026
- 2026Path-Space Mirror Descent for On-Policy Reinforcement Learning under the Generalized Schr"odinger Bridge23 Mar 2026
- 2026Discrete diffusion samplers and bridges: Off-policy algorithms and applications in latent spaces5 Feb 2026
- 2026A Kernel Approach for Semi-implicit Variational Inference17 Jan 2026
- 2025Probabilistic Digital Twins of Users: Latent Representation Learning with Statistically Validated Semantics19 Dec 2025
- 2025Neural Stochastic Flows: Solver-Free Modelling and Inference for SDE Solutions29 Oct 2025
- 2025Reinforced sequential Monte Carlo for amortised sampling13 Oct 2025
- 2025A Hierarchical Variational Graph Fused Lasso for Recovering Relative Rates in Spatial Compositional Data25 Sep 2025
38 more
- 2025Continuous Semi-Implicit Models7 Jun 2025
- 2025Asymptotically exact variational flows via involutive MCMC kernels2 Jun 2025
- 2025Beyond Verifiable Rewards: Scaling Reinforcement Learning for Language Models to Unverifiable Data25 Mar 2025
- 2025DIME:Diffusion-Based Maximum Entropy Reinforcement Learning4 Feb 2025
- 2024Integrating Random Effects in Variational Autoencoders for Dimensionality Reduction of Correlated Data22 Dec 2024
- 2024Hierarchical VAE with a Diffusion-based VampPrior2 Dec 2024
- 2024A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation25 Nov 2024
- 2024Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalities1 Nov 2024
- 2024ELBOing Stein: Variational Bayes with Stein Mixture Inference30 Oct 2024
- 2024Unified Cross-Modal Medical Image Synthesis with Hierarchical Mixture of Product-of-Experts25 Oct 2024
- 2024What's the score? Automated Denoising Score Matching for Nonlinear Diffusions10 Jul 2024
- 2024Probabilistic Programming with Programmable Variational Inference22 Jun 2024
- 2024Federated Learning for Non-factorizable Models using Deep Generative Prior Approximations25 May 2024
- 2024Scalable Vertical Federated Learning via Data Augmentation and Amortized Inference7 May 2024
- 2024Integrative Variational Autoencoders for Generative Modeling of an Image Outcome with Multiple Input Images5 Feb 2024
- 2024A Probabilistic Model Behind Self-Supervised Learning2 Feb 2024
- 2024Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social media29 Jan 2024
- 2024Provably Scalable Black-Box Variational Inference with Structured Variational Families19 Jan 2024
- 2024Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors5 Jan 2024
- 2023Multinomial belief networks for healthcare data28 Nov 2023
- 2023Diffusion models for probabilistic programming1 Nov 2023
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration26 Oct 2023
- 2023Learning Energy-Based Prior Model with Diffusion-Amortized MCMC5 Oct 2023
- 2023Local Search GFlowNets4 Oct 2023
- 2023Order-Preserving GFlowNets30 Sep 2023
- 2023Unified Brain MR-Ultrasound Synthesis using Multi-Modal Hierarchical Representations15 Sep 2023
- 2023Learning variational autoencoders via MCMC speed measures26 Aug 2023
- 2023Tree Variational Autoencoders15 Jun 2023
- 2023Learning to Jump: Thinning and Thickening Latent Counts for Generative Modeling28 May 2023
- 2023Parameter Estimation in DAGs from Incomplete Data via Optimal Transport25 May 2023
- 2023Variational Nonlinear Kalman Filtering with Unknown Process Noise Covariance6 May 2023
- 2023Sparsifying Bayesian neural networks with latent binary variables and normalizing flows5 May 2023
- 2023Variational Inference for Bayesian Neural Networks under Model and Parameter Uncertainty1 May 2023
- 2023Collective Relational Inference for learning heterogeneous interactions30 Apr 2023
- 2023Calibrating the Rigged Lottery: Making All Tickets Reliable18 Feb 2023
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions14 Feb 2023
- 2023Predictive World Models from Real-World Partial Observations12 Jan 2023
- 2023Constraining cosmological parameters from N-body simulations with Variational Bayesian Neural Networks9 Jan 2023
50 newest of 89 All 89 (JSON)
- 2025DIME:Diffusion-Based Maximum Entropy Reinforcement Learningcited by 58
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusionscited by 29
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Accelerationcited by 14
- 2024What's the score? Automated Denoising Score Matching for Nonlinear Diffusionscited by 7
- 2024Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriorscited by 2
- 2026Discrete diffusion samplers and bridges: Off-policy algorithms and applications in latent spacescited by 2
- 2023Diffusion models for probabilistic programmingcited by 1
- 2025Continuous Semi-Implicit Modelscited by 0
- 2026Hierarchical Variational Policies for Reward-Guided Diffusioncited by 0
- 2026Hierarchical Variational Policies for Reward-Guided Diffusion20 May 2026
- 2026Discrete diffusion samplers and bridges: Off-policy algorithms and applications in latent spaces5 Feb 2026
- 2025Continuous Semi-Implicit Models7 Jun 2025
- 2025DIME:Diffusion-Based Maximum Entropy Reinforcement Learning4 Feb 2025
- 2024What's the score? Automated Denoising Score Matching for Nonlinear Diffusions10 Jul 2024
- 2024Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors5 Jan 2024
- 2023Diffusion models for probabilistic programming1 Nov 2023
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration26 Oct 2023
- 2023Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions14 Feb 2023
- 2023Predictive World Models from Real-World Partial Observations12 Jan 2023
- 2022GFlowNets and variational inferencecited by 106
- 2023Local Search GFlowNetscited by 48
- 2021Monte Carlo Variational Auto-Encoderscited by 36
- 2025Beyond Verifiable Rewards: Scaling Reinforcement Learning for Language Models to Unverifiable Datacited by 29
- 2022Efficient-VDVAE: Less is morecited by 26
- 2022Unifying Generative Models with GFlowNets and Beyondcited by 24
- 2024Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalitiescited by 24
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2023Learning to Jump: Thinning and Thickening Latent Counts for Generative Modelingcited by 18
- 2021Sparse Uncertainty Representation in Deep Learning with Inducing Weightscited by 16
- 2022Amortized Variational Inference: A Systematic Reviewcited by 16
- 2023Unified Brain MR-Ultrasound Synthesis using Multi-Modal Hierarchical Representationscited by 13
12 most cited of 77 All 77 (JSON)
- 2026Large-scale empirical tuning and comparison of default optimizers for variational inference5 Jun 2026
- 2026f-Trajectory Balance: A Loss Family for Tuning GFlowNets, Generative Models, and LLMs with Off- and On-Policy Data14 May 2026
- 2026Anchored Variational Inference for Personalized Sequential Latent-State Models25 Apr 2026
- 2026Variational Learning of Fractional Posteriors29 Mar 2026
- 2026A Kernel Approach for Semi-implicit Variational Inference17 Jan 2026
- 2025Probabilistic Digital Twins of Users: Latent Representation Learning with Statistically Validated Semantics19 Dec 2025
- 2025Neural Stochastic Flows: Solver-Free Modelling and Inference for SDE Solutions29 Oct 2025
- 2025Reinforced sequential Monte Carlo for amortised sampling13 Oct 2025
- 2025A Hierarchical Variational Graph Fused Lasso for Recovering Relative Rates in Spatial Compositional Data25 Sep 2025
- 2025Asymptotically exact variational flows via involutive MCMC kernels2 Jun 2025
- 2025Beyond Verifiable Rewards: Scaling Reinforcement Learning for Language Models to Unverifiable Data25 Mar 2025
- 2024Integrating Random Effects in Variational Autoencoders for Dimensionality Reduction of Correlated Data22 Dec 2024
12 newest of 77 All 77 (JSON)