Structured Stochastic Variational Inference
Not on the map. Why?
Abstract (arXiv)
Stochastic variational inference makes it possible to approximate posterior distributions induced by large datasets quickly using stochastic optimization. The algorithm relies on the use of fully factorized variational distributions. However, this "mean-field" independence approximation limits the fidelity of the posterior approximation, and introduces local optima. We show how to relax the mean-field approximation to allow arbitrary dependencies between global parameters and local hidden variables, producing better parameter estimates by reducing bias, sensitivity to local optima, and sensitivity to hyperparameters.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 2; 2023: 4; 2024: 5; 2025: 2; 2026: 2.
21 papers.
Sort:
By area:
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flowscited by 56
- 2024Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inferencecited by 16
- 2021Structured Stochastic Gradient MCMCcited by 12
- 2021Automatic variational inference with cascading flowscited by 9
- 2024Batch, match, and patch: low-rank approximations for score-based variational inferencecited by 8
- 2025Towards Identifiability of Hierarchical Temporal Causal Representation Learningcited by 7
- 2023Federated Variational Inference Methods for Structured Latent Variable Modelscited by 4
- 2021ADAVI: Automatic Dual Amortized Variational Inference Applied To Pyramidal Bayesian Modelscited by 3
- 2024Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Samplingcited by 3
- 2025Probabilistic Curriculum Learning for Goal-Based Reinforcement Learningcited by 2
- 2021Relay Variational Inference: A Method for Accelerated Encoderless VIcited by 1
- 2022PAVI: Plate-Amortized Variational Inferencecited by 1
9 more
- 2022Structured Recognition for Generative Models with Explaining Awaycited by 1
- 2023DBGDGM: Dynamic Brain Graph Deep Generative Modelcited by 1
- 2023Parameter Estimation in DAGs from Incomplete Data via Optimal Transportcited by 1
- 2023PAVI: Plate-Amortized Variational Inferencecited by 1
- 2024Flexible Bayesian Last Layer Models Using Implicit Priors and Diffusion Posterior Samplingcited by 1
- 2024Decentralised Variational Inference Frameworks for Multi-object Tracking on Sensor Networks: Additional Notescited by 1
- 2026Scalable Mean-Field Variational Inference via Preconditioned Primal-Dual Optimizationcited by 1
- 2021A derivation of variational message passing (VMP) for latent Dirichlet allocation (LDA)cited by 0
- 2026Structured Nonparametric Variational Inference for Dependent Latent Modelingcited by 0
- 2026Structured Nonparametric Variational Inference for Dependent Latent Modeling13 Jun 2026
- 2026Scalable Mean-Field Variational Inference via Preconditioned Primal-Dual Optimization7 Feb 2026
- 2025Towards Identifiability of Hierarchical Temporal Causal Representation Learning21 Oct 2025
- 2025Probabilistic Curriculum Learning for Goal-Based Reinforcement Learning2 Apr 2025
- 2024Batch, match, and patch: low-rank approximations for score-based variational inference29 Oct 2024
- 2024Decentralised Variational Inference Frameworks for Multi-object Tracking on Sensor Networks: Additional Notes24 Aug 2024
- 2024Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling13 Aug 2024
- 2024Flexible Bayesian Last Layer Models Using Implicit Priors and Diffusion Posterior Sampling7 Aug 2024
- 2024Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inference24 Jul 2024
- 2023PAVI: Plate-Amortized Variational Inference30 Aug 2023
- 2023Parameter Estimation in DAGs from Incomplete Data via Optimal Transport25 May 2023
- 2023Federated Variational Inference Methods for Structured Latent Variable Models7 Feb 2023
9 more
- 2023DBGDGM: Dynamic Brain Graph Deep Generative Model26 Jan 2023
- 2022Structured Recognition for Generative Models with Explaining Away12 Sep 2022
- 2022PAVI: Plate-Amortized Variational Inference10 Jun 2022
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flows20 Nov 2021
- 2021A derivation of variational message passing (VMP) for latent Dirichlet allocation (LDA)2 Nov 2021
- 2021Relay Variational Inference: A Method for Accelerated Encoderless VI26 Oct 2021
- 2021Structured Stochastic Gradient MCMC19 Jul 2021
- 2021ADAVI: Automatic Dual Amortized Variational Inference Applied To Pyramidal Bayesian Models23 Jun 2021
- 2021Automatic variational inference with cascading flows9 Feb 2021
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flowscited by 56
- 2021Structured Stochastic Gradient MCMCcited by 12
- 2021Automatic variational inference with cascading flowscited by 9
- 2024Batch, match, and patch: low-rank approximations for score-based variational inferencecited by 8
- 2025Towards Identifiability of Hierarchical Temporal Causal Representation Learningcited by 7
- 2023Federated Variational Inference Methods for Structured Latent Variable Modelscited by 4
- 2021ADAVI: Automatic Dual Amortized Variational Inference Applied To Pyramidal Bayesian Modelscited by 3
- 2024Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Samplingcited by 3
- 2025Probabilistic Curriculum Learning for Goal-Based Reinforcement Learningcited by 2
- 2021Relay Variational Inference: A Method for Accelerated Encoderless VIcited by 1
- 2022PAVI: Plate-Amortized Variational Inferencecited by 1
- 2022Structured Recognition for Generative Models with Explaining Awaycited by 1
12 most cited of 20 All 20 (JSON)
- 2026Structured Nonparametric Variational Inference for Dependent Latent Modeling13 Jun 2026
- 2026Scalable Mean-Field Variational Inference via Preconditioned Primal-Dual Optimization7 Feb 2026
- 2025Towards Identifiability of Hierarchical Temporal Causal Representation Learning21 Oct 2025
- 2025Probabilistic Curriculum Learning for Goal-Based Reinforcement Learning2 Apr 2025
- 2024Batch, match, and patch: low-rank approximations for score-based variational inference29 Oct 2024
- 2024Decentralised Variational Inference Frameworks for Multi-object Tracking on Sensor Networks: Additional Notes24 Aug 2024
- 2024Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling13 Aug 2024
- 2024Flexible Bayesian Last Layer Models Using Implicit Priors and Diffusion Posterior Sampling7 Aug 2024
- 2023PAVI: Plate-Amortized Variational Inference30 Aug 2023
- 2023Parameter Estimation in DAGs from Incomplete Data via Optimal Transport25 May 2023
- 2023Federated Variational Inference Methods for Structured Latent Variable Models7 Feb 2023
- 2023DBGDGM: Dynamic Brain Graph Deep Generative Model26 Jan 2023
12 newest of 20 All 20 (JSON)