Semi-Implicit Variational Inference
Not on the map. Why?
Abstract (arXiv)
Semi-implicit variational inference (SIVI) is introduced to expand the commonly used analytic variational distribution family, by mixing the variational parameter with a flexible distribution. This mixing distribution can assume any density function, explicit or not, as long as independent random samples can be generated via reparameterization. Not only does SIVI expand the variational family to incorporate highly flexible variational distributions, including implicit ones that have no analytic density functions, but also sandwiches the evidence lower bound (ELBO) between a lower bound and an upper bound, and further derives an asymptotically exact surrogate ELBO that is amenable to optimization via stochastic gradient ascent. With a substantially expanded variational family and a novel optimization algorithm, SIVI is shown to closely match the accuracy of MCMC in inferring the posterior in a variety of Bayesian inference tasks.
Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 9; 2023: 13; 2024: 14; 2025: 13; 2026: 3.
55 papers.
Sort:
By area:
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2022GFlowNets and variational inferencecited by 106
- 2023Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunitiescited by 61
- 2022Probabilistic Conformal Prediction Using Conditional Random Samplescited by 47
- 2024Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Stepcited by 47
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoderscited by 42
- 2023SeeGera: Self-supervised Semi-implicit Graph Variational Auto-encoders with Maskingcited by 23
- 2024Score Forgetting Distillation: A Swift, Data-Free Method for Machine Unlearning in Diffusion Modelscited by 23
- 2024Training Neural Samplers with Reverse Diffusive KL Divergencecited by 21
- 2023Semi-Implicit Variational Inference via Score Matchingcited by 19
- 2023Learning to Jump: Thinning and Thickening Latent Counts for Generative Modelingcited by 18
- 2023Beta Diffusioncited by 17
38 more
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Accelerationcited by 14
- 2022Latent State Marginalization as a Low-cost Approach for Improving Explorationcited by 13
- 2023Star-Shaped Denoising Diffusion Probabilistic Modelscited by 13
- 2024Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generationcited by 13
- 2023Neural Markov Jump Processescited by 12
- 2025Few-Step Diffusion via Score identity Distillationcited by 12
- 2021Efficient Semi-Implicit Variational Inferencecited by 9
- 2024Kernel Semi-Implicit Variational Inferencecited by 8
- 2021Structured Dropout Variational Inference for Bayesian Neural Networkscited by 7
- 2024Particle Semi-Implicit Variational Inferencecited by 7
- 2024On Divergence Measures for Training GFlowNetscited by 6
- 2023Implicit Variational Inference for High-Dimensional Posteriorscited by 5
- 2023Wasserstein Gradient Flow over Variational Parameter Space for Variational Inferencecited by 5
- 2025CrowdLLM: Building LLM-Based Digital Populations Augmented with Generative Modelscited by 5
- 2021Interpolating between sampling and variational inference with infinite stochastic mixturescited by 3
- 2022PAVI: Plate-Amortized Variational Inferencecited by 2
- 2024Diffusion Boosted Treescited by 2
- 2024BayesCNS: A Unified Bayesian Approach to Address Cold Start and Non-Stationarity in Search Systems at Scalecited by 2
- 2025Fisher meets Feynman: score-based variational inference with a product of expertscited by 2
- 2022VFDS: Variational Foresight Dynamic Selection in Bayesian Neural Networks for Efficient Human Activity Recognitioncited by 1
- 2023Parameter Estimation in DAGs from Incomplete Data via Optimal Transportcited by 1
- 2023PAVI: Plate-Amortized Variational Inferencecited by 1
- 2023Variational Graph Autoencoder for Heterogeneous Information Networks with Missing and Inaccurate Attributescited by 1
- 2024Variational Bayesian Phylogenetic Inference with Semi-implicit Branch Length Distributionscited by 1
- 2024Scalable Weibull Graph Attention Autoencoder for Modeling Document Networkscited by 1
- 2024Semi-Implicit Functional Gradient Flow for Efficient Samplingcited by 1
- 2025Bayesian Computation in Deep Learningcited by 1
- 2025Particle Dynamics for Latent-Variable Energy-Based Modelscited by 1
- 2025Bayesian Semiparametric Causal Inference: Targeted Doubly Robust Estimation of Treatment Effectscited by 1
- 2026A Kernel Approach for Semi-implicit Variational Inferencecited by 1
- 2022Variational Inference for Bayesian Bridge Regressioncited by 0
- 2022Cyclical Kernel Adaptive Metropoliscited by 0
- 2022Bayesian Neural Network Inference via Implicit Models and the Posterior Predictive Distributioncited by 0
- 2024Towards Model-Agnostic Posterior Approximation for Fast and Accurate Variational Autoencoderscited by 0
- 2025Multi-resolution Score-Based Variational Graphical Diffusion for Causal Disaster System Modeling and Inferencecited by 0
- 2025A Generative Framework for Causal Estimation via Importance-Weighted Diffusion Distillationcited by 0
- 2025Revisiting Unbiased Implicit Variational Inferencecited by 0
- 2025Semi-Implicit Variational Inference via Kernelized Path Gradient Descentcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Implicit Variational Rejection Sampling12 Jun 2026
- 2026Variational Learning of Fractional Posteriors29 Mar 2026
- 2026A Kernel Approach for Semi-implicit Variational Inference17 Jan 2026
- 2025CrowdLLM: Building LLM-Based Digital Populations Augmented with Generative Models2 Dec 2025
- 2025Bayesian Semiparametric Causal Inference: Targeted Doubly Robust Estimation of Treatment Effects19 Nov 2025
- 2025Fisher meets Feynman: score-based variational inference with a product of experts24 Oct 2025
- 2025Particle Dynamics for Latent-Variable Energy-Based Models17 Oct 2025
- 2025Towards real-time surrogate-free Bayesian inversion for neutron reflectometry8 Sep 2025
- 2025Subgraph Generation for Generalizing on Out-of-Distribution Links15 Jul 2025
- 2025Continuous Semi-Implicit Models7 Jun 2025
- 2025Semi-Implicit Variational Inference via Kernelized Path Gradient Descent5 Jun 2025
- 2025Revisiting Unbiased Implicit Variational Inference4 Jun 2025
38 more
- 2025Few-Step Diffusion via Score identity Distillation19 May 2025
- 2025A Generative Framework for Causal Estimation via Importance-Weighted Diffusion Distillation16 May 2025
- 2025Multi-resolution Score-Based Variational Graphical Diffusion for Causal Disaster System Modeling and Inference5 Apr 2025
- 2025Bayesian Computation in Deep Learning25 Feb 2025
- 2024Semi-Implicit Functional Gradient Flow for Efficient Sampling23 Oct 2024
- 2024Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Step19 Oct 2024
- 2024Training Neural Samplers with Reverse Diffusive KL Divergence16 Oct 2024
- 2024Scalable Weibull Graph Attention Autoencoder for Modeling Document Networks13 Oct 2024
- 2024On Divergence Measures for Training GFlowNets12 Oct 2024
- 2024BayesCNS: A Unified Bayesian Approach to Address Cold Start and Non-Stationarity in Search Systems at Scale3 Oct 2024
- 2024Score Forgetting Distillation: A Swift, Data-Free Method for Machine Unlearning in Diffusion Models17 Sep 2024
- 2024Variational Bayesian Phylogenetic Inference with Semi-implicit Branch Length Distributions9 Aug 2024
- 2024Particle Semi-Implicit Variational Inference30 Jun 2024
- 2024Diffusion Boosted Trees3 Jun 2024
- 2024Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generation3 Jun 2024
- 2024Kernel Semi-Implicit Variational Inference29 May 2024
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation5 Apr 2024
- 2024Towards Model-Agnostic Posterior Approximation for Fast and Accurate Variational Autoencoders13 Mar 2024
- 2023Variational Graph Autoencoder for Heterogeneous Information Networks with Missing and Inaccurate Attributes14 Nov 2023
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration26 Oct 2023
- 2023Wasserstein Gradient Flow over Variational Parameter Space for Variational Inference25 Oct 2023
- 2023Implicit Variational Inference for High-Dimensional Posteriors10 Oct 2023
- 2023Beta Diffusion14 Sep 2023
- 2023PAVI: Plate-Amortized Variational Inference30 Aug 2023
- 2023Semi-Implicit Variational Inference via Score Matching19 Aug 2023
- 2023Neural Markov Jump Processes31 May 2023
- 2023Learning to Jump: Thinning and Thickening Latent Counts for Generative Modeling28 May 2023
- 2023Parameter Estimation in DAGs from Incomplete Data via Optimal Transport25 May 2023
- 2023Star-Shaped Denoising Diffusion Probabilistic Models10 Feb 2023
- 2023Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunities2 Feb 2023
- 2023SeeGera: Self-supervised Semi-implicit Graph Variational Auto-encoders with Masking29 Jan 2023
- 2022Latent State Marginalization as a Low-cost Approach for Improving Exploration3 Oct 2022
- 2022GFlowNets and variational inference2 Oct 2022
- 2022Bayesian Neural Network Inference via Implicit Models and the Posterior Predictive Distribution6 Sep 2022
- 2022Cyclical Kernel Adaptive Metropolis29 Jun 2022
- 2022Probabilistic Conformal Prediction Using Conditional Random Samples14 Jun 2022
- 2022PAVI: Plate-Amortized Variational Inference10 Jun 2022
- 2022Variational Inference for Bayesian Bridge Regression19 May 2022
50 newest of 55 All 55 (JSON)
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2024Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Stepcited by 47
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoderscited by 42
- 2024Score Forgetting Distillation: A Swift, Data-Free Method for Machine Unlearning in Diffusion Modelscited by 23
- 2023Beta Diffusioncited by 17
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Accelerationcited by 14
- 2023Star-Shaped Denoising Diffusion Probabilistic Modelscited by 13
- 2024Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generationcited by 13
- 2025Few-Step Diffusion via Score identity Distillationcited by 12
- 2024Diffusion Boosted Treescited by 2
- 2025A Generative Framework for Causal Estimation via Importance-Weighted Diffusion Distillationcited by 0
- 2025Continuous Semi-Implicit Modelscited by 0
- 2025Continuous Semi-Implicit Models7 Jun 2025
- 2025Few-Step Diffusion via Score identity Distillation19 May 2025
- 2025A Generative Framework for Causal Estimation via Importance-Weighted Diffusion Distillation16 May 2025
- 2024Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Step19 Oct 2024
- 2024Score Forgetting Distillation: A Swift, Data-Free Method for Machine Unlearning in Diffusion Models17 Sep 2024
- 2024Diffusion Boosted Trees3 Jun 2024
- 2024Guided Score identity Distillation for Data-Free One-Step Text-to-Image Generation3 Jun 2024
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation5 Apr 2024
- 2023Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration26 Oct 2023
- 2023Beta Diffusion14 Sep 2023
- 2023Star-Shaped Denoising Diffusion Probabilistic Models10 Feb 2023
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders19 Feb 2022
- 2022GFlowNets and variational inferencecited by 106
- 2023Graph Neural Networks for temporal graphs: State of the art, open challenges, and opportunitiescited by 61
- 2022Probabilistic Conformal Prediction Using Conditional Random Samplescited by 47
- 2023SeeGera: Self-supervised Semi-implicit Graph Variational Auto-encoders with Maskingcited by 23
- 2024Training Neural Samplers with Reverse Diffusive KL Divergencecited by 21
- 2023Semi-Implicit Variational Inference via Score Matchingcited by 19
- 2023Learning to Jump: Thinning and Thickening Latent Counts for Generative Modelingcited by 18
- 2022Latent State Marginalization as a Low-cost Approach for Improving Explorationcited by 13
- 2023Neural Markov Jump Processescited by 12
- 2021Efficient Semi-Implicit Variational Inferencecited by 9
- 2024Kernel Semi-Implicit Variational Inferencecited by 8
- 2021Structured Dropout Variational Inference for Bayesian Neural Networkscited by 7
12 most cited of 43 All 43 (JSON)
- 2026Implicit Variational Rejection Sampling12 Jun 2026
- 2026Variational Learning of Fractional Posteriors29 Mar 2026
- 2026A Kernel Approach for Semi-implicit Variational Inference17 Jan 2026
- 2025CrowdLLM: Building LLM-Based Digital Populations Augmented with Generative Models2 Dec 2025
- 2025Bayesian Semiparametric Causal Inference: Targeted Doubly Robust Estimation of Treatment Effects19 Nov 2025
- 2025Fisher meets Feynman: score-based variational inference with a product of experts24 Oct 2025
- 2025Particle Dynamics for Latent-Variable Energy-Based Models17 Oct 2025
- 2025Towards real-time surrogate-free Bayesian inversion for neutron reflectometry8 Sep 2025
- 2025Subgraph Generation for Generalizing on Out-of-Distribution Links15 Jul 2025
- 2025Semi-Implicit Variational Inference via Kernelized Path Gradient Descent5 Jun 2025
- 2025Revisiting Unbiased Implicit Variational Inference4 Jun 2025
- 2025Multi-resolution Score-Based Variational Graphical Diffusion for Causal Disaster System Modeling and Inference5 Apr 2025
12 newest of 43 All 43 (JSON)