On Statistical Optimality of Variational Bayes
Not on the map. Why?
Abstract (arXiv)
The article addresses a long-standing open problem on the justification of using variational Bayes methods for parameter estimation. We provide general conditions for obtaining optimal risk bounds for point estimates acquired from mean-field variational Bayesian inference. The conditions pertain to the existence of certain test functions for the distance metric on the parameter space and minimal assumptions on the prior. A general recipe for verification of the conditions is outlined which is broadly applicable to existing Bayesian models with or without latent variables. As illustrations, specific applications to Latent Dirichlet Allocation and Gaussian mixture models are discussed.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 8; 2024: 1; 2025: 3; 2026: 3.
21 papers.
Sort:
- 2022Personalized Federated Learning via Variational Bayesian Inferencecited by 68
- 2022Mean-field Variational Inference via Wasserstein Gradient Flowcited by 19
- 2023On the Convergence of Coordinate Ascent Variational Inferencecited by 18
- 2021Layer Adaptive Node Selection in Bayesian Neural Networks: Statistical Guarantees and Implementation Detailscited by 14
- 2023FedHB: Hierarchical Bayesian Federated Learningcited by 8
- 2022Statistical and Computational Trade-offs in Variational Inference: A Case Study in Inferential Model Selectioncited by 7
- 2023Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clusteringcited by 5
- 2023Machine Learning and the Future of Bayesian Computationcited by 4
- 2022Structured Optimal Variational Inference for Dynamic Latent Space Modelscited by 2
- 2023Bayesian Personalized Federated Learning with Shared and Personalized Uncertainty Representationscited by 2
- 2023Personalized Federated Learning via Amortized Bayesian Meta-Learningcited by 1
- 2023Pointwise uncertainty quantification for sparse variational Gaussian process regression with a Brownian motion priorcited by 1
9 more
- 2024Maximum a Posteriori Inference for Factor Graphs via Benders' Decompositioncited by 1
- 2025Bayesian Coreset Optimization for Personalized Federated Learningcited by 1
- 2026Stability of Sequential and Parallel Coordinate Ascent Variational Inferencecited by 1
- 2026Symmetry Guarantees Statistic Recovery in Variational Inferencecited by 1
- 2026Even More Guarantees for Variational Inference in the Presence of Symmetriescited by 1
- 2021Exclusive Topic Modelingcited by 0
- 2023A Hierarchical Bayesian Model for Deep Few-Shot Meta Learningcited by 0
- 2025Mode Collapse of Mean-Field Variational Inferencecited by 0
- 2025Variational bagging: a robust approach for Bayesian uncertainty quantificationcited by 0
- 2026Even More Guarantees for Variational Inference in the Presence of Symmetries23 Apr 2026
- 2026Symmetry Guarantees Statistic Recovery in Variational Inference20 Apr 2026
- 2026Stability of Sequential and Parallel Coordinate Ascent Variational Inference21 Mar 2026
- 2025Variational bagging: a robust approach for Bayesian uncertainty quantification25 Nov 2025
- 2025Bayesian Coreset Optimization for Personalized Federated Learning3 Nov 2025
- 2025Mode Collapse of Mean-Field Variational Inference20 Oct 2025
- 2024Maximum a Posteriori Inference for Factor Graphs via Benders' Decomposition24 Oct 2024
- 2023Pointwise uncertainty quantification for sparse variational Gaussian process regression with a Brownian motion prior29 Sep 2023
- 2023Bayesian Personalized Federated Learning with Shared and Personalized Uncertainty Representations27 Sep 2023
- 2023Personalized Federated Learning via Amortized Bayesian Meta-Learning5 Jul 2023
- 2023A Hierarchical Bayesian Model for Deep Few-Shot Meta Learning16 Jun 2023
- 2023On the Convergence of Coordinate Ascent Variational Inference1 Jun 2023
9 more
- 2023FedHB: Hierarchical Bayesian Federated Learning8 May 2023
- 2023Machine Learning and the Future of Bayesian Computation21 Apr 2023
- 2023Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering8 Mar 2023
- 2022Structured Optimal Variational Inference for Dynamic Latent Space Models29 Sep 2022
- 2022Statistical and Computational Trade-offs in Variational Inference: A Case Study in Inferential Model Selection22 Jul 2022
- 2022Mean-field Variational Inference via Wasserstein Gradient Flow17 Jul 2022
- 2022Personalized Federated Learning via Variational Bayesian Inference16 Jun 2022
- 2021Layer Adaptive Node Selection in Bayesian Neural Networks: Statistical Guarantees and Implementation Details25 Aug 2021
- 2021Exclusive Topic Modeling6 Feb 2021
- 2022Personalized Federated Learning via Variational Bayesian Inferencecited by 68
- 2022Mean-field Variational Inference via Wasserstein Gradient Flowcited by 19
- 2023On the Convergence of Coordinate Ascent Variational Inferencecited by 18
- 2021Layer Adaptive Node Selection in Bayesian Neural Networks: Statistical Guarantees and Implementation Detailscited by 14
- 2023FedHB: Hierarchical Bayesian Federated Learningcited by 8
- 2022Statistical and Computational Trade-offs in Variational Inference: A Case Study in Inferential Model Selectioncited by 7
- 2023Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clusteringcited by 5
- 2023Machine Learning and the Future of Bayesian Computationcited by 4
- 2022Structured Optimal Variational Inference for Dynamic Latent Space Modelscited by 2
- 2023Bayesian Personalized Federated Learning with Shared and Personalized Uncertainty Representationscited by 2
- 2023Personalized Federated Learning via Amortized Bayesian Meta-Learningcited by 1
- 2023Pointwise uncertainty quantification for sparse variational Gaussian process regression with a Brownian motion priorcited by 1
12 most cited of 21 All 21 (JSON)
- 2026Even More Guarantees for Variational Inference in the Presence of Symmetries23 Apr 2026
- 2026Symmetry Guarantees Statistic Recovery in Variational Inference20 Apr 2026
- 2026Stability of Sequential and Parallel Coordinate Ascent Variational Inference21 Mar 2026
- 2025Variational bagging: a robust approach for Bayesian uncertainty quantification25 Nov 2025
- 2025Bayesian Coreset Optimization for Personalized Federated Learning3 Nov 2025
- 2025Mode Collapse of Mean-Field Variational Inference20 Oct 2025
- 2024Maximum a Posteriori Inference for Factor Graphs via Benders' Decomposition24 Oct 2024
- 2023Pointwise uncertainty quantification for sparse variational Gaussian process regression with a Brownian motion prior29 Sep 2023
- 2023Bayesian Personalized Federated Learning with Shared and Personalized Uncertainty Representations27 Sep 2023
- 2023Personalized Federated Learning via Amortized Bayesian Meta-Learning5 Jul 2023
- 2023A Hierarchical Bayesian Model for Deep Few-Shot Meta Learning16 Jun 2023
- 2023On the Convergence of Coordinate Ascent Variational Inference1 Jun 2023
12 newest of 21 All 21 (JSON)