Federated Generalized Bayesian Learning via Distributed Stein Variational Gradient Descent
Not on the map. Why?
Abstract (arXiv)
This paper introduces Distributed Stein Variational Gradient Descent (DSVGD), a non-parametric generalized Bayesian inference framework for federated learning. DSVGD maintains a number of non-random and interacting particles at a central server to represent the current iterate of the model global posterior. The particles are iteratively downloaded and updated by one of the agents with the end goal of minimizing the global free energy. By varying the number of particles, DSVGD enables a flexible trade-off between per-iteration communication load and number of communication rounds. DSVGD is shown to compare favorably to benchmark frequentist and Bayesian federated learning strategies, also scheduling a single device per iteration, in terms of accuracy and scalability with respect to the number of agents, while also providing well-calibrated, and hence trustworthy, predictions.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 5; 2024: 10; 2025: 6; 2026: 1.
34 papers.
Sort:
By area:
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challengescited by 125
- 2021Personalized Federated Learning with Gaussian Processescited by 76
- 2023GNNDelete: A General Strategy for Unlearning in Graph Neural Networkscited by 43
- 2021QLSD: Quantised Langevin stochastic dynamics for Bayesian federated learningcited by 26
- 2024Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metricscited by 25
- 2023Bayesian Federated Learning: A Surveycited by 22
- 2021A Convergence Theory for SVGD in the Population Limit under Talagrand's Inequality T1cited by 21
- 2023Federated Learning as Variational Inference: A Scalable Expectation Propagation Approachcited by 17
- 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Conditioncited by 16
- 2021Forget-SVGD: Particle-Based Bayesian Federated Unlearningcited by 14
- 2022Federated Learning with Uncertainty via Distilled Predictive Distributionscited by 11
- 2021Bayesian Variational Federated Learning and Unlearning in Decentralized Networkscited by 8
22 more
- 2022Compressed Particle-Based Federated Bayesian Learning and Unlearningcited by 5
- 2024Personalized Federated Learning of Probabilistic Models: A PAC-Bayesian Approachcited by 5
- 2022Client Selection for Federated Bayesian Learningcited by 4
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compressioncited by 4
- 2024A Bayesian Framework for Clustered Federated Learningcited by 3
- 2022Improved Stein Variational Gradient Descent with Importance Weightscited by 2
- 2024Long-time asymptotics of noisy SVGD outside the population limitcited by 2
- 2024Trustworthy Personalized Bayesian Federated Learning via Posterior Fine-Tunecited by 1
- 2024Variational Bayes for Federated Continual Learningcited by 1
- 2024Federated Learning with Uncertainty and Personalization via Efficient Second-order Optimizationcited by 1
- 2025Federated Generalised Variational Inference: A Robust Probabilistic Federated Learning Frameworkcited by 1
- 2025Personalized Bayesian Federated Learning with Wasserstein Barycenter Aggregationcited by 1
- 2025FedUP: Efficient Pruning-based Federated Unlearning for Model Poisoning Attackscited by 1
- 2021Robust Distributed Bayesian Learning with Stragglers via Consensus Monte Carlocited by 0
- 2023Be Bayesian by Attachments to Catch More Uncertaintycited by 0
- 2024Cooperation and Federation in Distributed Radar Point Cloud Processingcited by 0
- 2024Compressed Bayesian Federated Learning for Reliable Passive Radio Sensing in Industrial IoTcited by 0
- 2024Personalizing Low-Rank Bayesian Neural Networks Via Federated Learningcited by 0
- 2025Bayesian Federated Learning for Continual Trainingcited by 0
- 2025Cost-Free Personalization via Information-Geometric Projection in Bayesian Federated Learningcited by 0
- 2025Adaptive Kernel Selection for Stein Variational Gradient Descentcited by 0
- 2026Federated Martingale Posterior Sampingcited by 0
- 2026Federated Martingale Posterior Samping18 May 2026
- 2025Adaptive Kernel Selection for Stein Variational Gradient Descent2 Oct 2025
- 2025Cost-Free Personalization via Information-Geometric Projection in Bayesian Federated Learning12 Sep 2025
- 2025FedUP: Efficient Pruning-based Federated Unlearning for Model Poisoning Attacks19 Aug 2025
- 2025Personalized Bayesian Federated Learning with Wasserstein Barycenter Aggregation20 May 2025
- 2025Bayesian Federated Learning for Continual Training21 Apr 2025
- 2025Federated Generalised Variational Inference: A Robust Probabilistic Federated Learning Framework2 Feb 2025
- 2024Federated Learning with Uncertainty and Personalization via Efficient Second-order Optimization27 Nov 2024
- 2024A Bayesian Framework for Clustered Federated Learning20 Oct 2024
- 2024Personalizing Low-Rank Bayesian Neural Networks Via Federated Learning18 Oct 2024
- 2024Long-time asymptotics of noisy SVGD outside the population limit17 Jun 2024
- 2024Variational Bayes for Federated Continual Learning23 May 2024
22 more
- 2024Compressed Bayesian Federated Learning for Reliable Passive Radio Sensing in Industrial IoT9 May 2024
- 2024Cooperation and Federation in Distributed Radar Point Cloud Processing3 May 2024
- 2024Trustworthy Personalized Bayesian Federated Learning via Posterior Fine-Tune25 Feb 2024
- 2024Personalized Federated Learning of Probabilistic Models: A PAC-Bayesian Approach16 Jan 2024
- 2024Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics10 Jan 2024
- 2023Be Bayesian by Attachments to Catch More Uncertainty19 Oct 2023
- 2023Bayesian Federated Learning: A Survey26 Apr 2023
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compression8 Mar 2023
- 2023GNNDelete: A General Strategy for Unlearning in Graph Neural Networks26 Feb 2023
- 2023Federated Learning as Variational Inference: A Scalable Expectation Propagation Approach8 Feb 2023
- 2022Client Selection for Federated Bayesian Learning11 Dec 2022
- 2022Improved Stein Variational Gradient Descent with Importance Weights2 Oct 2022
- 2022Compressed Particle-Based Federated Bayesian Learning and Unlearning14 Sep 2022
- 2022Federated Learning with Uncertainty via Distilled Predictive Distributions15 Jun 2022
- 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Condition1 Jun 2022
- 2021Robust Distributed Bayesian Learning with Stragglers via Consensus Monte Carlo17 Dec 2021
- 2021Forget-SVGD: Particle-Based Bayesian Federated Unlearning23 Nov 2021
- 2021Personalized Federated Learning with Gaussian Processes29 Jun 2021
- 2021A Convergence Theory for SVGD in the Population Limit under Talagrand's Inequality T16 Jun 2021
- 2021QLSD: Quantised Langevin stochastic dynamics for Bayesian federated learning1 Jun 2021
- 2021Bayesian Variational Federated Learning and Unlearning in Decentralized Networks8 Apr 2021
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challenges5 Apr 2021
- 2024Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metricscited by 25
- 2021Forget-SVGD: Particle-Based Bayesian Federated Unlearningcited by 14
- 2021Bayesian Variational Federated Learning and Unlearning in Decentralized Networkscited by 8
- 2022Compressed Particle-Based Federated Bayesian Learning and Unlearningcited by 5
- 2025FedUP: Efficient Pruning-based Federated Unlearning for Model Poisoning Attackscited by 1
- 2025FedUP: Efficient Pruning-based Federated Unlearning for Model Poisoning Attacks19 Aug 2025
- 2024Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics10 Jan 2024
- 2022Compressed Particle-Based Federated Bayesian Learning and Unlearning14 Sep 2022
- 2021Forget-SVGD: Particle-Based Bayesian Federated Unlearning23 Nov 2021
- 2021Bayesian Variational Federated Learning and Unlearning in Decentralized Networks8 Apr 2021
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challengescited by 125
- 2021Personalized Federated Learning with Gaussian Processescited by 76
- 2023GNNDelete: A General Strategy for Unlearning in Graph Neural Networkscited by 43
- 2021QLSD: Quantised Langevin stochastic dynamics for Bayesian federated learningcited by 26
- 2023Bayesian Federated Learning: A Surveycited by 22
- 2021A Convergence Theory for SVGD in the Population Limit under Talagrand's Inequality T1cited by 21
- 2023Federated Learning as Variational Inference: A Scalable Expectation Propagation Approachcited by 17
- 2022Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Conditioncited by 16
- 2022Federated Learning with Uncertainty via Distilled Predictive Distributionscited by 11
- 2024Personalized Federated Learning of Probabilistic Models: A PAC-Bayesian Approachcited by 5
- 2022Client Selection for Federated Bayesian Learningcited by 4
- 2023ELF: Federated Langevin Algorithms with Primal, Dual and Bidirectional Compressioncited by 4
12 most cited of 29 All 29 (JSON)
- 2026Federated Martingale Posterior Samping18 May 2026
- 2025Adaptive Kernel Selection for Stein Variational Gradient Descent2 Oct 2025
- 2025Cost-Free Personalization via Information-Geometric Projection in Bayesian Federated Learning12 Sep 2025
- 2025Personalized Bayesian Federated Learning with Wasserstein Barycenter Aggregation20 May 2025
- 2025Bayesian Federated Learning for Continual Training21 Apr 2025
- 2025Federated Generalised Variational Inference: A Robust Probabilistic Federated Learning Framework2 Feb 2025
- 2024Federated Learning with Uncertainty and Personalization via Efficient Second-order Optimization27 Nov 2024
- 2024A Bayesian Framework for Clustered Federated Learning20 Oct 2024
- 2024Personalizing Low-Rank Bayesian Neural Networks Via Federated Learning18 Oct 2024
- 2024Long-time asymptotics of noisy SVGD outside the population limit17 Jun 2024
- 2024Variational Bayes for Federated Continual Learning23 May 2024
- 2024Compressed Bayesian Federated Learning for Reliable Passive Radio Sensing in Industrial IoT9 May 2024
12 newest of 29 All 29 (JSON)