Streaming Variational Bayes
Not on the map. Why?
Abstract (arXiv)
We present SDA-Bayes, a framework for (S)treaming, (D)istributed, (A)synchronous computation of a Bayesian posterior. The framework makes streaming updates to the estimated posterior according to a user-specified approximation batch primitive. We demonstrate the usefulness of our framework, with variational Bayes (VB) as the primitive, by fitting the latent Dirichlet allocation model to two large-scale document collections. We demonstrate the advantages of our algorithm over stochastic variational inference (SVI) by comparing the two after a single pass through a known amount of data---a case where SVI may be applied---and in the streaming setting, where SVI does not apply.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jul 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 5; 2023: 9; 2024: 10; 2025: 6; 2026: 6.
46 papers.
Sort:
By area:
- 2021Online Coreset Selection for Rehearsal-based Continual Learningcited by 114
- 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstructioncited by 39
- 2023Continual Learning via Sequential Function-Space Variational Inferencecited by 28
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2023Low-rank extended Kalman filtering for online learning of neural networks from streaming datacited by 23
- 2025Model Predictive Task Sampling for Efficient and Robust Adaptationcited by 20
- 2021Generalizing to the Open World: Deep Visual Odometry with Online Adaptationcited by 19
- 2023Federated Learning as Variational Inference: A Scalable Expectation Propagation Approachcited by 17
- 2024Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Resetcited by 17
- 2022Partitioned Variational Inference: A Framework for Probabilistic Federated Learningcited by 13
- 2025Fast and Robust: Task Sampling with Posterior and Diversity Synergies for Adaptive Decision-Makers in Randomized Environmentscited by 11
34 more
- 2025ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisitioncited by 8
- 2021Knowing when we do not know: Bayesian continual learning for sensing-based analysis taskscited by 7
- 2023Particle-based Online Bayesian Samplingcited by 7
- 2024A Comprehensive Guide to Explainable AI: From Classical Models to LLMscited by 7
- 2023Streaming Factor Trajectory Learning for Temporal Tensor Decompositioncited by 6
- 2025Knowledge Adaptation as Posterior Correctioncited by 6
- 2023Machine Learning and the Future of Bayesian Computationcited by 4
- 2024Exploring the Stability Gap in Continual Learning: The Role of the Classification Headcited by 4
- 2024Streaming Bayes GFlowNetscited by 4
- 2021Online Meta Adaptation for Variable-Rate Learned Image Compressioncited by 3
- 2023Streaming LifeLong Learning With Any-Time Inferencecited by 3
- 2024Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue Systemcited by 3
- 2024Embarrassingly Parallel GFlowNetscited by 3
- 2021Non-negative matrix factorization algorithms generally improve topic model fitscited by 2
- 2022BAM: Bayes with Adaptive Memorycited by 2
- 2022Differentially private partitioned variational inferencecited by 2
- 2024Lifelong Learning of Video Diffusion Models From a Single Video Streamcited by 2
- 2026Soft Bayesian Context Tree Models for Real-Valued Time Seriescited by 2
- 2021Low Complexity Approximate Bayesian Logistic Regression for Sparse Online Learningcited by 1
- 2022Streaming Inference for Infinite Non-Stationary Clusteringcited by 1
- 2023Towards Robust Continual Learning with Bayesian Adaptive Moment Regularizationcited by 1
- 2025Unlearning in Diffusion models under Data Constraints: A Variational Inference Approachcited by 1
- 2026Efficient Online Variational Estimation via Monte Carlo Samplingcited by 1
- 2026Adaptive Bayesian Online Learning via Expert Aggregationcited by 1
- 2021Wasserstein-Splitting Gaussian Process Regression for Heterogeneous Online Bayesian Inferencecited by 0
- 2022Dirichlet process mixture models for non-stationary data streamscited by 0
- 2023Streaming data recovery via Bayesian tensor train decompositioncited by 0
- 2024Streaming Gaussian Dirichlet Random Fields for Spatial Predictions of High Dimensional Categorical Observationscited by 0
- 2024Representation and De-interleaving of Mixtures of Hidden Markov Processescited by 0
- 2024Fisher Information based Stochastic Gradient Ascent for Online Learning of Dirichlet Process Mixture and Theorycited by 0
- 2025Predictive Coresetscited by 0
- 2026From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learningcited by 0
- 2026Active Continual Learning with Metaplastic Binary Bayesian Neural Networkscited by 0
- 2026Fast rates in Bayesian online learning with approximate posteriorscited by 0
- 2026Fast rates in Bayesian online learning with approximate posteriors26 Aug 2026
- 2026Adaptive Bayesian Online Learning via Expert Aggregation22 Jul 2026
- 2026Active Continual Learning with Metaplastic Binary Bayesian Neural Networks28 May 2026
- 2026From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learning13 Mar 2026
- 2026Efficient Online Variational Estimation via Monte Carlo Sampling6 Feb 2026
- 2026Soft Bayesian Context Tree Models for Real-Valued Time Series16 Jan 2026
- 2025Unlearning in Diffusion models under Data Constraints: A Variational Inference Approach5 Oct 2025
- 2025Knowledge Adaptation as Posterior Correction17 Jun 2025
- 2025ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisition8 Jun 2025
- 2025Fast and Robust: Task Sampling with Posterior and Diversity Synergies for Adaptive Decision-Makers in Randomized Environments27 Apr 2025
- 2025Predictive Coresets8 Feb 2025
- 2025Model Predictive Task Sampling for Efficient and Robust Adaptation19 Jan 2025
34 more
- 2024Fisher Information based Stochastic Gradient Ascent for Online Learning of Dirichlet Process Mixture and Theory12 Dec 2024
- 2024A Comprehensive Guide to Explainable AI: From Classical Models to LLMs1 Dec 2024
- 2024Streaming Bayes GFlowNets8 Nov 2024
- 2024Exploring the Stability Gap in Continual Learning: The Role of the Classification Head6 Nov 2024
- 2024Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Reset6 Nov 2024
- 2024Lifelong Learning of Video Diffusion Models From a Single Video Stream7 Jun 2024
- 2024Embarrassingly Parallel GFlowNets5 Jun 2024
- 2024Representation and De-interleaving of Mixtures of Hidden Markov Processes1 Jun 2024
- 2024Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System16 May 2024
- 2024Streaming Gaussian Dirichlet Random Fields for Spatial Predictions of High Dimensional Categorical Observations23 Feb 2024
- 2023Continual Learning via Sequential Function-Space Variational Inference28 Dec 2023
- 2023Streaming Factor Trajectory Learning for Temporal Tensor Decomposition25 Oct 2023
- 2023Towards Robust Continual Learning with Bayesian Adaptive Moment Regularization15 Sep 2023
- 2023Low-rank extended Kalman filtering for online learning of neural networks from streaming data31 May 2023
- 2023Machine Learning and the Future of Bayesian Computation21 Apr 2023
- 2023Particle-based Online Bayesian Sampling28 Feb 2023
- 2023Streaming data recovery via Bayesian tensor train decomposition23 Feb 2023
- 2023Federated Learning as Variational Inference: A Scalable Expectation Propagation Approach8 Feb 2023
- 2023Streaming LifeLong Learning With Any-Time Inference27 Jan 2023
- 2022Dirichlet process mixture models for non-stationary data streams13 Oct 2022
- 2022Differentially private partitioned variational inference23 Sep 2022
- 2022Streaming Inference for Infinite Non-Stationary Clustering2 May 2022
- 2022Partitioned Variational Inference: A Framework for Probabilistic Federated Learning24 Feb 2022
- 2022BAM: Bayes with Adaptive Memory4 Feb 2022
- 2021Online Meta Adaptation for Variable-Rate Learned Image Compression16 Nov 2021
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation7 Nov 2021
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-making28 Oct 2021
- 2021Wasserstein-Splitting Gaussian Process Regression for Heterogeneous Online Bayesian Inference26 Jul 2021
- 2021Knowing when we do not know: Bayesian continual learning for sensing-based analysis tasks6 Jun 2021
- 2021Online Coreset Selection for Rehearsal-based Continual Learning2 Jun 2021
- 2021Non-negative matrix factorization algorithms generally improve topic model fits27 May 2021
- 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstruction30 Mar 2021
- 2021Generalizing to the Open World: Deep Visual Odometry with Online Adaptation29 Mar 2021
- 2021Low Complexity Approximate Bayesian Logistic Regression for Sparse Online Learning28 Jan 2021
- 2021Online Coreset Selection for Rehearsal-based Continual Learningcited by 114
- 2021Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstructioncited by 39
- 2023Continual Learning via Sequential Function-Space Variational Inferencecited by 28
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
- 2021Conditioning Sparse Variational Gaussian Processes for Online Decision-makingcited by 23
- 2023Low-rank extended Kalman filtering for online learning of neural networks from streaming datacited by 23
- 2025Model Predictive Task Sampling for Efficient and Robust Adaptationcited by 20
- 2021Generalizing to the Open World: Deep Visual Odometry with Online Adaptationcited by 19
- 2023Federated Learning as Variational Inference: A Scalable Expectation Propagation Approachcited by 17
- 2024Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Resetcited by 17
- 2022Partitioned Variational Inference: A Framework for Probabilistic Federated Learningcited by 13
- 2025Fast and Robust: Task Sampling with Posterior and Diversity Synergies for Adaptive Decision-Makers in Randomized Environmentscited by 11
12 most cited of 43 All 43 (JSON)
- 2026Fast rates in Bayesian online learning with approximate posteriors26 Aug 2026
- 2026Adaptive Bayesian Online Learning via Expert Aggregation22 Jul 2026
- 2026Active Continual Learning with Metaplastic Binary Bayesian Neural Networks28 May 2026
- 2026Efficient Online Variational Estimation via Monte Carlo Sampling6 Feb 2026
- 2026Soft Bayesian Context Tree Models for Real-Valued Time Series16 Jan 2026
- 2025Knowledge Adaptation as Posterior Correction17 Jun 2025
- 2025ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisition8 Jun 2025
- 2025Fast and Robust: Task Sampling with Posterior and Diversity Synergies for Adaptive Decision-Makers in Randomized Environments27 Apr 2025
- 2025Predictive Coresets8 Feb 2025
- 2025Model Predictive Task Sampling for Efficient and Robust Adaptation19 Jan 2025
- 2024Fisher Information based Stochastic Gradient Ascent for Online Learning of Dirichlet Process Mixture and Theory12 Dec 2024
- 2024A Comprehensive Guide to Explainable AI: From Classical Models to LLMs1 Dec 2024
12 newest of 43 All 43 (JSON)