# Bayesian model averaging: A systematic review and conceptual classification

arXiv: https://arxiv.org/abs/1509.08864 · HTML: https://mlsanity.com/paper/1509.08864/

## Key facts

- Cited by 29 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 29 Sep 2015.

## Built on by (most cited first, 29 of 29)

- [Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models](https://mlsanity.com/paper/2208.03306/) (2022)
- [Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation](https://mlsanity.com/paper/2110.03051/) (2021)
- [BCD Nets: Scalable Variational Approaches for Bayesian Causal Discovery](https://mlsanity.com/paper/2112.02761/) (2021)
- [A review of predictive uncertainty estimation with machine learning](https://mlsanity.com/paper/2209.08307/) (2022)
- [CRPS Learning](https://mlsanity.com/paper/2102.00968/) (2021)
- [Prune and Tune Ensembles: Low-Cost Ensemble Learning With Sparse Independent Subnetworks](https://mlsanity.com/paper/2202.11782/) (2022)
- [ELODI: Ensemble Logit Difference Inhibition for Positive-Congruent Training](https://mlsanity.com/paper/2205.06265/) (2022)
- [Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Review](https://mlsanity.com/paper/2312.09454/) (2023)
- [Collapsed Inference for Bayesian Deep Learning](https://mlsanity.com/paper/2306.09686/) (2023)
- [clusterBMA: Bayesian model averaging for clustering](https://mlsanity.com/paper/2209.04117/) (2022)
- [Local Bayesian Dirichlet mixing of imperfect models](https://mlsanity.com/paper/2311.01596/) (2023)
- [Bayesian Deep Learning Via Expectation Maximization and Turbo Deep Approximate Message Passing](https://mlsanity.com/paper/2402.07366/) (2024)
- [WiSleep: Inferring Sleep Duration at Scale Using Passive WiFi Sensing](https://mlsanity.com/paper/2102.03690/) (2021)
- [Dynamic Ensemble Bayesian Filter for Robust Control of a Human Brain-machine Interface](https://mlsanity.com/paper/2204.11840/) (2022)
- [A model aggregation approach for high-dimensional large-scale optimization](https://mlsanity.com/paper/2205.07525/) (2022)
- [Stability and L2-penalty in Model Averaging](https://mlsanity.com/paper/2311.13827/) (2023)
- [Model orthogonalization and Bayesian forecast mixing via Principal Component Analysis](https://mlsanity.com/paper/2405.10839/) (2024)
- [Flat Posterior Does Matter For Bayesian Model Averaging](https://mlsanity.com/paper/2406.15664/) (2024)
- [Network Fission Ensembles for Low-Cost Self-Ensembles](https://mlsanity.com/paper/2408.02301/) (2024)
- [ANCHOR: Abductive Network Construction with Hierarchical Orchestration for Reliable Probability Inference in Large Language Models](https://mlsanity.com/paper/2605.10328/) (2026)
- [A formal definition and meta-model for a machine theory of mind](https://mlsanity.com/paper/2606.03471/) (2026)
- [Bayesian Model Averaging for Data Driven Decision Making when Causality is Partially Known](https://mlsanity.com/paper/2105.05395/) (2021)
- [Feature Selection using e-values](https://mlsanity.com/paper/2206.05391/) (2022)
- [Sparse Mutation Decompositions: Fine Tuning Deep Neural Networks with Subspace Evolution](https://mlsanity.com/paper/2302.05832/) (2023)
- [Automating Model Comparison in Factor Graphs](https://mlsanity.com/paper/2306.05965/) (2023)
- [Achieving Skilled and Reliable Daily Probabilistic Forecasts of Wind Power at Subseasonal-to-Seasonal Timescales over France](https://mlsanity.com/paper/2511.16164/) (2025)
- [PREBA: Surgical Duration Prediction via PCA-Weighted Retrieval-Augmented LLMs and Bayesian Averaging Aggregation](https://mlsanity.com/paper/2603.13275/) (2026)
- [Uncertainty-Aware Sparse Identification of Dynamical Systems via Bayesian Model Averaging](https://mlsanity.com/paper/2604.10854/) (2026)
- [An Auto-Scaling Approach for Serverless Environments Based on a Multi-Expert Consensus Mechanism](https://mlsanity.com/paper/2607.15511/) (2026)

## Abstract (arXiv)

Bayesian Model Averaging (BMA) is an application of Bayesian inference to the problems of model selection, combined estimation and prediction that produces a straightforward model choice criteria and less risky predictions. However, the application of BMA is not always straightforward, leading to diverse assumptions and situational choices on its different aspects. Despite the widespread application of BMA in the literature, there were not many accounts of these differences and trends besides a few landmark revisions in the late 1990s and early 2000s, therefore not taking into account any advancements made in the last 15 years. In this work, we present an account of these developments through a careful content analysis of 587 articles in BMA published between 1996 and 2014. We also develop a conceptual classification scheme to better describe this vast literature, understand its trends and future directions and provide guidance for the researcher interested in both the application and development of the methodology. The results of the classification scheme and content review are then used to discuss the present and future of the BMA literature.