Bayesian Model Averaging under Predictor Redundancy via Density-Ratio Posterior Compression
Not on the map. Why?
Abstract (arXiv)
Bayesian model averaging in support-indexed regression induces a posterior distribution over active predictor supports. Under predictor redundancy, posterior mass can spread across many nearly interchangeable supports, making exact-support summaries unstable or hard to interpret even when prediction is stable. We study how to report an already fitted Bayesian model averaging posterior without changing the Bayesian target. A report uses hard or soft regions of support space, and its compressed reporting law is compared with the reference posterior through an explicit density ratio. This ratio gives computable total-variation and Kullback--Leibler distortion, bounds for bounded predictive summaries, retained-mass diagnostics, and fallback-weight diagnostics. The framework covers fixed hard regions, metric-ball regions, posterior-cluster regions, and pooled-pruned region dictionaries. We prove exact error formulas and validation bounds for these region reports, and give conditions under which a few regions can replace a long list of individual supports. In simulations, our region reports often give shorter and clearer summaries while preserving the main posterior information, and the density-ratio diagnostics show when too much information has been lost.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 22 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
4 of 22 references.
References · 4
- 2015Comparison of Bayesian predictive methods for model selectioncited by 10
- 2018Projective Inference in High-dimensional Problems: Prediction and Feature Selectioncited by 8
- 2020Using reference models in variable selectioncited by 3
- 2022Model-based clustering of categorical data based on the Hamming distancecited by 1
Built on by
Not cited yet.