mlsanityData to 14 Oct 2026

Bayesian Model Averaging under Predictor Redundancy via Density-Ratio Posterior Compression

arXiv 2606.21080 ↗First posted 19 Jun 2026stat.ML cs.LG stat.MEcited by 0

Not on the map. Why?

Abstract (arXiv)

Bayesian model averaging in support-indexed regression induces a posterior distribution over active predictor supports. Under predictor redundancy, posterior mass can spread across many nearly interchangeable supports, making exact-support summaries unstable or hard to interpret even when prediction is stable. We study how to report an already fitted Bayesian model averaging posterior without changing the Bayesian target. A report uses hard or soft regions of support space, and its compressed reporting law is compared with the reference posterior through an explicit density ratio. This ratio gives computable total-variation and Kullback--Leibler distortion, bounds for bounded predictive summaries, retained-mass diagnostics, and fallback-weight diagnostics. The framework covers fixed hard regions, metric-ball regions, posterior-cluster regions, and pooled-pruned region dictionaries. We prove exact error formulas and validation bounds for these region reports, and give conditions under which a few regions can replace a long list of individual supports. In simulations, our region reports often give shorter and clearer summaries while preserving the main posterior information, and the density-ratio diagnostics show when too much information has been lost.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 22 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

4 of 22 references.

References · 4

  1. 2015Comparison of Bayesian predictive methods for model selectioncited by 10
  2. 2018Projective Inference in High-dimensional Problems: Prediction and Feature Selectioncited by 8
  3. 2020Using reference models in variable selectioncited by 3
  4. 2022Model-based clustering of categorical data based on the Hamming distancecited by 1

Built on by

Not cited yet.