# Proximal nested sampling for high-dimensional Bayesian model selection

arXiv: https://arxiv.org/abs/2106.03646 · HTML: https://mlsanity.com/paper/2106.03646/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Jun 2021.

## Built on by (most cited first, 11 of 11)

- [Improving Gradient-guided Nested Sampling for Posterior Inference](https://mlsanity.com/paper/2312.03911/) (2023)
- [The split Gibbs sampler revisited: improvements to its algorithmic structure and augmented target distribution](https://mlsanity.com/paper/2206.13894/) (2022)
- [Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms](https://mlsanity.com/paper/2305.15988/) (2023)
- [Proximal nested sampling with data-driven priors for physical scientists](https://mlsanity.com/paper/2307.00056/) (2023)
- [Accelerated Bayesian imaging by relaxed proximal-point Langevin sampling](https://mlsanity.com/paper/2308.09460/) (2023)
- [Bayesian evidence estimation from posterior samples with normalizing flows](https://mlsanity.com/paper/2404.12294/) (2024)
- [The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptions](https://mlsanity.com/paper/2502.03458/) (2025)
- [Sample-efficient evidence estimation of score based priors for model selection](https://mlsanity.com/paper/2602.20549/) (2026)
- [Learned Interferometric Imaging for the SPIDER Instrument](https://mlsanity.com/paper/2301.10260/) (2023)
- [Bayesian model selection and misspecification testing in imaging inverse problems only from noisy and partial measurements](https://mlsanity.com/paper/2510.27663/) (2025)
- [Automatic Laplace Collapsed Sampling: Scalable Marginalisation of Latent Parameters via Automatic Differentiation](https://mlsanity.com/paper/2603.26644/) (2026)

## Abstract (arXiv)

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal likelihood (model evidence), which is computationally challenging, prohibiting its use in many high-dimensional Bayesian inverse problems. With Bayesian imaging applications in mind, in this work we present the proximal nested sampling methodology to objectively compare alternative Bayesian imaging models for applications that use images to inform decisions under uncertainty. The methodology is based on nested sampling, a Monte Carlo approach specialised for model comparison, and exploits proximal Markov chain Monte Carlo techniques to scale efficiently to large problems and to tackle models that are log-concave and not necessarily smooth (e.g., involving l_1 or total-variation priors). The proposed approach can be applied computationally to problems of dimension O(10^6) and beyond, making it suitable for high-dimensional inverse imaging problems. It is validated on large Gaussian models, for which the likelihood is available analytically, and subsequently illustrated on a range of imaging problems where it is used to analyse different choices of dictionary and measurement model.
