Bayesian linear regression with sparse priors
Not on the map. Why?
Abstract (arXiv)
We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the posterior distribution is shown to contract at the optimal rate for recovery of the unknown sparse vector, and to give optimal prediction of the response vector. It is also shown to select the correct sparse model, or at least the coefficients that are significantly different from zero. The asymptotic shape of the posterior distribution is characterized and employed to the construction and study of credible sets for uncertainty quantification.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Mar 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 8; 2023: 6; 2024: 9; 2025: 5; 2026: 5.
40 papers.
Sort:
- 2021Identifiable Deep Generative Models via Sparse Decodingcited by 54
- 2022Thompson Sampling for High-Dimensional Sparse Linear Contextual Banditscited by 16
- 2024Bayesian Concept Bottleneck Models with LLM Priorscited by 16
- 2021Variational Inference in high-dimensional linear regressioncited by 10
- 2022The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?cited by 9
- 2023Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inferencecited by 9
- 2021Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processescited by 7
- 2022Asymptotic Properties for Bayesian Neural Network in Besov Spacecited by 7
- 2024Misclassification bounds for PAC-Bayesian sparse deep learningcited by 7
- 2021Performance of Bayesian linear regression in a model with mismatchcited by 6
- 2024A sparse PAC-Bayesian approach for high-dimensional quantile predictioncited by 6
- 2022Scalable Spike-and-Slabcited by 5
28 more
- 2022Robust Methods for High-Dimensional Linear Learningcited by 5
- 2024Bayesian Joint Additive Factor Models for Multiview Learningcited by 5
- 2023FedBIAD: Communication-Efficient and Accuracy-Guaranteed Federated Learning with Bayesian Inference-Based Adaptive Dropoutcited by 4
- 2025High-dimensional Bayesian Tobit regression for censored response with Horseshoe priorcited by 4
- 2021Spike and slab Bayesian sparse principal component analysiscited by 3
- 2021A fast asynchronous MCMC sampler for sparse Bayesian inferencecited by 3
- 2023Hierarchical shrinkage Gaussian processes: applications to computer code emulation and dynamical system recoverycited by 3
- 2021Sparse online variational Bayesian regressioncited by 2
- 2022Sparse high-dimensional linear regression with a partitioned empirical Bayes ECM algorithmcited by 2
- 2022On the optimization and pruning for Bayesian deep learningcited by 2
- 2024Covariate-Elaborated Robust Partial Information Transfer with Conditional Spike-and-Slab Priorcited by 2
- 2025Handling bounded response in high dimensions: a Horseshoe prior Bayesian Beta regression approachcited by 2
- 2022Masked Bayesian Neural Networks : Computation and Optimalitycited by 1
- 2024Adaptive posterior concentration rates for sparse high-dimensional linear regression with random design and unknown error variancecited by 1
- 2024Isoperimetry is All We Need: Langevin Posterior Sampling for RL with Sublinear Regretcited by 1
- 2025Correcting Noisy Multilabel Predictions: Modeling Label Noise through Latent Space Shiftscited by 1
- 2026Stability of Sequential and Parallel Coordinate Ascent Variational Inferencecited by 1
- 2023Bayesian Analysis for Over-parameterized Linear Model via Effective Spectracited by 0
- 2023From Estimation to Sampling for Bayesian Linear Regression with Spike-and-Slab Priorcited by 0
- 2023A statistical perspective on algorithm unrolling models for inverse problemscited by 0
- 2024High-dimensional prediction for count response via sparse exponential weightscited by 0
- 2024Bayesian penalized empirical likelihood and Markov Chain Monte Carlo samplingcited by 0
- 2025SpinSVAR: Estimating Structural Vector Autoregression Assuming Sparse Inputcited by 0
- 2025Time-varying Factor Augmented Vector Autoregression with Grouped Sparse Autoencodercited by 0
- 2026Spectral Bayesian Regression on the Spherecited by 0
- 2026Joint Model and Data Sparsification via the Marginal Likelihoodcited by 0
- 2026Beyond Global Divergences: A Local-Mass Perspective on Bayesian Inferencecited by 0
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selectioncited by 0
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection27 Sep 2026
- 2026Beyond Global Divergences: A Local-Mass Perspective on Bayesian Inference25 Jun 2026
- 2026Joint Model and Data Sparsification via the Marginal Likelihood28 May 2026
- 2026Stability of Sequential and Parallel Coordinate Ascent Variational Inference21 Mar 2026
- 2026Spectral Bayesian Regression on the Sphere28 Jan 2026
- 2025Handling bounded response in high dimensions: a Horseshoe prior Bayesian Beta regression approach28 May 2025
- 2025High-dimensional Bayesian Tobit regression for censored response with Horseshoe prior13 May 2025
- 2025Time-varying Factor Augmented Vector Autoregression with Grouped Sparse Autoencoder6 Mar 2025
- 2025Correcting Noisy Multilabel Predictions: Modeling Label Noise through Latent Space Shifts20 Feb 2025
- 2025SpinSVAR: Estimating Structural Vector Autoregression Assuming Sparse Input6 Jan 2025
- 2024Isoperimetry is All We Need: Langevin Posterior Sampling for RL with Sublinear Regret30 Dec 2024
- 2024Bayesian penalized empirical likelihood and Markov Chain Monte Carlo sampling23 Dec 2024
28 more
- 2024Bayesian Concept Bottleneck Models with LLM Priors21 Oct 2024
- 2024High-dimensional prediction for count response via sparse exponential weights20 Oct 2024
- 2024A sparse PAC-Bayesian approach for high-dimensional quantile prediction3 Sep 2024
- 2024Bayesian Joint Additive Factor Models for Multiview Learning2 Jun 2024
- 2024Adaptive posterior concentration rates for sparse high-dimensional linear regression with random design and unknown error variance29 May 2024
- 2024Misclassification bounds for PAC-Bayesian sparse deep learning2 May 2024
- 2024Covariate-Elaborated Robust Partial Information Transfer with Conditional Spike-and-Slab Prior30 Mar 2024
- 2023A statistical perspective on algorithm unrolling models for inverse problems10 Nov 2023
- 2023FedBIAD: Communication-Efficient and Accuracy-Guaranteed Federated Learning with Bayesian Inference-Based Adaptive Dropout14 Jul 2023
- 2023From Estimation to Sampling for Bayesian Linear Regression with Spike-and-Slab Prior9 Jul 2023
- 2023Bayesian Analysis for Over-parameterized Linear Model via Effective Spectra25 May 2023
- 2023Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inference24 May 2023
- 2023Hierarchical shrinkage Gaussian processes: applications to computer code emulation and dynamical system recovery1 Feb 2023
- 2022Thompson Sampling for High-Dimensional Sparse Linear Contextual Bandits11 Nov 2022
- 2022On the optimization and pruning for Bayesian deep learning24 Oct 2022
- 2022Sparse high-dimensional linear regression with a partitioned empirical Bayes ECM algorithm16 Sep 2022
- 2022Robust Methods for High-Dimensional Linear Learning10 Aug 2022
- 2022Masked Bayesian Neural Networks : Computation and Optimality2 Jun 2022
- 2022Asymptotic Properties for Bayesian Neural Network in Besov Space1 Jun 2022
- 2022The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?20 May 2022
- 2022Scalable Spike-and-Slab4 Apr 2022
- 2021Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processes8 Nov 2021
- 2021Identifiable Deep Generative Models via Sparse Decoding20 Oct 2021
- 2021A fast asynchronous MCMC sampler for sparse Bayesian inference14 Aug 2021
- 2021Performance of Bayesian linear regression in a model with mismatch14 Jul 2021
- 2021Variational Inference in high-dimensional linear regression25 Apr 2021
- 2021Sparse online variational Bayesian regression24 Feb 2021
- 2021Spike and slab Bayesian sparse principal component analysis30 Jan 2021
- 2021Identifiable Deep Generative Models via Sparse Decodingcited by 54
- 2022Thompson Sampling for High-Dimensional Sparse Linear Contextual Banditscited by 16
- 2024Bayesian Concept Bottleneck Models with LLM Priorscited by 16
- 2021Variational Inference in high-dimensional linear regressioncited by 10
- 2022The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?cited by 9
- 2023Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inferencecited by 9
- 2021Fast and Scalable Spike and Slab Variable Selection in High-Dimensional Gaussian Processescited by 7
- 2022Asymptotic Properties for Bayesian Neural Network in Besov Spacecited by 7
- 2024Misclassification bounds for PAC-Bayesian sparse deep learningcited by 7
- 2021Performance of Bayesian linear regression in a model with mismatchcited by 6
- 2024A sparse PAC-Bayesian approach for high-dimensional quantile predictioncited by 6
- 2022Scalable Spike-and-Slabcited by 5
12 most cited of 40 All 40 (JSON)
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection27 Sep 2026
- 2026Beyond Global Divergences: A Local-Mass Perspective on Bayesian Inference25 Jun 2026
- 2026Joint Model and Data Sparsification via the Marginal Likelihood28 May 2026
- 2026Stability of Sequential and Parallel Coordinate Ascent Variational Inference21 Mar 2026
- 2026Spectral Bayesian Regression on the Sphere28 Jan 2026
- 2025Handling bounded response in high dimensions: a Horseshoe prior Bayesian Beta regression approach28 May 2025
- 2025High-dimensional Bayesian Tobit regression for censored response with Horseshoe prior13 May 2025
- 2025Time-varying Factor Augmented Vector Autoregression with Grouped Sparse Autoencoder6 Mar 2025
- 2025Correcting Noisy Multilabel Predictions: Modeling Label Noise through Latent Space Shifts20 Feb 2025
- 2025SpinSVAR: Estimating Structural Vector Autoregression Assuming Sparse Input6 Jan 2025
- 2024Isoperimetry is All We Need: Langevin Posterior Sampling for RL with Sublinear Regret30 Dec 2024
- 2024Bayesian penalized empirical likelihood and Markov Chain Monte Carlo sampling23 Dec 2024
12 newest of 40 All 40 (JSON)