Differentially Private Bayesian Linear Regression
Not on the map. Why?
Abstract (arXiv)
Linear regression is an important tool across many fields that work with sensitive human-sourced data. Significant prior work has focused on producing differentially private point estimates, which provide a privacy guarantee to individuals while still allowing modelers to draw insights from data by estimating regression coefficients. We investigate the problem of Bayesian linear regression, with the goal of computing posterior distributions that correctly quantify uncertainty given privately released statistics. We show that a naive approach that ignores the noise injected by the privacy mechanism does a poor job in realistic data settings. We then develop noise-aware methods that perform inference over the privacy mechanism and produce correct posteriors across a wide range of scenarios.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 4; 2024: 5; 2025: 4; 2026: 2.
24 papers.
Sort:
- 2022Differentially Private Regression with Unbounded Covariatescited by 10
- 2024Incentives in Private Collaborative Machine Learningcited by 10
- 2022Noise-Aware Statistical Inference with Differentially Private Synthetic Datacited by 9
- 2021Non-parametric Differentially Private Confidence Intervals for the Mediancited by 7
- 2021Differentially Private Bayesian Neural Networks on Accuracy, Privacy and Reliabilitycited by 6
- 2024Private Regression via Data-Dependent Sufficient Statistic Perturbationcited by 4
- 2021Gaussian Processes with Differential Privacycited by 3
- 2021Differentially Private Nonparametric Regression Under a Growth Conditioncited by 3
- 2022Sharper Utility Bounds for Differentially Private Modelscited by 3
- 2022DPVIm: Differentially Private Variational Inference Improvedcited by 2
- 2024Is merging worth it? Securely evaluating the information gain for causal dataset acquisitioncited by 2
- 2021Locally Differentially Private Bayesian Inferencecited by 1
12 more
- 2023Differentially Private Distributed Bayesian Linear Regression with MCMCcited by 1
- 2023Simulation-based Bayesian Inference from Privacy Protected Datacited by 1
- 2024Differentially private Bayesian testscited by 1
- 2025Fiducial Matching: Differentially Private Inference for Categorical Datacited by 1
- 2026Computation-Utility-Privacy Tradeoffs in Bayesian Estimationcited by 1
- 2023Differentially Private Statistical Inference through β-Divergence One Posterior Samplingcited by 0
- 2023The Normal Distributions Indistinguishability Spectrum and its Application to Privacy-Preserving Machine Learningcited by 0
- 2024Noise-Aware Differentially Private Variational Inferencecited by 0
- 2025Optimal Survey Design for Private Mean Estimationcited by 0
- 2025On Reconstructing Training Data From Bayesian Posteriors and Trained Modelscited by 0
- 2025Differentially Private Two-Stage Gradient Descent for Instrumental Variable Regressioncited by 0
- 2026Differentially Private Truncation of Unbounded Data via Public Second Momentscited by 0
- 2026Computation-Utility-Privacy Tradeoffs in Bayesian Estimation18 Mar 2026
- 2026Differentially Private Truncation of Unbounded Data via Public Second Moments25 Feb 2026
- 2025Differentially Private Two-Stage Gradient Descent for Instrumental Variable Regression26 Sep 2025
- 2025On Reconstructing Training Data From Bayesian Posteriors and Trained Models24 Jul 2025
- 2025Fiducial Matching: Differentially Private Inference for Categorical Data15 Jul 2025
- 2025Optimal Survey Design for Private Mean Estimation30 Jan 2025
- 2024Noise-Aware Differentially Private Variational Inference25 Oct 2024
- 2024Is merging worth it? Securely evaluating the information gain for causal dataset acquisition11 Sep 2024
- 2024Private Regression via Data-Dependent Sufficient Statistic Perturbation23 May 2024
- 2024Incentives in Private Collaborative Machine Learning2 Apr 2024
- 2024Differentially private Bayesian tests27 Jan 2024
- 2023Simulation-based Bayesian Inference from Privacy Protected Data19 Oct 2023
12 more
- 2023The Normal Distributions Indistinguishability Spectrum and its Application to Privacy-Preserving Machine Learning3 Sep 2023
- 2023Differentially Private Statistical Inference through β-Divergence One Posterior Sampling11 Jul 2023
- 2023Differentially Private Distributed Bayesian Linear Regression with MCMC31 Jan 2023
- 2022DPVIm: Differentially Private Variational Inference Improved28 Oct 2022
- 2022Noise-Aware Statistical Inference with Differentially Private Synthetic Data28 May 2022
- 2022Sharper Utility Bounds for Differentially Private Models22 Apr 2022
- 2022Differentially Private Regression with Unbounded Covariates19 Feb 2022
- 2021Differentially Private Nonparametric Regression Under a Growth Condition24 Nov 2021
- 2021Locally Differentially Private Bayesian Inference27 Oct 2021
- 2021Differentially Private Bayesian Neural Networks on Accuracy, Privacy and Reliability18 Jul 2021
- 2021Non-parametric Differentially Private Confidence Intervals for the Median18 Jun 2021
- 2021Gaussian Processes with Differential Privacy1 Jun 2021
- 2022Differentially Private Regression with Unbounded Covariatescited by 10
- 2024Incentives in Private Collaborative Machine Learningcited by 10
- 2022Noise-Aware Statistical Inference with Differentially Private Synthetic Datacited by 9
- 2021Non-parametric Differentially Private Confidence Intervals for the Mediancited by 7
- 2021Differentially Private Bayesian Neural Networks on Accuracy, Privacy and Reliabilitycited by 6
- 2024Private Regression via Data-Dependent Sufficient Statistic Perturbationcited by 4
- 2021Gaussian Processes with Differential Privacycited by 3
- 2021Differentially Private Nonparametric Regression Under a Growth Conditioncited by 3
- 2022Sharper Utility Bounds for Differentially Private Modelscited by 3
- 2022DPVIm: Differentially Private Variational Inference Improvedcited by 2
- 2024Is merging worth it? Securely evaluating the information gain for causal dataset acquisitioncited by 2
- 2021Locally Differentially Private Bayesian Inferencecited by 1
12 most cited of 24 All 24 (JSON)
- 2026Computation-Utility-Privacy Tradeoffs in Bayesian Estimation18 Mar 2026
- 2026Differentially Private Truncation of Unbounded Data via Public Second Moments25 Feb 2026
- 2025Differentially Private Two-Stage Gradient Descent for Instrumental Variable Regression26 Sep 2025
- 2025On Reconstructing Training Data From Bayesian Posteriors and Trained Models24 Jul 2025
- 2025Fiducial Matching: Differentially Private Inference for Categorical Data15 Jul 2025
- 2025Optimal Survey Design for Private Mean Estimation30 Jan 2025
- 2024Noise-Aware Differentially Private Variational Inference25 Oct 2024
- 2024Is merging worth it? Securely evaluating the information gain for causal dataset acquisition11 Sep 2024
- 2024Private Regression via Data-Dependent Sufficient Statistic Perturbation23 May 2024
- 2024Incentives in Private Collaborative Machine Learning2 Apr 2024
- 2024Differentially private Bayesian tests27 Jan 2024
- 2023Simulation-based Bayesian Inference from Privacy Protected Data19 Oct 2023
12 newest of 24 All 24 (JSON)