# Conjugate Bayes for probit regression via unified skew-normal distributions

arXiv: https://arxiv.org/abs/1802.09565 · HTML: https://mlsanity.com/paper/1802.09565/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Feb 2018.

## Built on by (most cited first, 13 of 13)

- [Latency-Response Theory Model: Evaluating Large Language Models via Response Accuracy and Chain-of-Thought Length](https://mlsanity.com/paper/2512.07019/) (2025)
- [Sparse Bayesian Multidimensional Item Response Theory](https://mlsanity.com/paper/2310.17820/) (2023)
- [Semiparametric discrete data regression with Monte Carlo inference and prediction](https://mlsanity.com/paper/2110.12316/) (2021)
- [Mixing times of data-augmentation Gibbs samplers for high-dimensional probit regression](https://mlsanity.com/paper/2505.14343/) (2025)
- [Bayesian Inference for the Multinomial Probit Model under Gaussian Prior Distribution](https://mlsanity.com/paper/2206.00720/) (2022)
- [Scalable and Calibrated Sampling for Bayesian Generalized Linear Mixed Model via Stochastic Gradient Markov Chain Monte Carlo](https://mlsanity.com/paper/2403.03007/) (2024)
- [Monte Carlo inference for semiparametric Bayesian regression](https://mlsanity.com/paper/2306.05498/) (2023)
- [Efficient expectation propagation for posterior approximation in high-dimensional probit models](https://mlsanity.com/paper/2309.01619/) (2023)
- [Efficient computation of predictive probabilities in probit models via expectation propagation](https://mlsanity.com/paper/2309.01630/) (2023)
- [Expectation propagation for the smoothing distribution in dynamic probit](https://mlsanity.com/paper/2309.01641/) (2023)
- [BaGGLS: A Bayesian Shrinkage Framework for Interpretable Modeling of Interactions in High-Dimensional Biological Data](https://mlsanity.com/paper/2511.15330/) (2025)
- [Mean-field Variational Bayes for Sparse Probit Regression](https://mlsanity.com/paper/2601.21765/) (2026)
- [Discrete Causal Representations from Heterogeneous Domains: A Bayesian Approach with Social Survey Applications](https://mlsanity.com/paper/2606.06288/) (2026)

## Abstract (arXiv)

Regression models for dichotomous data are ubiquitous in statistics. Besides being useful for inference on binary responses, these methods serve also as building blocks in more complex formulations, such as density regression, nonparametric classification and graphical models. Within the Bayesian framework, inference proceeds by updating the priors for the coefficients, typically set to be Gaussians, with the likelihood induced by probit or logit regressions for the responses. In this updating, the apparent absence of a tractable posterior has motivated a variety of computational methods, including Markov Chain Monte Carlo routines and algorithms which approximate the posterior. Despite being routinely implemented, Markov Chain Monte Carlo strategies face mixing or time-inefficiency issues in large p and small n studies, whereas approximate routines fail to capture the skewness typically observed in the posterior. This article proves that the posterior distribution for the probit coefficients has a unified skew-normal kernel, under Gaussian priors. Such a novel result allows efficient Bayesian inference for a wide class of applications, especially in large p and small-to-moderate n studies where state-of-the-art computational methods face notable issues. These advances are outlined in a genetic study, and further motivate the development of a wider class of conjugate priors for probit models along with methods to obtain independent and identically distributed samples from the unified skew-normal posterior.