# End-to-End Learning for the Deep Multivariate Probit Model

arXiv: https://arxiv.org/abs/1803.08591 · HTML: https://mlsanity.com/paper/1803.08591/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Mar 2018.

## Built on by (most cited first, 8 of 8)

- [Machine Learning and Deep Learning -- A review for Ecologists](https://mlsanity.com/paper/2204.05023/) (2022)
- [Evaluating Multi-label Classifiers with Noisy Labels](https://mlsanity.com/paper/2102.08427/) (2021)
- [HOT-VAE: Learning High-Order Label Correlation for Multi-Label Classification via Attention-Based Variational Autoencoders](https://mlsanity.com/paper/2103.06375/) (2021)
- [Automating Crystal-Structure Phase Mapping: Combining Deep Learning with Constraint Reasoning](https://mlsanity.com/paper/2108.09523/) (2021)
- [Materials Representation and Transfer Learning for Multi-Property Prediction](https://mlsanity.com/paper/2106.02225/) (2021)
- [SimFair: A Unified Framework for Fairness-Aware Multi-Label Classification](https://mlsanity.com/paper/2302.09683/) (2023)
- [LabelKAN -- Kolmogorov-Arnold Networks for Inter-Label Learning: Avian Community Learning](https://mlsanity.com/paper/2601.18818/) (2026)
- [STELLAR: Spatio-Temporal Environmental Learning with Latent Alignment and Refinement for Long-Tailed Species Distribution Modeling](https://mlsanity.com/paper/2606.08484/) (2026)

## Abstract (arXiv)

The multivariate probit model (MVP) is a popular classic model for studying binary responses of multiple entities. Nevertheless, the computational challenge of learning the MVP model, given that its likelihood involves integrating over a multidimensional constrained space of latent variables, significantly limits its application in practice. We propose a flexible deep generalization of the classic MVP, the Deep Multivariate Probit Model (DMVP), which is an end-to-end learning scheme that uses an efficient parallel sampling process of the multivariate probit model to exploit GPU-boosted deep neural networks. We present both theoretical and empirical analysis of the convergence behavior of DMVP's sampling process with respect to the resolution of the correlation structure. We provide convergence guarantees for DMVP and our empirical analysis demonstrates the advantages of DMVP's sampling compared with standard MCMC-based methods. We also show that when applied to multi-entity modelling problems, which are natural DMVP applications, DMVP trains faster than classical MVP, by at least an order of magnitude, captures rich correlations among entities, and further improves the joint likelihood of entities compared with several competitive models.
