# Disentangled Variational Autoencoder based Multi-Label Classification with Covariance-Aware Multivariate Probit Model

arXiv: https://arxiv.org/abs/2007.06126 · HTML: https://mlsanity.com/paper/2007.06126/

## Key facts

- Cited by 22 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Jul 2020.

## Built on by (most cited first, 22 of 22)

- [Traffic Flow Forecasting with Spatial-Temporal Graph Diffusion Network](https://mlsanity.com/paper/2110.04038/) (2021)
- [Hierarchical Learning for Generation with Long Source Sequences](https://mlsanity.com/paper/2104.07545/) (2021)
- [Spatial-Temporal Sequential Hypergraph Network for Crime Prediction with Dynamic Multiplex Relation Learning](https://mlsanity.com/paper/2201.02435/) (2022)
- [Deep Learning for Multi-Label Learning: A Comprehensive Survey](https://mlsanity.com/paper/2401.16549/) (2024)
- [Gaussian Mixture Variational Autoencoder with Contrastive Learning for Multi-Label Classification](https://mlsanity.com/paper/2112.00976/) (2021)
- [Correlation-Aware Graph Convolutional Networks for Multi-Label Node Classification](https://mlsanity.com/paper/2411.17350/) (2024)
- [Evaluating Multi-label Classifiers with Noisy Labels](https://mlsanity.com/paper/2102.08427/) (2021)
- [HOT-VAE: Learning High-Order Label Correlation for Multi-Label Classification via Attention-Based Variational Autoencoders](https://mlsanity.com/paper/2103.06375/) (2021)
- [Materials Representation and Transfer Learning for Multi-Property Prediction](https://mlsanity.com/paper/2106.02225/) (2021)
- [SimFair: A Unified Framework for Fairness-Aware Multi-Label Classification](https://mlsanity.com/paper/2302.09683/) (2023)
- [Learning Gaussian Mixture Representations for Tensor Time Series Forecasting](https://mlsanity.com/paper/2306.00390/) (2023)
- [Deep Partial Multi-Label Learning with Graph Disambiguation](https://mlsanity.com/paper/2305.05882/) (2023)
- [Multi-Label Adaptive Batch Selection by Highlighting Hard and Imbalanced Samples](https://mlsanity.com/paper/2403.18192/) (2024)
- [Multi-relation Message Passing for Multi-label Text Classification](https://mlsanity.com/paper/2202.04844/) (2022)
- [Multi-Label Gold Asymmetric Loss Correction with Single-Label Regulators](https://mlsanity.com/paper/2108.02032/) (2021)
- [Multi-axis Attentive Prediction for Sparse EventData: An Application to Crime Prediction](https://mlsanity.com/paper/2110.01794/) (2021)
- [Improving Multi-Label Contrastive Learning by Leveraging Label Distribution](https://mlsanity.com/paper/2501.19145/) (2025)
- [Interval Type-2 Fuzzy Neural Networks for Multi-Label Classification](https://mlsanity.com/paper/2302.10430/) (2023)
- [A Consistent Lebesgue Measure for Multi-label Learning](https://mlsanity.com/paper/2402.00324/) (2024)
- [Semi-Supervised Learning with Balanced Deep Representation Distributions](https://mlsanity.com/paper/2603.21056/) (2026)
- [STELLAR: Spatio-Temporal Environmental Learning with Latent Alignment and Refinement for Long-Tailed Species Distribution Modeling](https://mlsanity.com/paper/2606.08484/) (2026)
- [HyperLabel: Multi-Label Classification via Hypergraph-Based Label Correlation Modeling](https://mlsanity.com/paper/2609.32276/) (2026)

## Abstract (arXiv)

Multi-label classification is the challenging task of predicting the presence and absence of multiple targets, involving representation learning and label correlation modeling. We propose a novel framework for multi-label classification, Multivariate Probit Variational AutoEncoder (MPVAE), that effectively learns latent embedding spaces as well as label correlations. MPVAE learns and aligns two probabilistic embedding spaces for labels and features respectively. The decoder of MPVAE takes in the samples from the embedding spaces and models the joint distribution of output targets under a Multivariate Probit model by learning a shared covariance matrix. We show that MPVAE outperforms the existing state-of-the-art methods on a variety of application domains, using public real-world datasets. MPVAE is further shown to remain robust under noisy settings. Lastly, we demonstrate the interpretability of the learned covariance by a case study on a bird observation dataset.
