# Disentanglement Challenge: From Regularization to Reconstruction

arXiv: https://arxiv.org/abs/1912.00155 · HTML: https://mlsanity.com/paper/1912.00155/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Nov 2019.

## Built on by (most cited first, 2 of 2)

- [Provable concept learning for interpretable predictions using variational autoencoders](https://mlsanity.com/paper/2204.00492/) (2022)
- [The Transitive Information Theory and its Application to Deep Generative Models](https://mlsanity.com/paper/2203.05074/) (2022)

## Abstract (arXiv)

The challenge of learning disentangled representation has recently attracted much attention and boils down to a competition using a new real world disentanglement dataset (Gondal et al., 2019). Various methods based on variational auto-encoder have been proposed to solve this problem, by enforcing the independence between the representation and modifying the regularization term in the variational lower bound. However recent work by Locatello et al. (2018) has demonstrated that the proposed methods are heavily influenced by randomness and the choice of the hyper-parameter. In this work, instead of designing a new regularization term, we adopt the FactorVAE but improve the reconstruction performance and increase the capacity of network and the training step. The strategy turns out to be very effective and achieve the 1st place in the challenge.
