The Deep Generative Decoder: MAP estimation of representations improves modeling of single-cell RNA data
Not on the map. Why?
Abstract (arXiv)
Learning low-dimensional representations of single-cell transcriptomics has become instrumental to its downstream analysis. The state of the art is currently represented by neural network models such as variational autoencoders (VAEs) which use a variational approximation of the likelihood for inference. We here present the Deep Generative Decoder (DGD), a simple generative model that computes model parameters and representations directly via maximum a posteriori (MAP) estimation. The DGD handles complex parameterized latent distributions naturally unlike VAEs which typically use a fixed Gaussian distribution, because of the complexity of adding other types. We first show its general functionality on a commonly used benchmark set, Fashion-MNIST. Secondly, we apply the model to multiple single-cell data sets. Here the DGD learns low-dimensional, meaningful and well-structured latent representations with sub-clustering beyond the provided labels. The advantages of this approach are its simplicity and its capability to provide representations of much smaller dimensionality than a comparable VAE.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 68 references that are in the map. First posted on arXiv 13 Oct 2021.
Builds on
22 of 68 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Neural Discrete Representation Learningcited by 4,712
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2020Designing Network Design Spacescited by 960
- 2016Pixel Recurrent Neural Networkscited by 816
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
10 more
- 2021Score-based Generative Modeling in Latent Spacecited by 636
- 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 385
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 220
- 2017Optimizing the Latent Space of Generative Networkscited by 157
- 2018Inference Suboptimality in Variational Autoencoderscited by 132
- 2020Failure Modes of Variational Autoencoders and Their Effects on Downstream Taskscited by 16
- 2020Gradient Origin Networkscited by 10
- 2021DuelGAN: A Duel Between Two Discriminators Stabilizes the GAN Trainingcited by 4
- 2021A manifold learning perspective on representation learning: Learning decoder and representations without an encodercited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.
- 2025Riemannian Generative Decodercited by 2
- 2024Improved Variational Inference in Discrete VAEs using Error Correcting Codescited by 0
- 2025Riemannian Generative Decoder23 Jun 2025
- 2024Improved Variational Inference in Discrete VAEs using Error Correcting Codes10 Oct 2024