Conjugate Energy-Based Models
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose conjugate energy-based models (CEBMs), a new class of energy-based models that define a joint density over data and latent variables. The joint density of a CEBM decomposes into an intractable distribution over data and a tractable posterior over latent variables. CEBMs have similar use cases as variational autoencoders, in the sense that they learn an unsupervised mapping from data to latent variables. However, these models omit a generator network, which allows them to learn more flexible notions of similarity between data points. Our experiments demonstrate that conjugate EBMs achieve competitive results in terms of image modelling, predictive power of latent space, and out-of-domain detection on a variety of datasets.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 61 references that are in the map. First posted on arXiv 25 Jun 2021.
Builds on
29 of 61 references.
References · 29
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2018Disentangling by Factorisingcited by 614
- 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
- 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 381
- 2016Adversarial Feature Learningcited by 350
- 2021How to Train Your Energy-Based Modelscited by 271
- 2017VAE with a VampPriorcited by 247
- 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
- 2016Attend, Infer, Repeat: Fast Scene Understanding with Generative Modelscited by 209
- 2020SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decompositioncited by 190
- 2016A Theory of Generative ConvNetcited by 174
17 more
- 2019Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Modelcited by 147
- 2018Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objectscited by 128
- 2019On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Modelscited by 105
- 2020Learning Latent Space Energy-Based Prior Modelcited by 104
- 2019Flow Contrastive Estimation of Energy-Based Modelscited by 75
- 2020Your GAN is Secretly an Energy-based Model and You Should use Discriminator Driven Latent Samplingcited by 71
- 2020Improving Generative Imagination in Object-Centric World Modelscited by 70
- 2020No MCMC for me: Amortized sampling for fast and stable training of energy-based modelscited by 64
- 2018Structured Disentangled Representationscited by 62
- 2016Cooperative Training of Descriptor and Generator Networkscited by 60
- 2020Learning Energy-Based Model with Variational Auto-Encoder as Amortized Samplercited by 43
- 2019Exploiting Spatial Invariance for Scalable Unsupervised Object Trackingcited by 40
- 2018Divergence Triangle for Joint Training of Generator Model, Energy-based Model, and Inference Modelcited by 34
- 2020Joint Training of Variational Auto-Encoder and Latent Energy-Based Modelcited by 30
- 2020Hybrid Discriminative-Generative Training via Contrastive Learningcited by 24
- 2020Bi-level Score Matching for Learning Energy-based Latent Variable Modelscited by 10
- 2019Amortized Population Gibbs Samplers with Neural Sufficient Statisticscited by 6
Built on by
Citing papers per year: 2023: 2.
2 papers.
- 2023Guiding Energy-based Models via Contrastive Latent Variablescited by 17
- 2023Morse Neural Networks for Uncertainty Quantificationcited by 4
- 2023Morse Neural Networks for Uncertainty Quantification2 Jul 2023
- 2023Guiding Energy-based Models via Contrastive Latent Variables6 Mar 2023