Particle Dynamics for Latent-Variable Energy-Based Models
Not on the map. Why?
Abstract (arXiv)
Latent-variable energy-based models (LVEBMs) assign a single normalized energy to joint pairs of observed data and latent variables, offering expressive generative modeling while capturing hidden structure. We recast maximum-likelihood training as a saddle problem over distributions on the latent and joint manifolds and view the inner updates as coupled Wasserstein gradient flows. The resulting algorithm alternates overdamped Langevin updates for a joint negative pool and for conditional latent particles with stochastic parameter ascent, requiring no discriminator or auxiliary networks. We prove existence and convergence under standard smoothness and dissipativity assumptions, with decay rates in KL divergence and Wasserstein-2 distance. The saddle-point view further yields an ELBO strictly tighter than bounds obtained with restricted amortized posteriors. Our method is evaluated on numerical approximations of physical systems and performs competitively against comparable approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 38 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
14 of 38 references.
References · 14
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
- 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
- 2018Inference Suboptimality in Variational Autoencoderscited by 131
- 2020No MCMC for me: Amortized sampling for fast and stable training of energy-based modelscited by 64
- 2018Semi-Implicit Variational Inferencecited by 55
- 2024Statistical optimal transportcited by 44
- 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
2 more
- 2024Particle Semi-Implicit Variational Inferencecited by 7
- 2021Particle Dynamics for Learning EBMscited by 1
Built on by
Not cited yet.