Learning Energy-Based Generative Models via Potential Flow: A Variational Principle Approach to Probability Density Homotopy Matching
Not on the map. Why?
Abstract (arXiv)
Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive divergence training via implicit Markov chain Monte Carlo (MCMC) sampling is often unstable and expensive in high-dimensional settings. In this paper, we propose Variational Potential Flow Bayes (VPFB), a new energy-based generative framework that eliminates the need for implicit MCMC sampling and does not rely on auxiliary networks or cooperative training. VPFB learns an energy-parameterized potential flow by constructing a flow-driven density homotopy that is matched to the data distribution through a variational loss minimizing the Kullback-Leibler divergence between the flow-driven and marginal homotopies. This principled formulation enables robust and efficient generative modeling while preserving the interpretability of EBMs. Experimental results on image generation, interpolation, out-of-distribution detection, and compositional generation confirm the effectiveness of VPFB, showing that our method performs competitively with existing approaches in terms of sample quality and versatility across diverse generative modeling tasks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 71 of its 88 references that are in the map. First posted on arXiv 22 Apr 2025.
Builds on
71 of 88 references.
References · 71
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2016Wide Residual Networkscited by 3,070
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2015Variational Inference with Normalizing Flowscited by 2,170
38 more
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2019Large Batch Optimization for Deep Learning: Training BERT in 76 minutescited by 674
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 583
- 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 543
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
- 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 417
- 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 405
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
- 2021How to Train Your Energy-Based Modelscited by 274
- 2019Residual Flows for Invertible Generative Modelingcited by 257
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2022Generative Modelling With Inverse Heat Dissipationcited by 167
- 2023Diffusion Schr"odinger Bridge Matchingcited by 153
- 2019Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Modelcited by 148
- 2020Improved Contrastive Divergence Training of Energy Based Modelscited by 130
- 2020Learning Energy-Based Models by Diffusion Recovery Likelihoodcited by 123
- 2019On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Modelscited by 105
- 2020VAEBM: A Symbiosis between Variational Autoencoders and Energy-based Modelscited by 104
- 2022Soft Diffusion: Score Matching for General Corruptionscited by 102
- 2022Action Matching: Learning Stochastic Dynamics from Samplescited by 98
- 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimationcited by 97
- 2020Residual Energy-Based Models for Text Generationcited by 95
- 2022Poisson Flow Generative Modelscited by 95
- 2022Blurring Diffusion Modelscited by 91
- 2021GraphEBM: Molecular Graph Generation with Energy-Based Modelscited by 85
- 2019Flow Contrastive Estimation of Energy-Based Modelscited by 75
- 2020Generalized Energy Based Modelscited by 73
- 2020Your GAN is Secretly an Energy-based Model and You Should use Discriminator Driven Latent Samplingcited by 71
- 2020No MCMC for me: Amortized sampling for fast and stable training of energy-based modelscited by 64
- 2016Cooperative Training of Descriptor and Generator Networkscited by 60
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2020Dual Contradistinctive Generative Autoencodercited by 58
- 2020Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classificationcited by 57
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.