mlsanityData to 14 Oct 2026

Learning Energy-Based Generative Models via Potential Flow: A Variational Principle Approach to Probability Density Homotopy Matching

arXiv 2504.16262 ↗First posted 22 Apr 2025cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive divergence training via implicit Markov chain Monte Carlo (MCMC) sampling is often unstable and expensive in high-dimensional settings. In this paper, we propose Variational Potential Flow Bayes (VPFB), a new energy-based generative framework that eliminates the need for implicit MCMC sampling and does not rely on auxiliary networks or cooperative training. VPFB learns an energy-parameterized potential flow by constructing a flow-driven density homotopy that is matched to the data distribution through a variational loss minimizing the Kullback-Leibler divergence between the flow-driven and marginal homotopies. This principled formulation enables robust and efficient generative modeling while preserving the interpretability of EBMs. Experimental results on image generation, interpolation, out-of-distribution detection, and compositional generation confirm the effectiveness of VPFB, showing that our method performs competitively with existing approaches in terms of sample quality and versatility across diverse generative modeling tasks.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 71 of its 88 references that are in the map. First posted on arXiv 22 Apr 2025.

Builds on

71 of 88 references.

References · 71

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2018Neural Ordinary Differential Equationscited by 3,779
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  9. 2016Wide Residual Networkscited by 3,070
  10. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  11. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  12. 2015Variational Inference with Normalizing Flowscited by 2,170
38 more
  1. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  2. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  3. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  4. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  5. 2019Large Batch Optimization for Deep Learning: Training BERT in 76 minutescited by 674
  6. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
  7. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 583
  8. 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 543
  9. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
  10. 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 417
  11. 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 405
  12. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
  13. 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
  14. 2021How to Train Your Energy-Based Modelscited by 274
  15. 2019Residual Flows for Invertible Generative Modelingcited by 257
  16. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
  17. 2022Generative Modelling With Inverse Heat Dissipationcited by 167
  18. 2023Diffusion Schr"odinger Bridge Matchingcited by 153
  19. 2019Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Modelcited by 148
  20. 2020Improved Contrastive Divergence Training of Energy Based Modelscited by 130
  21. 2020Learning Energy-Based Models by Diffusion Recovery Likelihoodcited by 123
  22. 2019On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Modelscited by 105
  23. 2020VAEBM: A Symbiosis between Variational Autoencoders and Energy-based Modelscited by 104
  24. 2022Soft Diffusion: Score Matching for General Corruptionscited by 102
  25. 2022Action Matching: Learning Stochastic Dynamics from Samplescited by 98
  26. 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimationcited by 97
  27. 2020Residual Energy-Based Models for Text Generationcited by 95
  28. 2022Poisson Flow Generative Modelscited by 95
  29. 2022Blurring Diffusion Modelscited by 91
  30. 2021GraphEBM: Molecular Graph Generation with Energy-Based Modelscited by 85
  31. 2019Flow Contrastive Estimation of Energy-Based Modelscited by 75
  32. 2020Generalized Energy Based Modelscited by 73
  33. 2020Your GAN is Secretly an Energy-based Model and You Should use Discriminator Driven Latent Samplingcited by 71
  34. 2020No MCMC for me: Amortized sampling for fast and stable training of energy-based modelscited by 64
  35. 2016Cooperative Training of Descriptor and Generator Networkscited by 60
  36. 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
  37. 2020Dual Contradistinctive Generative Autoencodercited by 58
  38. 2020Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classificationcited by 57

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.