mlsanityData to 14 Oct 2026

BoltzNCE: Learning Likelihoods for Boltzmann Generation with Stochastic Interpolants and Noise Contrastive Estimation

arXiv 2507.00846 ↗First posted 1 Jul 2025cs.LG physics.bio-phcited by 7

Not on the map. Why?

Abstract (arXiv)

Efficient sampling from the Boltzmann distribution given its energy function is a key challenge for modeling complex physical systems such as molecules. Boltzmann Generators address this problem by leveraging continuous normalizing flows to transform a simple prior into a distribution that can be reweighted to match the target using sample likelihoods. Despite the elegance of this approach, obtaining these likelihoods requires computing costly Jacobians during integration, which is impractical for large molecular systems. To overcome this difficulty, we train an energy-based model (EBM) to approximate likelihoods using both noise contrastive estimation (NCE) and score matching, which we show outperforms the use of either objective in isolation. On 2d synthetic systems where failure can be easily visualized, NCE improves mode weighting relative to score matching alone. On alanine dipeptide, our method yields free energy profiles and energy distributions that closely match those obtained using exact likelihoods while achieving 100× faster inference. By training on multiple dipeptide systems, we show that our approach also exhibits effective transfer learning, generalizing to new systems at inference time and achieving at least a 6× speedup over standard MD. While many recent efforts in generative modeling have prioritized models with fast sampling, our work demonstrates the design of models with accelerated likelihoods, enabling the application of reweighting schemes that ensure unbiased Boltzmann statistics at scale. Our code is available at https://github.com/RishalAggarwal/BoltzNCE.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 47 of its 79 references that are in the map. First posted on arXiv 1 Jul 2025.

Builds on

47 of 79 references.

References · 47

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2018Neural Ordinary Differential Equationscited by 3,779
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2021E(n) Equivariant Graph Neural Networkscited by 965
  8. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  9. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  10. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  11. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
  12. 2021Implicit Behavioral Cloningcited by 452
35 more
  1. 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 313
  2. 2021How to Train Your Energy-Based Modelscited by 274
  3. 2022Torsional Diffusion for Molecular Conformer Generationcited by 263
  4. 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 220
  5. 2021GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graphcited by 143
  6. 2023Equivariant flow matchingcited by 135
  7. 2020Improved Contrastive Divergence Training of Energy Based Modelscited by 130
  8. 2022Flow Annealed Importance Sampling Bootstrapcited by 127
  9. 2024AlphaFold Meets Flow Matching for Generating Protein Ensemblescited by 110
  10. 2020Telescoping Density-Ratio Estimationcited by 108
  11. 2020Generalized Energy Based Modelscited by 73
  12. 2020Targeted free energy estimation via learned mappingscited by 67
  13. 2023Timewarp: Transferable Acceleration of Molecular Dynamics by Learning Time-Coarsened Dynamicscited by 66
  14. 2021Density Ratio Estimation via Infinitesimal Classificationcited by 61
  15. 2024Mixed Continuous and Categorical Flow Matching for 3D De Novo Molecule Generationcited by 54
  16. 2021Equivariant Graph Neural Networks for 3D Macromolecular Structurecited by 53
  17. 2021Smooth Normalizing Flowscited by 53
  18. 2024Transferable Boltzmann Generatorscited by 46
  19. 2024Protein Conformation Generation via Force-Guided SE(3) Diffusion Modelscited by 45
  20. 2021Deeptime: a Python library for machine learning dynamical models from time series datacited by 38
  21. 2025Scalable Equilibrium Sampling with Sequential Boltzmann Generatorscited by 38
  22. 2022Flow-matching -- efficient coarse-graining of molecular dynamics without forcescited by 36
  23. 2020"Hey, that's not an ODE": Faster ODE Adjoints via Seminormscited by 35
  24. 2023Harmonic Self-Conditioned Flow Matching for Multi-Ligand Docking and Binding Site Designcited by 30
  25. 2014Notes on Noise Contrastive Estimation and Negative Samplingcited by 26
  26. 2023Navigating protein landscapes with a machine-learned transferable coarse-grained modelcited by 23
  27. 2023Guiding Energy-based Models via Contrastive Latent Variablescited by 18
  28. 2024Efficient mapping of phase diagrams with conditional Boltzmann Generatorscited by 18
  29. 2021Analyzing and Improving the Optimization Landscape of Noise-Contrastive Estimationcited by 15
  30. 2024BNEM: A Boltzmann Sampler Based on Bootstrapped Noised Energy Matchingcited by 15
  31. 2023Provable benefits of annealing for estimating normalizing constants: Importance Sampling, Noise-Contrastive Estimation, and beyondcited by 13
  32. 2023Revisiting Energy Based Models as Policies: Ranking Noise Contrastive Estimation and Interpolating Energy Modelscited by 10
  33. 2024Scalable Normalizing Flows Enable Boltzmann Generators for Macromoleculescited by 10
  34. 2022Pitfalls of Gaussians as a noise distribution in NCEcited by 6
  35. 2023Accelerating Inference in Molecular Diffusion Models with Latent Representations of Protein Structurecited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.