BoltzNCE: Learning Likelihoods for Boltzmann Generation with Stochastic Interpolants and Noise Contrastive Estimation
Not on the map. Why?
Abstract (arXiv)
Efficient sampling from the Boltzmann distribution given its energy function is a key challenge for modeling complex physical systems such as molecules. Boltzmann Generators address this problem by leveraging continuous normalizing flows to transform a simple prior into a distribution that can be reweighted to match the target using sample likelihoods. Despite the elegance of this approach, obtaining these likelihoods requires computing costly Jacobians during integration, which is impractical for large molecular systems. To overcome this difficulty, we train an energy-based model (EBM) to approximate likelihoods using both noise contrastive estimation (NCE) and score matching, which we show outperforms the use of either objective in isolation. On 2d synthetic systems where failure can be easily visualized, NCE improves mode weighting relative to score matching alone. On alanine dipeptide, our method yields free energy profiles and energy distributions that closely match those obtained using exact likelihoods while achieving 100× faster inference. By training on multiple dipeptide systems, we show that our approach also exhibits effective transfer learning, generalizing to new systems at inference time and achieving at least a 6× speedup over standard MD. While many recent efforts in generative modeling have prioritized models with fast sampling, our work demonstrates the design of models with accelerated likelihoods, enabling the application of reweighting schemes that ensure unbiased Boltzmann statistics at scale. Our code is available at https://github.com/RishalAggarwal/BoltzNCE.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 47 of its 79 references that are in the map. First posted on arXiv 1 Jul 2025.
Builds on
47 of 79 references.
References · 47
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
- 2021Implicit Behavioral Cloningcited by 452
35 more
- 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 313
- 2021How to Train Your Energy-Based Modelscited by 274
- 2022Torsional Diffusion for Molecular Conformer Generationcited by 263
- 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 220
- 2021GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graphcited by 143
- 2023Equivariant flow matchingcited by 135
- 2020Improved Contrastive Divergence Training of Energy Based Modelscited by 130
- 2022Flow Annealed Importance Sampling Bootstrapcited by 127
- 2024AlphaFold Meets Flow Matching for Generating Protein Ensemblescited by 110
- 2020Telescoping Density-Ratio Estimationcited by 108
- 2020Generalized Energy Based Modelscited by 73
- 2020Targeted free energy estimation via learned mappingscited by 67
- 2023Timewarp: Transferable Acceleration of Molecular Dynamics by Learning Time-Coarsened Dynamicscited by 66
- 2021Density Ratio Estimation via Infinitesimal Classificationcited by 61
- 2024Mixed Continuous and Categorical Flow Matching for 3D De Novo Molecule Generationcited by 54
- 2021Equivariant Graph Neural Networks for 3D Macromolecular Structurecited by 53
- 2021Smooth Normalizing Flowscited by 53
- 2024Transferable Boltzmann Generatorscited by 46
- 2024Protein Conformation Generation via Force-Guided SE(3) Diffusion Modelscited by 45
- 2021Deeptime: a Python library for machine learning dynamical models from time series datacited by 38
- 2025Scalable Equilibrium Sampling with Sequential Boltzmann Generatorscited by 38
- 2022Flow-matching -- efficient coarse-graining of molecular dynamics without forcescited by 36
- 2020"Hey, that's not an ODE": Faster ODE Adjoints via Seminormscited by 35
- 2023Harmonic Self-Conditioned Flow Matching for Multi-Ligand Docking and Binding Site Designcited by 30
- 2014Notes on Noise Contrastive Estimation and Negative Samplingcited by 26
- 2023Navigating protein landscapes with a machine-learned transferable coarse-grained modelcited by 23
- 2023Guiding Energy-based Models via Contrastive Latent Variablescited by 18
- 2024Efficient mapping of phase diagrams with conditional Boltzmann Generatorscited by 18
- 2021Analyzing and Improving the Optimization Landscape of Noise-Contrastive Estimationcited by 15
- 2024BNEM: A Boltzmann Sampler Based on Bootstrapped Noised Energy Matchingcited by 15
- 2023Provable benefits of annealing for estimating normalizing constants: Importance Sampling, Noise-Contrastive Estimation, and beyondcited by 13
- 2023Revisiting Energy Based Models as Policies: Ranking Noise Contrastive Estimation and Interpolating Energy Modelscited by 10
- 2024Scalable Normalizing Flows Enable Boltzmann Generators for Macromoleculescited by 10
- 2022Pitfalls of Gaussians as a noise distribution in NCEcited by 6
- 2023Accelerating Inference in Molecular Diffusion Models with Latent Representations of Protein Structurecited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2025FALCON: Few-step Accurate Likelihoods for Continuous Flowscited by 13
- 2026Learning Energy-Based Models from Stochastic Interpolants using Spatiotemporal Differencescited by 2
- 2026Few-Step Boltzmann Generators via Scalable Likelihood Flow Mapscited by 2
- 2026Autoregressive Boltzmann Generatorscited by 1
- 2026Scalable Inference-Time Annealing with Surrogate Likelihood Estimatorscited by 0
- 2026Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Samplingcited by 0
- 2026Manifold Drift in Flow Preference Optimization: A Root Cause of Reward Hackingcited by 0
- 2026Manifold Drift in Flow Preference Optimization: A Root Cause of Reward Hacking20 Aug 2026
- 2026Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling17 Jul 2026
- 2026Few-Step Boltzmann Generators via Scalable Likelihood Flow Maps27 Jun 2026
- 2026Autoregressive Boltzmann Generators25 Jun 2026
- 2026Scalable Inference-Time Annealing with Surrogate Likelihood Estimators29 May 2026
- 2026Learning Energy-Based Models from Stochastic Interpolants using Spatiotemporal Differences26 May 2026
- 2025FALCON: Few-step Accurate Likelihoods for Continuous Flows10 Dec 2025