Non-equilibrium Annealed Adjoint Sampler
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Recently, there has been significant progress in learning-based diffusion samplers, which aim to sample from a given unnormalized density. Many of these approaches formulate the sampling task as a stochastic optimal control (SOC) problem using a canonical uninformative reference process, which limits their ability to efficiently guide trajectories toward the target distribution. In this work, we propose the Non-Equilibrium Annealed Adjoint Sampler (NAAS), a novel SOC-based diffusion framework that employs annealed reference dynamics as a non-stationary base SDE. This annealing structure provides a natural progression toward the target distribution and generates informative reference trajectories, thereby enhancing the stability and efficiency of learning the control. Owing to our SOC formulation, our framework can incorporate a variety of SOC solvers, thereby offering high flexibility in algorithmic design. As one instantiation, we employ a lean adjoint system inspired by adjoint matching, enabling efficient and scalable training. We demonstrate the effectiveness of NAAS across a range of tasks, including sampling from classical energy landscapes and molecular Boltzmann distributions.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 28 of its 56 references that are in the map. First posted on arXiv 22 Jun 2025.
Builds on
28 of 56 references.
Closest ancestors · 6
Same direction, newest first
- 2024Learned Reference-based Diffusion Sampling for multi-modal distributions25 Oct
- 2024Particle Denoising Diffusion Sampler9 Feb
- 2023Diffusion Schr"odinger Bridge Matching29 Mar
- 2023Denoising Diffusion Samplers27 Feb
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
Other references · 22
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 233
- 2021Path Integral Sampler: a stochastic control approach for samplingcited by 181
- 2020Stochastic Normalizing Flowscited by 157
- 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generationcited by 150
- 2022Flow Annealed Importance Sampling Bootstrapcited by 127
- 2024Iterated Denoising Energy Matching for Sampling from Boltzmann Densitiescited by 116
- 2023Improved sampling via learned diffusionscited by 104
- 2021Annealed Flow Transport Monte Carlocited by 90
- 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matchingcited by 85
- 2020Solving high-dimensional Hamilton-Jacobi-Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path spacecited by 82
10 more
- 2024NETS: A Non-Equilibrium Transport Samplercited by 69
- 2022Continual Repeated Annealed Flow Transport Monte Carlocited by 66
- 2024Beyond ELBOs: A Large-Scale Evaluation of Variational Methods for Samplingcited by 56
- 2024Sequential Controlled Langevin Diffusionscited by 48
- 2022Deep Generalized Schr"odinger Bridgecited by 47
- 2023Generalized Schr"odinger Bridge Matchingcited by 40
- 2021MCMC Variational Inference via Uncorrected Hamiltonian Annealingcited by 39
- 2024Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Samplingcited by 23
- 2024Harmonic Path Integral Diffusioncited by 11
- 2025Complexity Analysis of Normalizing Constant Estimation: from Jarzynski Equality to Annealed Importance Sampling and beyondcited by 11
Built on by
Citing papers per year: 2025: 6; 2026: 2.
8 papers.
- 2025Trust Region Constrained Measure Transport in Path Space for Stochastic Optimal Control and Inferencecited by 23
- 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Controlcited by 21
- 2025Proximal Diffusion Neural Samplercited by 16
- 2025Learning Boltzmann Generators via Constrained Mass Transportcited by 9
- 2025Control Consistency Losses for Diffusion Bridgescited by 6
- 2025Functional Adjoint Sampler: Scalable Sampling on Infinite Dimensional Spacescited by 4
- 2026Discrete Adjoint Schr"odinger Bridge Samplercited by 4
- 2026Efficient Training of Boltzmann Generators Using Off-Policy Log-Dispersion Regularizationcited by 3
- 2026Discrete Adjoint Schr"odinger Bridge Sampler9 Feb 2026
- 2026Efficient Training of Boltzmann Generators Using Off-Policy Log-Dispersion Regularization3 Feb 2026
- 2025Control Consistency Losses for Diffusion Bridges4 Dec 2025
- 2025Functional Adjoint Sampler: Scalable Sampling on Infinite Dimensional Spaces9 Nov 2025
- 2025Learning Boltzmann Generators via Constrained Mass Transport21 Oct 2025
- 2025Proximal Diffusion Neural Sampler4 Oct 2025
- 2025Trust Region Constrained Measure Transport in Path Space for Stochastic Optimal Control and Inference17 Aug 2025
- 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Control14 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026A unified perspective on fine-tuning and sampling with diffusion and flow models
- 2025Continuously Tempered Diffusion Samplers
- 2025Adjoint Schr"odinger Bridge Sampler
- 2024AdjointDEIS: Efficient Gradients for Diffusion Models
- 2025Tilt Matching for Scalable Sampling and Fine-Tuning
- 2026Unsupervised Diffusion Solver for Combinatorial Optimization via Combinatorial Adjoint Matching
- 2026Efficient Adjoint Matching for Fine-tuning Diffusion Models
- 2025Progressive Inference-Time Annealing of Diffusion Models for Sampling from Boltzmann Densities