Continual Repeated Annealed Flow Transport Monte Carlo
Not on the map. Why?
Abstract (arXiv)
We propose Continual Repeated Annealed Flow Transport Monte Carlo (CRAFT), a method that combines a sequential Monte Carlo (SMC) sampler (itself a generalization of Annealed Importance Sampling) with variational inference using normalizing flows. The normalizing flows are directly trained to transport between annealing temperatures using a KL divergence for each transition. This optimization objective is itself estimated using the normalizing flow/SMC approximation. We show conceptually and using multiple empirical examples that CRAFT improves on Annealed Flow Transport Monte Carlo (Arbel et al., 2021), on which it builds and also on Markov chain Monte Carlo (MCMC) based Stochastic Normalizing Flows (Wu et al., 2020). By incorporating CRAFT within particle MCMC, we show that such learnt samplers can achieve impressively accurate results on a challenging lattice field theory example.
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 31 Jan 2022.
Builds on
19 of 39 references.
References · 19
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2020Stochastic Normalizing Flowscited by 156
- 2019Flow-based generative models for Markov chain Monte Carlo in lattice field theorycited by 147
- 2017Variational Sequential Monte Carlocited by 93
- 2017Filtering Variational Objectivescited by 91
- 2021Annealed Flow Transport Monte Carlocited by 90
- 2017Auto-Encoding Sequential Monte Carlocited by 64
- 2021Differentiable Particle Filtering via Entropy-Regularized Optimal Transportcited by 59
7 more
- 2021MCMC Variational Inference via Uncorrected Hamiltonian Annealingcited by 39
- 2021Monte Carlo Variational Auto-Encoderscited by 36
- 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noisecited by 36
- 2021Introduction to Normalizing Flows for Lattice Field Theorycited by 35
- 2020An invitation to sequential Monte Carlo samplerscited by 33
- 2021Scaling Up Machine Learning For Quantum Field Theory with Equivariant Continuous Flowscited by 24
- 2021Nested Variational Inferencecited by 14
Built on by
Citing papers per year: 2022: 4; 2023: 9; 2024: 21; 2025: 23; 2026: 9.
66 papers.
Sort:
By area:
- 2022Flow Annealed Importance Sampling Bootstrapcited by 124
- 2024Iterated Denoising Energy Matching for Sampling from Boltzmann Densitiescited by 113
- 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matchingcited by 78
- 2024NETS: A Non-Equilibrium Transport Samplercited by 67
- 2024Particle Denoising Diffusion Samplercited by 63
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2024Beyond ELBOs: A Large-Scale Evaluation of Variational Methods for Samplingcited by 55
- 2022Score-Based Diffusion meets Annealed Importance Samplingcited by 51
- 2024Sequential Controlled Langevin Diffusionscited by 47
- 2025Scalable Equilibrium Sampling with Sequential Boltzmann Generatorscited by 36
- 2025LEAPS: A discrete neural sampler via locally equivariant networkscited by 30
- 2025Underdamped Diffusion Bridges with Applications to Samplingcited by 28
38 more
- 2022Aspects of scaling and scalability for flow-based sampling of lattice QCDcited by 26
- 2024Liouville Flow Importance Samplercited by 25
- 2023Advances in machine-learning-based sampling motivated by lattice quantum chromodynamicscited by 23
- 2023Transport meets Variational Inference: Controlled Monte Carlo Diffusionscited by 21
- 2025Adjoint Schr"odinger Bridge Samplercited by 20
- 2024Dynamical Measure Transport and Neural PDE Solvers for Samplingcited by 19
- 2025From discrete-time policies to continuous-time diffusion samplers: Asymptotic equivalences and faster trainingcited by 17
- 2025Proximal Diffusion Neural Samplercited by 16
- 2025Temperature-Annealed Boltzmann Generatorscited by 14
- 2023Entropy-based Training Methods for Scalable Neural Implicit Samplercited by 13
- 2025Accelerated Parallel Tempering via Neural Transportscited by 13
- 2024Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributionscited by 11
- 2025Amortized Sampling with Transferable Normalizing Flowscited by 11
- 2024Markovian Flow Matching: Accelerating MCMC with Continuous Normalizing Flowscited by 9
- 2024Learned Reference-based Diffusion Sampling for multi-modal distributionscited by 9
- 2025Non-equilibrium Annealed Adjoint Samplercited by 8
- 2025Learning Boltzmann Generators via Constrained Mass Transportcited by 8
- 2024Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inferencecited by 7
- 2024Importance Corrected Neural JKO Samplingcited by 7
- 2024Practical applications of machine-learned flows on gauge fieldscited by 6
- 2025Scaling flow-based approaches for topology sampling in SU(3) gauge theorycited by 6
- 2022Proximal Residual Flows for Bayesian Inverse Problemscited by 5
- 2023Comparison of Affine and Rational Quadratic Spline Coupling and Autoregressive Flows through Robust Statistical Testscited by 5
- 2023Estimating Gibbs free energies via isobaric-isothermal flowscited by 5
- 2024Stable Training of Normalizing Flows for High-dimensional Variational Inferencecited by 5
- 2024Fast and Unified Path Gradient Estimators for Normalizing Flowscited by 5
- 2024Quasi-Bayes meets Vinescited by 5
- 2024Disentangling impact of capacity, objective, batchsize, estimators, and step-size on flow VIcited by 5
- 2025Neural Flow Samplers with Shortcut Modelscited by 5
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Samplercited by 4
- 2026Flow Sampling: Learning to Sample from Unnormalized Densities via Denoising Conditional Processescited by 4
- 2025Model-Informed Flows for Bayesian Inferencecited by 3
- 2023The NFLikelihood: an unsupervised DNNLikelihood from Normalizing Flowscited by 2
- 2023Reparameterized Variational Rejection Samplingcited by 2
- 2023Rare Event Probability Learning by Normalizing Flowscited by 2
- 2025SESaMo: Symmetry-Enforcing Stochastic Modulation for Normalizing Flowscited by 2
- 2024Empirical evaluation of normalizing flows in Markov Chain Monte Carlocited by 1
- 2025Asymptotically exact variational flows via involutive MCMC kernelscited by 1
50 most cited of 66 All 66 (JSON)
- 2026Wasserstein Gradient Flows and Forward-Only Diffusion Are Not Enough for Multimodal Sampling1 Oct 2026
- 2026Iterative Exact Discrete Guidance for Energy-Based Sampling29 Sep 2026
- 2026Neural Transport Nested Sampling24 Sep 2026
- 2026Mode Coverage in Normalizing Flow Boltzmann Generators via Log-Ratio Variation8 Sep 2026
- 2026FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions1 Sep 2026
- 2026Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling17 Jul 2026
- 2026Tensor Train Diffusion: Leveraging Low-Rank Structures for High-Dimensional Score-Based Sampling7 Jul 2026
- 2026Flow Sampling: Learning to Sample from Unnormalized Densities via Denoising Conditional Processes5 May 2026
- 2026Jeffreys Flow: Robust Boltzmann Generators for Rare Event Sampling via Parallel Tempering Distillation7 Apr 2026
- 2025One-Step Diffusion Samplers via Self-Distillation and Deterministic Flow4 Dec 2025
- 2025Particle Monte Carlo methods for Lattice Field Theory19 Nov 2025
- 2025Reducing normalizing flow complexity for MCMC preconditioning4 Nov 2025
38 more
- 2025Scaling flow-based approaches for topology sampling in SU(3) gauge theory29 Oct 2025
- 2025Learning Boltzmann Generators via Constrained Mass Transport21 Oct 2025
- 2025Proximal Diffusion Neural Sampler4 Oct 2025
- 2025Continuously Tempered Diffusion Samplers30 Aug 2025
- 2025Amortized Sampling with Transferable Normalizing Flows25 Aug 2025
- 2025Adjoint Schr"odinger Bridge Sampler27 Jun 2025
- 2025Non-equilibrium Annealed Adjoint Sampler22 Jun 2025
- 2025Asymptotically exact variational flows via involutive MCMC kernels2 Jun 2025
- 2025Model-Informed Flows for Bayesian Inference30 May 2025
- 2025SESaMo: Symmetry-Enforcing Stochastic Modulation for Normalizing Flows26 May 2025
- 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching16 Apr 2025
- 2025Underdamped Diffusion Bridges with Applications to Sampling2 Mar 2025
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Sampler1 Mar 2025
- 2025Scalable Equilibrium Sampling with Sequential Boltzmann Generators25 Feb 2025
- 2025Value Gradient Sampler: Learning Invariant Value Functions for Equivariant Diffusion Sampling18 Feb 2025
- 2025LEAPS: A discrete neural sampler via locally equivariant networks15 Feb 2025
- 2025Accelerated Parallel Tempering via Neural Transports14 Feb 2025
- 2025Neural Flow Samplers with Shortcut Models11 Feb 2025
- 2025Temperature-Annealed Boltzmann Generators31 Jan 2025
- 2025From discrete-time policies to continuous-time diffusion samplers: Asymptotic equivalences and faster training10 Jan 2025
- 2024Empirical evaluation of normalizing flows in Markov Chain Monte Carlo22 Dec 2024
- 2024Disentangling impact of capacity, objective, batchsize, estimators, and step-size on flow VI11 Dec 2024
- 2024Sampling from Boltzmann densities with physics informed low-rank formats10 Dec 2024
- 2024Sequential Controlled Langevin Diffusions10 Dec 2024
- 2024Denoising Fisher Training For Neural Implicit Samplers3 Nov 2024
- 2024Learned Reference-based Diffusion Sampling for multi-modal distributions25 Oct 2024
- 2024NETS: A Non-Equilibrium Transport Sampler3 Oct 2024
- 2024Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributions30 Sep 2024
- 2024Importance Corrected Neural JKO Sampling29 Jul 2024
- 2024Dynamical Measure Transport and Neural PDE Solvers for Sampling10 Jul 2024
- 2024Quasi-Bayes meets Vines18 Jun 2024
- 2024Beyond ELBOs: A Large-Scale Evaluation of Variational Methods for Sampling11 Jun 2024
- 2024Markovian Flow Matching: Accelerating MCMC with Continuous Normalizing Flows23 May 2024
- 2024Liouville Flow Importance Sampler3 May 2024
- 2024Practical applications of machine-learned flows on gauge fields17 Apr 2024
- 2024Fast and Unified Path Gradient Estimators for Normalizing Flows23 Mar 2024
- 2024Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inference15 Mar 2024
- 2024Stable Training of Normalizing Flows for High-dimensional Variational Inference26 Feb 2024
50 newest of 66 All 66 (JSON)
- 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matchingcited by 78
- 2024Particle Denoising Diffusion Samplercited by 63
- 2025Adjoint Schr"odinger Bridge Samplercited by 20
- 2025From discrete-time policies to continuous-time diffusion samplers: Asymptotic equivalences and faster trainingcited by 17
- 2024Markovian Flow Matching: Accelerating MCMC with Continuous Normalizing Flowscited by 9
- 2024Learned Reference-based Diffusion Sampling for multi-modal distributionscited by 9
- 2025Non-equilibrium Annealed Adjoint Samplercited by 8
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Samplercited by 4
- 2026Flow Sampling: Learning to Sample from Unnormalized Densities via Denoising Conditional Processescited by 4
- 2025Continuously Tempered Diffusion Samplerscited by 1
- 2025One-Step Diffusion Samplers via Self-Distillation and Deterministic Flowcited by 1
- 2025Value Gradient Sampler: Learning Invariant Value Functions for Equivariant Diffusion Samplingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Tensor Train Diffusion: Leveraging Low-Rank Structures for High-Dimensional Score-Based Sampling7 Jul 2026
- 2026Flow Sampling: Learning to Sample from Unnormalized Densities via Denoising Conditional Processes5 May 2026
- 2025One-Step Diffusion Samplers via Self-Distillation and Deterministic Flow4 Dec 2025
- 2025Continuously Tempered Diffusion Samplers30 Aug 2025
- 2025Adjoint Schr"odinger Bridge Sampler27 Jun 2025
- 2025Non-equilibrium Annealed Adjoint Sampler22 Jun 2025
- 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching16 Apr 2025
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Sampler1 Mar 2025
- 2025Value Gradient Sampler: Learning Invariant Value Functions for Equivariant Diffusion Sampling18 Feb 2025
- 2025From discrete-time policies to continuous-time diffusion samplers: Asymptotic equivalences and faster training10 Jan 2025
- 2024Learned Reference-based Diffusion Sampling for multi-modal distributions25 Oct 2024
- 2024Markovian Flow Matching: Accelerating MCMC with Continuous Normalizing Flows23 May 2024
12 newest of 13 All 13 (JSON)
- 2022Flow Annealed Importance Sampling Bootstrapcited by 124
- 2024Iterated Denoising Energy Matching for Sampling from Boltzmann Densitiescited by 113
- 2024NETS: A Non-Equilibrium Transport Samplercited by 67
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2024Beyond ELBOs: A Large-Scale Evaluation of Variational Methods for Samplingcited by 55
- 2022Score-Based Diffusion meets Annealed Importance Samplingcited by 51
- 2024Sequential Controlled Langevin Diffusionscited by 47
- 2025Scalable Equilibrium Sampling with Sequential Boltzmann Generatorscited by 36
- 2025LEAPS: A discrete neural sampler via locally equivariant networkscited by 30
- 2025Underdamped Diffusion Bridges with Applications to Samplingcited by 28
- 2022Aspects of scaling and scalability for flow-based sampling of lattice QCDcited by 26
- 2024Liouville Flow Importance Samplercited by 25
12 most cited of 53 All 53 (JSON)
- 2026Wasserstein Gradient Flows and Forward-Only Diffusion Are Not Enough for Multimodal Sampling1 Oct 2026
- 2026Iterative Exact Discrete Guidance for Energy-Based Sampling29 Sep 2026
- 2026Neural Transport Nested Sampling24 Sep 2026
- 2026Mode Coverage in Normalizing Flow Boltzmann Generators via Log-Ratio Variation8 Sep 2026
- 2026FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions1 Sep 2026
- 2026Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling17 Jul 2026
- 2026Jeffreys Flow: Robust Boltzmann Generators for Rare Event Sampling via Parallel Tempering Distillation7 Apr 2026
- 2025Particle Monte Carlo methods for Lattice Field Theory19 Nov 2025
- 2025Reducing normalizing flow complexity for MCMC preconditioning4 Nov 2025
- 2025Scaling flow-based approaches for topology sampling in SU(3) gauge theory29 Oct 2025
- 2025Learning Boltzmann Generators via Constrained Mass Transport21 Oct 2025
- 2025Proximal Diffusion Neural Sampler4 Oct 2025
12 newest of 53 All 53 (JSON)