Path-Gradient Estimators for Continuous Normalizing Flows
Not on the map. Why?
Abstract (arXiv)
Recent work has established a path-gradient estimator for simple variational Gaussian distributions and has argued that the path-gradient is particularly beneficial in the regime in which the variational distribution approaches the exact target distribution. In many applications, this regime can however not be reached by a simple Gaussian variational distribution. In this work, we overcome this crucial limitation by proposing a path-gradient estimator for the considerably more expressive variational family of continuous normalizing flows. We outline an efficient algorithm to calculate this estimator and establish its superior performance empirically.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 17 Jun 2022.
Builds on
21 of 30 references.
References · 21
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
- 2015Importance Weighted Autoencoderscited by 456
- 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 250
- 2018Neural Importance Samplingcited by 155
- 2020Equivariant flow-based sampling for lattice gauge theorycited by 103
- 2018Solving Statistical Mechanics Using Variational Autoregressive Networkscited by 100
- 2017Sticking the Landing: Simple, Lower-Variance Gradient Estimators for Variational Inferencecited by 98
- 2018Sylvester Normalizing Flows for Variational Inferencecited by 72
- 2014Reweighted Wake-Sleepcited by 66
9 more
- 2018Doubly Reparameterized Gradient Estimators for Monte Carlo Objectivescited by 41
- 2020Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and Optimizationcited by 37
- 2021Introduction to Normalizing Flows for Lattice Field Theorycited by 35
- 2021Scaling Up Machine Learning For Quantum Field Theory with Equivariant Continuous Flowscited by 24
- 2020On the Difficulty of Unbiased Alpha Divergence Minimizationcited by 21
- 2021Generalized Doubly Reparameterized Gradient Estimatorscited by 14
- 2021Empirical Evaluation of Biased Methods for Alpha Divergence Minimizationcited by 10
- 2021Machine Learning Trivializing Maps: A First Step Towards Understanding How Flow-Based Samplers Scale Upcited by 5
- 2021Machine Learning and Variational Algorithms for Lattice Field Theorycited by 3
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 2; 2026: 1.
11 papers.
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationcited by 57
- 2022Learning Lattice Quantum Field Theories with Equivariant Continuous Flowscited by 37
- 2022Gradients should stay on Path: Better Estimators of the Reverse- and Forward KL Divergence for Normalizing Flowscited by 23
- 2023Advances in machine-learning-based sampling motivated by lattice quantum chromodynamicscited by 23
- 2023Sampling the lattice Nambu-Goto string using Continuous Normalizing Flowscited by 12
- 2023Bridging the Gap Between Variational Inference and Wasserstein Gradient Flowscited by 8
- 2024Fast and Unified Path Gradient Estimators for Normalizing Flowscited by 5
- 2025Path Gradients after Flow Matchingcited by 3
- 2025SESaMo: Symmetry-Enforcing Stochastic Modulation for Normalizing Flowscited by 2
- 2024Multi-Lattice Sampling of Quantum Field Theories via Neural Operator-based Flowscited by 1
- 2026Scaling Online Optimal Transport Minibatches for Flow Matchingcited by 0
- 2026Scaling Online Optimal Transport Minibatches for Flow Matching13 Oct 2026
- 2025SESaMo: Symmetry-Enforcing Stochastic Modulation for Normalizing Flows26 May 2025
- 2025Path Gradients after Flow Matching15 May 2025
- 2024Fast and Unified Path Gradient Estimators for Normalizing Flows23 Mar 2024
- 2024Multi-Lattice Sampling of Quantum Field Theories via Neural Operator-based Flows1 Jan 2024
- 2023Bridging the Gap Between Variational Inference and Wasserstein Gradient Flows31 Oct 2023
- 2023Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimization4 Oct 2023
- 2023Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics3 Sep 2023
- 2023Sampling the lattice Nambu-Goto string using Continuous Normalizing Flows3 Jul 2023
- 2022Gradients should stay on Path: Better Estimators of the Reverse- and Forward KL Divergence for Normalizing Flows17 Jul 2022
- 2022Learning Lattice Quantum Field Theories with Equivariant Continuous Flows1 Jul 2022