The Expressive Power of a Class of Normalizing Flow Models
Not on the map. Why?
Abstract (arXiv)
Normalizing flows have received a great deal of recent attention as they allow flexible generative modeling as well as easy likelihood computation. While a wide variety of flow models have been proposed, there is little formal understanding of the representation power of these models. In this work, we study some basic normalizing flows and rigorously establish bounds on their expressive power. Our results indicate that while these flows are highly expressive in one dimension, in higher dimensions their representation power may be limited, especially when the flows have moderate depth.
Key facts. Cited by 35 papers in the map (data through 13 Oct 2026). First posted on arXiv 31 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 7; 2023: 7; 2024: 3; 2025: 2; 2026: 3.
35 papers.
Sort:
By area:
- 2021Score-based Generative Modeling in Latent Spacecited by 635
- 2021Riemannian Convex Potential Mapscited by 17
- 2021Ab-initio study of interacting fermions at finite temperature with neural canonical transformationcited by 16
- 2021On the expressivity of bi-Lipschitz normalizing flowscited by 16
- 2021Triangular Flows for Generative Modeling: Statistical Consistency, Smoothness Classes, and Fast Ratescited by 16
- 2022Flow-based Recurrent Belief State Learning for POMDPscited by 16
- 2021Sparse Flows: Pruning Continuous-depth Modelscited by 13
- 2022Gradual Domain Adaptation via Normalizing Flowscited by 11
- 2024Universal Functional Regression with Neural Operator Flowscited by 9
- 2021Jacobian Determinant of Normalizing Flowscited by 8
- 2021Universal Approximation of Residual Flows in Maximum Mean Discrepancycited by 7
- 2025Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Modelscited by 7
23 more
- 2023Embracing the chaos: analysis and diagnosis of numerical instability in variational flowscited by 6
- 2021Unsupervised tree boosting for learning probability distributionscited by 5
- 2022Maximum Likelihood Learning of Unnormalized Models for Simulation-Based Inferencecited by 5
- 2021Approximation capabilities of measure-preserving neural networkscited by 4
- 2022AdaAnn: Adaptive Annealing Scheduler for Probability Density Approximationcited by 3
- 2023Simulation-based Inference with the Generalized Kullback-Leibler Divergencecited by 3
- 2023Energy-Calibrated VAE with Test Time Free Lunchcited by 3
- 2022Universality of parametric Coupling Flows over parametric diffeomorphismscited by 2
- 2022Learning to Bound: A Generative Cram'er-Rao Boundcited by 2
- 2023Learning to Generate All Feasible Actionscited by 2
- 2023Mixed Variational Flows for Discrete Variablescited by 2
- 2021Generalization of the Change of Variables Formula with Applications to Residual Flowscited by 1
- 2021Minimax Analysis for Inverse Risk in Nonparametric Planer Invertible Regressioncited by 1
- 2021ELF: Exact-Lipschitz Based Universal Density Approximator Flowcited by 1
- 2022Variational Monte Carlo Approach to Partial Differential Equations with Neural Networkscited by 1
- 2023Posterior Consistency for Missing Data in Variational Autoencoderscited by 1
- 2023On the Quantification of Image Reconstruction Uncertainty without Training Datacited by 1
- 2024Probabilistic Forecasting of Irregular Time Series via Conditional Flowscited by 1
- 2024Design of Restricted Normalizing Flow towards Arbitrary Stochastic Policy with Computational Efficiencycited by 1
- 2025Asymptotically exact variational flows via involutive MCMC kernelscited by 1
- 2026Robust Conditional Conformal Prediction via Branched Normalizing Flowcited by 0
- 2026Expressivity of Bi-Lipschitz Normalizing Flows: A Score-Based Diffusion Perspectivecited by 0
- 2026Deep Adaptive Dimension Reduction for Bayesian Inference in Inverse Problemscited by 0
- 2026Deep Adaptive Dimension Reduction for Bayesian Inference in Inverse Problems28 May 2026
- 2026Expressivity of Bi-Lipschitz Normalizing Flows: A Score-Based Diffusion Perspective7 May 2026
- 2026Robust Conditional Conformal Prediction via Branched Normalizing Flow3 May 2026
- 2025Asymptotically exact variational flows via involutive MCMC kernels2 Jun 2025
- 2025Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models23 May 2025
- 2024Design of Restricted Normalizing Flow towards Arbitrary Stochastic Policy with Computational Efficiency17 Dec 2024
- 2024Universal Functional Regression with Neural Operator Flows3 Apr 2024
- 2024Probabilistic Forecasting of Irregular Time Series via Conditional Flows9 Feb 2024
- 2023On the Quantification of Image Reconstruction Uncertainty without Training Data16 Nov 2023
- 2023Energy-Calibrated VAE with Test Time Free Lunch7 Nov 2023
- 2023Posterior Consistency for Missing Data in Variational Autoencoders25 Oct 2023
- 2023Simulation-based Inference with the Generalized Kullback-Leibler Divergence3 Oct 2023
23 more
- 2023Mixed Variational Flows for Discrete Variables29 Aug 2023
- 2023Embracing the chaos: analysis and diagnosis of numerical instability in variational flows12 Jul 2023
- 2023Learning to Generate All Feasible Actions26 Jan 2023
- 2022Maximum Likelihood Learning of Unnormalized Models for Simulation-Based Inference26 Oct 2022
- 2022Gradual Domain Adaptation via Normalizing Flows23 Jun 2022
- 2022Variational Monte Carlo Approach to Partial Differential Equations with Neural Networks4 Jun 2022
- 2022Flow-based Recurrent Belief State Learning for POMDPs23 May 2022
- 2022Learning to Bound: A Generative Cram'er-Rao Bound7 Mar 2022
- 2022Universality of parametric Coupling Flows over parametric diffeomorphisms7 Feb 2022
- 2022AdaAnn: Adaptive Annealing Scheduler for Probability Density Approximation1 Feb 2022
- 2021Triangular Flows for Generative Modeling: Statistical Consistency, Smoothness Classes, and Fast Rates31 Dec 2021
- 2021ELF: Exact-Lipschitz Based Universal Density Approximator Flow13 Dec 2021
- 2021Minimax Analysis for Inverse Risk in Nonparametric Planer Invertible Regression1 Dec 2021
- 2021On the expressivity of bi-Lipschitz normalizing flows15 Jul 2021
- 2021Generalization of the Change of Variables Formula with Applications to Residual Flows9 Jul 2021
- 2021Sparse Flows: Pruning Continuous-depth Models24 Jun 2021
- 2021Approximation capabilities of measure-preserving neural networks21 Jun 2021
- 2021Riemannian Convex Potential Maps18 Jun 2021
- 2021Score-based Generative Modeling in Latent Space10 Jun 2021
- 2021Ab-initio study of interacting fermions at finite temperature with neural canonical transformation18 May 2021
- 2021Universal Approximation of Residual Flows in Maximum Mean Discrepancy10 Mar 2021
- 2021Jacobian Determinant of Normalizing Flows12 Feb 2021
- 2021Unsupervised tree boosting for learning probability distributions26 Jan 2021
- 2021Score-based Generative Modeling in Latent Spacecited by 635
- 2021Score-based Generative Modeling in Latent Space10 Jun 2021
- 2021Riemannian Convex Potential Mapscited by 17
- 2021Ab-initio study of interacting fermions at finite temperature with neural canonical transformationcited by 16
- 2021On the expressivity of bi-Lipschitz normalizing flowscited by 16
- 2021Triangular Flows for Generative Modeling: Statistical Consistency, Smoothness Classes, and Fast Ratescited by 16
- 2022Flow-based Recurrent Belief State Learning for POMDPscited by 16
- 2021Sparse Flows: Pruning Continuous-depth Modelscited by 13
- 2022Gradual Domain Adaptation via Normalizing Flowscited by 11
- 2024Universal Functional Regression with Neural Operator Flowscited by 9
- 2021Jacobian Determinant of Normalizing Flowscited by 8
- 2021Universal Approximation of Residual Flows in Maximum Mean Discrepancycited by 7
- 2025Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Modelscited by 7
- 2023Embracing the chaos: analysis and diagnosis of numerical instability in variational flowscited by 6
12 most cited of 34 All 34 (JSON)
- 2026Deep Adaptive Dimension Reduction for Bayesian Inference in Inverse Problems28 May 2026
- 2026Expressivity of Bi-Lipschitz Normalizing Flows: A Score-Based Diffusion Perspective7 May 2026
- 2026Robust Conditional Conformal Prediction via Branched Normalizing Flow3 May 2026
- 2025Asymptotically exact variational flows via involutive MCMC kernels2 Jun 2025
- 2025Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models23 May 2025
- 2024Design of Restricted Normalizing Flow towards Arbitrary Stochastic Policy with Computational Efficiency17 Dec 2024
- 2024Universal Functional Regression with Neural Operator Flows3 Apr 2024
- 2024Probabilistic Forecasting of Irregular Time Series via Conditional Flows9 Feb 2024
- 2023On the Quantification of Image Reconstruction Uncertainty without Training Data16 Nov 2023
- 2023Energy-Calibrated VAE with Test Time Free Lunch7 Nov 2023
- 2023Posterior Consistency for Missing Data in Variational Autoencoders25 Oct 2023
- 2023Simulation-based Inference with the Generalized Kullback-Leibler Divergence3 Oct 2023
12 newest of 34 All 34 (JSON)