Expressivity of Bi-Lipschitz Normalizing Flows: A Score-Based Diffusion Perspective
Not on the map. Why?
Abstract (arXiv)
Many normalizing flow architectures impose regularity constraints, yet their distributional approximation properties are not fully characterized. We study the expressivity of bi-Lipschitz normalizing flows through the lens of score-based diffusion models. For the probability flow ODE of a variance-preserving diffusion, Lipschitz regularity of the score induces a flow of bi-Lipschitz diffeomorphic transport maps. This ODE bridge allows us to analyze the distributional approximation power of bi-Lipschitz normalizing flows and, conversely, derive deterministic convergence guarantees for diffusion-based transport. Our key idea is to use the probability flow ODE to link regularity of the score to regularity of the induced transport maps. We verify score regularity for broad target densities, including compactly supported densities, Gaussian convolutions of compactly supported measures and finite Gaussian mixtures. We obtain a universal distributional approximation result: Gaussian pullbacks induced by bi-Lipschitz variance-preserving transport maps are L1-dense among all probability densities. For Gaussian convolution targets, we further obtain convergence in Kullback-Leibler divergence without early stopping.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 48 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
32 of 48 references.
References · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2018Invertible Residual Networkscited by 365
20 more
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localizationcited by 235
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptionscited by 219
- 2022Convergence of score-based generative modeling for general data distributionscited by 181
- 2023The probability flow ODE is provably fastcited by 146
- 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
- 2019Noise Flow: Noise Modeling with Conditional Normalizing Flowscited by 108
- 2020Coupling-based Invertible Neural Networks Are Universal Diffeomorphism Approximatorscited by 85
- 2023KL Convergence Guarantees for Score diffusion models under minimal data assumptionscited by 63
- 2019Approximation Capabilities of Neural ODEs and Invertible Residual Networkscited by 56
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distancescited by 56
- 2020The Expressive Power of a Class of Normalizing Flow Modelscited by 35
- 2022Universal approximation property of invertible neural networkscited by 30
- 2023Improved Convergence of Score-Based Diffusion Models via Prediction-Correctioncited by 24
- 2025Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Accelerationcited by 17
- 2021On the expressivity of bi-Lipschitz normalizing flowscited by 16
- 2025Diffusion models for inverse problemscited by 16
- 2021Universal Approximation of Residual Flows in Maximum Mean Discrepancycited by 7
- 2024Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz Estimatescited by 6
- 2023On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networkscited by 2
- 2025Learned Discrepancy Reconstruction and Benchmark Dataset for Magnetic Particle Imagingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalities
- 2025Distribution estimation via Flow Matching with Lipschitz guarantees
- 2022Building Normalizing Flows with Stochastic Interpolants
- 2026A Quantitative Approximation Framework for Flow Distillation in Diffusion Models
- 2024Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective
- 2026A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models
- 2025Lipschitz-Guided Design of Interpolation Schedules in Generative Models
- 2026Score Approximation for Diffusion Models on Arbitrary Low-Dimensional Structures