On minimax density estimation via measure transport
Not on the map. Why?
Abstract (arXiv)
We study the convergence properties, in Hellinger and related distances, of nonparametric density estimators based on measure transport. These estimators represent the measure of interest as the pushforward of a chosen reference distribution under a transport map, where the map is chosen via a maximum likelihood objective (equivalently, minimizing an empirical Kullback-Leibler loss) or a penalized version thereof. We establish concentration inequalities for a general class of penalized measure transport estimators, by combining techniques from M-estimation with analytical properties of the transport-based density representation. We then demonstrate the implications of our theory for the case of triangular Knothe-Rosenblatt (KR) transports on the d-dimensional unit cube, and show that both penalized and unpenalized versions of such estimators achieve minimax optimal convergence rates over H"older classes of densities. Specifically, we establish optimal rates for unpenalized nonparametric maximum likelihood estimation over bounded H"older-type balls, and then for certain Sobolev-penalized estimators and sieved wavelet estimators.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 22 of its 60 references that are in the map. First posted on arXiv 20 Jul 2022.
Builds on
22 of 60 references.
References · 22
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2019Neural Spline Flowscited by 590
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
- 2017Stable Architectures for Deep Neural Networkscited by 340
- 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 320
- 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
- 2018Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flowscited by 217
10 more
- 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 216
- 2021Plugin Estimation of Smooth Optimal Transport Mapscited by 67
- 2019Block Neural Autoregressive Flowcited by 62
- 2019Sum-of-Squares Polynomial Flowcited by 62
- 2018Likelihood-free inference with emulator networkscited by 61
- 2019Coupling techniques for nonlinear ensemble filteringcited by 48
- 2017Inference via low-dimensional couplingscited by 43
- 2020On the representation and learning of monotone triangular transport mapscited by 41
- 2021Triangular Flows for Generative Modeling: Statistical Consistency, Smoothness Classes, and Fast Ratescited by 16
- 2022Bayesian model calibration for block copolymer self-assembly: Likelihood-free inference and expected information gain computation via measure transportcited by 11
Built on by
Citing papers per year: 2022: 2; 2023: 5; 2024: 4; 2025: 2; 2026: 5.
18 papers.
Sort:
- 2023Conditional Optimal Transport on Function Spacescited by 26
- 2023Distribution learning via neural differential equations: a nonparametric statistical perspectivecited by 22
- 2024Conditional simulation via entropic optimal transport: Toward non-parametric estimation of conditional Brenier mapscited by 9
- 2023Bounded KRnet and its applications to density estimation and approximationcited by 7
- 2023MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimationcited by 5
- 2024Diffeomorphic Measure Matching with Kernels for Generative Modelingcited by 4
- 2024Expected information gain estimation via density approximations: Sample allocation and dimension reductioncited by 4
- 2025A friendly introduction to triangular transportcited by 4
- 2025Numerical and statistical analysis of NeuralODE with Runge-Kutta time integrationcited by 3
- 2023Self-reinforced polynomial approximation methods for concentrated probability densitiescited by 2
- 2024ISR: Invertible Symbolic Regressioncited by 2
- 2026Error Analysis of Bayesian Inverse Problems with Generative Priorscited by 2
6 more
- 2026Convergence Rates for Distribution Matching with Sliced Optimal Transportcited by 2
- 2022Deep importance sampling using tensor trains with application to a priori and a posteriori rare event estimationcited by 1
- 2022Revisiting Le Cam's Equation: Exact Minimax Rates over Convex Density Classescited by 1
- 2026Regularity of Solutions to Beckmann's Parametric Optimal Transportcited by 0
- 2026Learning the Structure of Triangular Transport Mapscited by 0
- 2026Multifidelity Formulations for Triangular Transportcited by 0
- 2026Multifidelity Formulations for Triangular Transport30 Sep 2026
- 2026Learning the Structure of Triangular Transport Maps29 Sep 2026
- 2026Regularity of Solutions to Beckmann's Parametric Optimal Transport20 Mar 2026
- 2026Convergence Rates for Distribution Matching with Sliced Optimal Transport11 Feb 2026
- 2026Error Analysis of Bayesian Inverse Problems with Generative Priors24 Jan 2026
- 2025A friendly introduction to triangular transport27 Mar 2025
- 2025Numerical and statistical analysis of NeuralODE with Runge-Kutta time integration13 Mar 2025
- 2024Expected information gain estimation via density approximations: Sample allocation and dimension reduction13 Nov 2024
- 2024Conditional simulation via entropic optimal transport: Toward non-parametric estimation of conditional Brenier maps11 Nov 2024
- 2024ISR: Invertible Symbolic Regression10 May 2024
- 2024Diffeomorphic Measure Matching with Kernels for Generative Modeling12 Feb 2024
- 2023Conditional Optimal Transport on Function Spaces9 Nov 2023
6 more
- 2023Distribution learning via neural differential equations: a nonparametric statistical perspective3 Sep 2023
- 2023MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation7 Jun 2023
- 2023Bounded KRnet and its applications to density estimation and approximation15 May 2023
- 2023Self-reinforced polynomial approximation methods for concentrated probability densities5 Mar 2023
- 2022Revisiting Le Cam's Equation: Exact Minimax Rates over Convex Density Classes20 Oct 2022
- 2022Deep importance sampling using tensor trains with application to a priori and a posteriori rare event estimation5 Sep 2022
- 2023Conditional Optimal Transport on Function Spacescited by 26
- 2023Distribution learning via neural differential equations: a nonparametric statistical perspectivecited by 22
- 2024Conditional simulation via entropic optimal transport: Toward non-parametric estimation of conditional Brenier mapscited by 9
- 2023Bounded KRnet and its applications to density estimation and approximationcited by 7
- 2023MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimationcited by 5
- 2024Diffeomorphic Measure Matching with Kernels for Generative Modelingcited by 4
- 2024Expected information gain estimation via density approximations: Sample allocation and dimension reductioncited by 4
- 2025A friendly introduction to triangular transportcited by 4
- 2025Numerical and statistical analysis of NeuralODE with Runge-Kutta time integrationcited by 3
- 2023Self-reinforced polynomial approximation methods for concentrated probability densitiescited by 2
- 2024ISR: Invertible Symbolic Regressioncited by 2
- 2026Error Analysis of Bayesian Inverse Problems with Generative Priorscited by 2
12 most cited of 18 All 18 (JSON)
- 2026Multifidelity Formulations for Triangular Transport30 Sep 2026
- 2026Learning the Structure of Triangular Transport Maps29 Sep 2026
- 2026Regularity of Solutions to Beckmann's Parametric Optimal Transport20 Mar 2026
- 2026Convergence Rates for Distribution Matching with Sliced Optimal Transport11 Feb 2026
- 2026Error Analysis of Bayesian Inverse Problems with Generative Priors24 Jan 2026
- 2025A friendly introduction to triangular transport27 Mar 2025
- 2025Numerical and statistical analysis of NeuralODE with Runge-Kutta time integration13 Mar 2025
- 2024Expected information gain estimation via density approximations: Sample allocation and dimension reduction13 Nov 2024
- 2024Conditional simulation via entropic optimal transport: Toward non-parametric estimation of conditional Brenier maps11 Nov 2024
- 2024ISR: Invertible Symbolic Regression10 May 2024
- 2024Diffeomorphic Measure Matching with Kernels for Generative Modeling12 Feb 2024
- 2023Conditional Optimal Transport on Function Spaces9 Nov 2023
12 newest of 18 All 18 (JSON)