# On minimax density estimation via measure transport

arXiv: https://arxiv.org/abs/2207.10231 · HTML: https://mlsanity.com/paper/2207.10231/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 60 references that are in the map.
- First posted on arXiv 20 Jul 2022.

## Builds on (most cited first, 22 of 22)

- [Neural Ordinary Differential Equations](https://mlsanity.com/paper/1806.07366/) (2018)
- [Variational Inference with Normalizing Flows](https://mlsanity.com/paper/1505.05770/) (2015)
- [Density estimation using Real NVP](https://mlsanity.com/paper/1605.08803/) (2016)
- [Glow: Generative Flow with Invertible 1x1 Convolutions](https://mlsanity.com/paper/1807.03039/) (2018)
- [Normalizing Flows for Probabilistic Modeling and Inference](https://mlsanity.com/paper/1912.02762/) (2019)
- [Masked Autoregressive Flow for Density Estimation](https://mlsanity.com/paper/1705.07057/) (2017)
- [Neural Spline Flows](https://mlsanity.com/paper/1906.04032/) (2019)
- [FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models](https://mlsanity.com/paper/1810.01367/) (2018)
- [Stable Architectures for Deep Neural Networks](https://mlsanity.com/paper/1705.03341/) (2017)
- [CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flows](https://mlsanity.com/paper/2107.12571/) (2021)
- [How to train your neural ODE: the world of Jacobian and kinetic regularization](https://mlsanity.com/paper/2002.02798/) (2020)
- [Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows](https://mlsanity.com/paper/1805.07226/) (2018)
- [Automatic Posterior Transformation for Likelihood-Free Inference](https://mlsanity.com/paper/1905.07488/) (2019)
- [Plugin Estimation of Smooth Optimal Transport Maps](https://mlsanity.com/paper/2107.12364/) (2021)
- [Block Neural Autoregressive Flow](https://mlsanity.com/paper/1904.04676/) (2019)
- [Sum-of-Squares Polynomial Flow](https://mlsanity.com/paper/1905.02325/) (2019)
- [Likelihood-free inference with emulator networks](https://mlsanity.com/paper/1805.09294/) (2018)
- [Coupling techniques for nonlinear ensemble filtering](https://mlsanity.com/paper/1907.00389/) (2019)
- [Inference via low-dimensional couplings](https://mlsanity.com/paper/1703.06131/) (2017)
- [On the representation and learning of monotone triangular transport maps](https://mlsanity.com/paper/2009.10303/) (2020)
- [Triangular Flows for Generative Modeling: Statistical Consistency, Smoothness Classes, and Fast Rates](https://mlsanity.com/paper/2112.15595/) (2021)
- [Bayesian model calibration for block copolymer self-assembly: Likelihood-free inference and expected information gain computation via measure transport](https://mlsanity.com/paper/2206.11343/) (2022)

## Built on by (most cited first, 18 of 18)

- [Conditional Optimal Transport on Function Spaces](https://mlsanity.com/paper/2311.05672/) (2023)
- [Distribution learning via neural differential equations: a nonparametric statistical perspective](https://mlsanity.com/paper/2309.01043/) (2023)
- [Conditional simulation via entropic optimal transport: Toward non-parametric estimation of conditional Brenier maps](https://mlsanity.com/paper/2411.07154/) (2024)
- [Bounded KRnet and its applications to density estimation and approximation](https://mlsanity.com/paper/2305.09063/) (2023)
- [MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation](https://mlsanity.com/paper/2306.04120/) (2023)
- [Diffeomorphic Measure Matching with Kernels for Generative Modeling](https://mlsanity.com/paper/2402.08077/) (2024)
- [Expected information gain estimation via density approximations: Sample allocation and dimension reduction](https://mlsanity.com/paper/2411.08390/) (2024)
- [A friendly introduction to triangular transport](https://mlsanity.com/paper/2503.21673/) (2025)
- [Numerical and statistical analysis of NeuralODE with Runge-Kutta time integration](https://mlsanity.com/paper/2503.10729/) (2025)
- [Self-reinforced polynomial approximation methods for concentrated probability densities](https://mlsanity.com/paper/2303.02554/) (2023)
- [ISR: Invertible Symbolic Regression](https://mlsanity.com/paper/2405.06848/) (2024)
- [Error Analysis of Bayesian Inverse Problems with Generative Priors](https://mlsanity.com/paper/2601.17374/) (2026)
- [Convergence Rates for Distribution Matching with Sliced Optimal Transport](https://mlsanity.com/paper/2602.10691/) (2026)
- [Deep importance sampling using tensor trains with application to a priori and a posteriori rare event estimation](https://mlsanity.com/paper/2209.01941/) (2022)
- [Revisiting Le Cam's Equation: Exact Minimax Rates over Convex Density Classes](https://mlsanity.com/paper/2210.11436/) (2022)
- [Regularity of Solutions to Beckmann's Parametric Optimal Transport](https://mlsanity.com/paper/2603.19755/) (2026)
- [Learning the Structure of Triangular Transport Maps](https://mlsanity.com/paper/2609.37122/) (2026)
- [Multifidelity Formulations for Triangular Transport](https://mlsanity.com/paper/2610.00698/) (2026)

## Abstract (arXiv)

We study the convergence properties, in Hellinger and related distances, of nonparametric density estimators based on measure transport. These estimators represent the measure of interest as the pushforward of a chosen reference distribution under a transport map, where the map is chosen via a maximum likelihood objective (equivalently, minimizing an empirical Kullback-Leibler loss) or a penalized version thereof. We establish concentration inequalities for a general class of penalized measure transport estimators, by combining techniques from M-estimation with analytical properties of the transport-based density representation. We then demonstrate the implications of our theory for the case of triangular Knothe-Rosenblatt (KR) transports on the d-dimensional unit cube, and show that both penalized and unpenalized versions of such estimators achieve minimax optimal convergence rates over H"older classes of densities. Specifically, we establish optimal rates for unpenalized nonparametric maximum likelihood estimation over bounded H"older-type balls, and then for certain Sobolev-penalized estimators and sieved wavelet estimators.
