Minimax Analysis for Inverse Risk in Nonparametric Planer Invertible Regression
Not on the map. Why?
Abstract (arXiv)
We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics, econometrics, and machine learning. Although the consistency and universality of invertible estimators have been well investigated, analysis of the efficiency of these methods is still under development. In this study, we study a minimax risk for estimating invertible bi-Lipschitz functions on a square in a 2-dimensional plane. We first introduce two types of L2-risks to evaluate an estimator which preserves invertibility. Then, we derive lower and upper rates for minimax values for the risks associated with inverse functions. For the derivation, we exploit a representation of invertible functions using level-sets. Specifically, to obtain the upper rate, we develop an estimator asymptotically almost everywhere invertible, whose risk attains the derived minimax lower rate up to logarithmic factors. The derived minimax rate corresponds to that of the non-invertible bi-Lipschitz function, which shows that the invertibility does not reduce the complexity of the estimation problem in terms of the rate. % the minimax rate, similar to other shape constraints.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 38 references that are in the map. First posted on arXiv 1 Dec 2021.
Builds on
14 of 38 references.
References · 14
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
- 2019Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Designcited by 258
- 2018Neural Autoregressive Flowscited by 207
- 2020Normalizing Flows on Tori and Spherescited by 117
- 2020Coupling-based Invertible Neural Networks Are Universal Diffeomorphism Approximatorscited by 85
- 2019Block Neural Autoregressive Flowcited by 62
- 2019Sum-of-Squares Polynomial Flowcited by 62
2 more
Built on by
Citing papers per year: 2022: 1.
1 paper.