mlsanityData to 7 Oct 2026

Minimax Analysis for Inverse Risk in Nonparametric Planer Invertible Regression

arXiv 2112.00213 ↗First posted 1 Dec 2021math.ST stat.ML stat.THcited by 1

Not on the map. Why?

Abstract (arXiv)

We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics, econometrics, and machine learning. Although the consistency and universality of invertible estimators have been well investigated, analysis of the efficiency of these methods is still under development. In this study, we study a minimax risk for estimating invertible bi-Lipschitz functions on a square in a 2-dimensional plane. We first introduce two types of L2-risks to evaluate an estimator which preserves invertibility. Then, we derive lower and upper rates for minimax values for the risks associated with inverse functions. For the derivation, we exploit a representation of invertible functions using level-sets. Specifically, to obtain the upper rate, we develop an estimator asymptotically almost everywhere invertible, whose risk attains the derived minimax lower rate up to logarithmic factors. The derived minimax rate corresponds to that of the non-invertible bi-Lipschitz function, which shows that the invertibility does not reduce the complexity of the estimation problem in terms of the rate. % the minimax rate, similar to other shape constraints.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 38 references that are in the map. First posted on arXiv 1 Dec 2021.

Builds on

14 of 38 references.

References · 14

  1. 2015Variational Inference with Normalizing Flowscited by 2,161
  2. 2016Density estimation using Real NVPcited by 2,029
  3. 2014NICE: Non-linear Independent Components Estimationcited by 1,052
  4. 2017Masked Autoregressive Flow for Density Estimationcited by 680
  5. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
  6. 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
  7. 2019Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Designcited by 258
  8. 2018Neural Autoregressive Flowscited by 207
  9. 2020Normalizing Flows on Tori and Spherescited by 117
  10. 2020Coupling-based Invertible Neural Networks Are Universal Diffeomorphism Approximatorscited by 85
  11. 2019Block Neural Autoregressive Flowcited by 62
  12. 2019Sum-of-Squares Polynomial Flowcited by 62
2 more
  1. 2020The Expressive Power of a Class of Normalizing Flow Modelscited by 35
  2. 2017Frequentist coverage and sup-norm convergence rate in Gaussian process regressioncited by 15

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.