# Nonparametric Conditional Density Estimation in a High-Dimensional Regression Setting

arXiv: https://arxiv.org/abs/1604.00540 · HTML: https://mlsanity.com/paper/1604.00540/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Apr 2016.

## Built on by (most cited first, 20 of 20)

- [Conformal Prediction using Conditional Histograms](https://mlsanity.com/paper/2105.08747/) (2021)
- [Wasserstein Generative Learning of Conditional Distribution](https://mlsanity.com/paper/2112.10039/) (2021)
- [Quantifying Epistemic Uncertainty in Deep Learning](https://mlsanity.com/paper/2110.12122/) (2021)
- [Towards Instance-Wise Calibration: Local Amortized Diagnostics and Reshaping of Conditional Densities (LADaR)](https://mlsanity.com/paper/2205.14568/) (2022)
- [Efficient Uncertainty Quantification and Reduction for Over-Parameterized Neural Networks](https://mlsanity.com/paper/2306.05674/) (2023)
- [Doubly Robust Conditional Independence Testing with Generative Neural Networks](https://mlsanity.com/paper/2407.17694/) (2024)
- [ScoringBench: A Benchmark for Evaluating Tabular Foundation Models with Proper Scoring Rules](https://mlsanity.com/paper/2603.29928/) (2026)
- [A Likelihood Based Approach to Distribution Regression Using Conditional Deep Generative Models](https://mlsanity.com/paper/2410.02025/) (2024)
- [Schr"odinger bridge based deep conditional generative learning](https://mlsanity.com/paper/2409.17294/) (2024)
- [Distributional Regression with Tabular Foundation Models: Evaluating Probabilistic Predictions via Proper Scoring Rules](https://mlsanity.com/paper/2603.08206/) (2026)
- [Transforming Conditional Density Estimation Into a Single Nonparametric Regression Task](https://mlsanity.com/paper/2511.18530/) (2025)
- [A Bayesian Semiparametric Method For Estimating Causal Quantile Effects](https://mlsanity.com/paper/2211.01591/) (2022)
- [Flexible conditional density estimation for time series](https://mlsanity.com/paper/2301.09671/) (2023)
- [Kernel Density Bayesian Inverse Reinforcement Learning](https://mlsanity.com/paper/2303.06827/) (2023)
- [Expertise-based Weighting for Regression Models with Noisy Labels](https://mlsanity.com/paper/2305.07430/) (2023)
- [High-Dimensional Tail Index Regression](https://mlsanity.com/paper/2403.01318/) (2024)
- [Mantis Shrimp: Exploring Photometric Band Utilization in Computer Vision Networks for Photometric Redshift Estimation](https://mlsanity.com/paper/2501.09112/) (2025)
- [One-shot Conditional Sampling: MMD meets Nearest Neighbors](https://mlsanity.com/paper/2509.25507/) (2025)
- [LOCUS: A Distribution-Free Loss-Quantile Score for Risk-Aware Predictions](https://mlsanity.com/paper/2603.01971/) (2026)
- [Generative Predictive Distributions for Time Series](https://mlsanity.com/paper/2606.16773/) (2026)

## Abstract (arXiv)

In some applications (e.g., in cosmology and economics), the regression E[Z|x] is not adequate to represent the association between a predictor x and a response Z because of multi-modality and asymmetry of f(z|x); using the full density instead of a single-point estimate can then lead to less bias in subsequent analysis. As of now, there are no effective ways of estimating f(z|x) when x represents high-dimensional, complex data. In this paper, we propose a new nonparametric estimator of f(z|x) that adapts to sparse (low-dimensional) structure in x. By directly expanding f(z|x) in the eigenfunctions of a kernel-based operator, we avoid tensor products in high dimensions as well as ratios of estimated densities. Our basis functions are orthogonal with respect to the underlying data distribution, allowing fast implementation and tuning of parameters. We derive rates of convergence and show that the method adapts to the intrinsic dimension of the data. We also demonstrate the effectiveness of the series method on images, spectra, and an application to photometric redshift estimation of galaxies.