# The Kernel Mixture Network: A Nonparametric Method for Conditional Density Estimation of Continuous Random Variables

arXiv: https://arxiv.org/abs/1705.07111 · HTML: https://mlsanity.com/paper/1705.07111/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 May 2017.

## Built on by (most cited first, 15 of 15)

- [VCNet and Functional Targeted Regularization For Learning Causal Effects of Continuous Treatments](https://mlsanity.com/paper/2103.07861/) (2021)
- [Probabilistic Conformal Prediction Using Conditional Random Samples](https://mlsanity.com/paper/2206.06584/) (2022)
- [Neural Conditional Probability for Uncertainty Quantification](https://mlsanity.com/paper/2407.01171/) (2024)
- [Towards Instance-Wise Calibration: Local Amortized Diagnostics and Reshaping of Conditional Densities (LADaR)](https://mlsanity.com/paper/2205.14568/) (2022)
- [A Causal Approach to Detecting Multivariate Time-series Anomalies and Root Causes](https://mlsanity.com/paper/2206.15033/) (2022)
- [Conditional Measurement Density Estimation in Sequential Monte Carlo via Normalizing Flow](https://mlsanity.com/paper/2203.08617/) (2022)
- [Doubly Robust Proximal Causal Learning for Continuous Treatments](https://mlsanity.com/paper/2309.12819/) (2023)
- [Deconvolutional Density Network: Modeling Free-Form Conditional Distributions](https://mlsanity.com/paper/2105.14367/) (2021)
- [Benchmarking Tabular Foundation Models for Conditional Density Estimation in Regression](https://mlsanity.com/paper/2603.26611/) (2026)
- [Ensemble weather forecast post-processing with a flexible probabilistic neural network approach](https://mlsanity.com/paper/2303.17610/) (2023)
- [MCD: Marginal Contrastive Discrimination for conditional density estimation](https://mlsanity.com/paper/2206.01592/) (2022)
- [CEC-MMR: Cross-Entropy Clustering Approach to Multi-Modal Regression](https://mlsanity.com/paper/2504.07301/) (2025)
- [Normalizing Flow to Augmented Posterior: Conditional Density Estimation with Interpretable Dimension Reduction for High Dimensional Data](https://mlsanity.com/paper/2507.04216/) (2025)
- [Accelerated Bayesian Optimal Experimental Design via Conditional Density Estimation and Informative Data](https://mlsanity.com/paper/2507.15235/) (2025)
- [Smoothing-Based Conformal Prediction for Balancing Efficiency and Interpretability](https://mlsanity.com/paper/2509.22529/) (2025)

## Abstract (arXiv)

This paper introduces the kernel mixture network, a new method for nonparametric estimation of conditional probability densities using neural networks. We model arbitrarily complex conditional densities as linear combinations of a family of kernel functions centered at a subset of training points. The weights are determined by the outer layer of a deep neural network, trained by minimizing the negative log likelihood. This generalizes the popular quantized softmax approach, which can be seen as a kernel mixture network with square and non-overlapping kernels. We test the performance of our method on two important applications, namely Bayesian filtering and generative modeling. In the Bayesian filtering example, we show that the method can be used to filter complex nonlinear and non-Gaussian signals defined on manifolds. The resulting kernel mixture network filter outperforms both the quantized softmax filter and the extended Kalman filter in terms of model likelihood. Finally, our experiments on generative models show that, given the same architecture, the kernel mixture network leads to higher test set likelihood, less overfitting and more diversified and realistic generated samples than the quantized softmax approach.