# High-Dimensional Density Ratio Estimation with Extensions to Approximate Likelihood Computation

arXiv: https://arxiv.org/abs/1404.7063 · HTML: https://mlsanity.com/paper/1404.7063/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 28 Apr 2014.

## Built on by (most cited first, 19 of 19)

- [Benchmarking Simulation-Based Inference](https://mlsanity.com/paper/2101.04653/) (2021)
- [Flow Matching for Scalable Simulation-Based Inference](https://mlsanity.com/paper/2305.17161/) (2023)
- [Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models](https://mlsanity.com/paper/2210.04872/) (2022)
- [Density Ratio Estimation with Conditional Probability Paths](https://mlsanity.com/paper/2502.02300/) (2025)
- [Likelihood-Free Frequentist Inference: Bridging Classical Statistics and Machine Learning for Reliable Simulator-Based Inference](https://mlsanity.com/paper/2107.03920/) (2021)
- [Unifying Likelihood-free Inference with Black-box Optimization and Beyond](https://mlsanity.com/paper/2110.03372/) (2021)
- [Neural Posterior Estimation with Differentiable Simulators](https://mlsanity.com/paper/2207.05636/) (2022)
- [Contrastive Neural Ratio Estimation for Simulation-based Inference](https://mlsanity.com/paper/2210.06170/) (2022)
- [CP4SBI: Local Conformal Calibration of Credible Sets in Simulation-Based Inference](https://mlsanity.com/paper/2508.17077/) (2025)
- [Conformal Calibration of Statistical Confidence Sets](https://mlsanity.com/paper/2411.19368/) (2024)
- [Kernel-Based Tests for Likelihood-Free Hypothesis Testing](https://mlsanity.com/paper/2308.09043/) (2023)
- [Stratified Learning: A General-Purpose Statistical Method for Improved Learning under Covariate Shift](https://mlsanity.com/paper/2106.11211/) (2021)
- [Flexible conditional density estimation for time series](https://mlsanity.com/paper/2301.09671/) (2023)
- [A density ratio framework for evaluating the utility of synthetic data](https://mlsanity.com/paper/2408.13167/) (2024)
- [A Semiparametric Approach to Causal Inference](https://mlsanity.com/paper/2411.00950/) (2024)
- [Misspecification-robust amortised simulation-based inference using variational methods](https://mlsanity.com/paper/2509.05724/) (2025)
- [Learning density ratios in causal inference using Bregman-Riesz regression](https://mlsanity.com/paper/2510.16127/) (2025)
- [A Three-Way Testing Framework for Quantifying Epistemic Calibration Uncertainty in SBI](https://mlsanity.com/paper/2609.24419/) (2026)
- [Learning Conditional Expectation Operators via Functional Newton Updates](https://mlsanity.com/paper/2609.35598/) (2026)

## Abstract (arXiv)

The ratio between two probability density functions is an important component of various tasks, including selection bias correction, novelty detection and classification. Recently, several estimators of this ratio have been proposed. Most of these methods fail if the sample space is high-dimensional, and hence require a dimension reduction step, the result of which can be a significant loss of information. Here we propose a simple-to-implement, fully nonparametric density ratio estimator that expands the ratio in terms of the eigenfunctions of a kernel-based operator; these functions reflect the underlying geometry of the data (e.g., submanifold structure), often leading to better estimates without an explicit dimension reduction step. We show how our general framework can be extended to address another important problem, the estimation of a likelihood function in situations where that function cannot be well-approximated by an analytical form. One is often faced with this situation when performing statistical inference with data from the sciences, due the complexity of the data and of the processes that generated those data. We emphasize applications where using existing likelihood-free methods of inference would be challenging due to the high dimensionality of the sample space, but where our spectral series method yields a reasonable estimate of the likelihood function. We provide theoretical guarantees and illustrate the effectiveness of our proposed method with numerical experiments.