# A divergence-based condition to ensure quantile improvement in black-box global optimization

arXiv: https://arxiv.org/abs/2402.01277 · HTML: https://mlsanity.com/paper/2402.01277/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Feb 2024.

## Built on by (most cited first, 1 of 1)

- [Beyond IGO-Flow: Toward Convergence Analysis of IGO in Continuous Spaces](https://mlsanity.com/paper/2606.17523/) (2026)

## Abstract (arXiv)

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative fashion, so that their mass concentrate where the objective function is low. Despite empirical success, the theoretical study of these methods remains difficult. In this work, we introduce a new framework, based on divergence-decrease conditions, to study and design black-box global optimization algorithms. Our approach allows to establish and quantify the improvement of proposals at each iteration, in terms of expected value or quantile of the objective. We show that the information-geometric optimization approach fits within our framework, yielding a new approach for its analysis. We also establish proposal improvement results for two novel algorithms, one related with the cross-entropy approach with mixture models, and another one using heavy-tailed sampling proposal distributions.
