Probabilistic Smoothing with Ratio-Monotone Transforms for Global Optimization
Not on the map. Why?
Abstract (arXiv)
Probabilistic smoothing is a standard tool for global optimization, but existing methods rely on Gaussian kernels and specific transforms, often resulting in strong hyperparameter sensitivity and limited robustness. We propose a general smoothing framework that combines flexible symmetric unimodal kernels with monotonic ratio-based transformations. Under mild conditions, we show that the smoothed objective preserves the global maximizer and that all stationary points concentrate near the true optimum for sufficiently large amplification, without requiring a decreasing smoothing schedule. We further provide explicit complexity bounds for stochastic gradient ascent and show that a leave-one-out baseline provably reduces variance. Experiments on high-dimensional benchmarks and black-box adversarial attacks demonstrate improved robustness and competitive performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
9 of 17 references.
References · 9
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2013Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programmingcited by 716
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2019ZO-AdaMM: Zeroth-Order Adaptive Momentum Method for Black-Box Optimizationcited by 75
- 2015On Graduated Optimization for Stochastic Non-Convex Problemscited by 34
- 2022Single Loop Gaussian Homotopy Method for Non-convex Optimizationcited by 15
- 2022Generalizing Gaussian Smoothing for Random Searchcited by 15
- 2024Global Optimization with A Power-Transformed Objective and Gaussian Smoothingcited by 4
Built on by
Not cited yet.