mlsanityData to 7 Oct 2026

Stochastic global optimization of continuous functions via random walks on Grassmannians

arXiv 2605.14151 ↗First posted 13 May 2026math.OC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce a stochastic global optimization method based on random walks on Grassmannian manifolds. To minimize a continuous objective ℓ:ℝdrightarrowℝ, the method repeatedly samples random k-dimensional linear subspaces (with kll d), solves the resulting low-dimensional restrictions of these problems to these subspaces using an arbitrary black-box optimizer, and updates the iterate (which monotonically improves upon the previous iterate). Unlike classical optimization analyses that rely on convexity, smoothness, Lipschitz bounds, or Polyak-Lojasiewicz-type conditions, our convergence guarantees depend only on the geometric distribution of restricted minima across the k-dimensional subspaces passing through a given point in ℝd. We identify a gap parameter -- an analogue of a spectral gap for random walks -- that controls the rate at which the iterates approach the global minimum value. Finally, we argue that the same analysis yields a blind-spot robustness property: sufficiently narrow, deep dips of the loss function (small-measure regions where ℓ spikes downward) have limited influence on the algorithm's trajectory, since they are unlikely to be encountered by random subspace sampling.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 26 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

5 of 26 references.

References · 5

  1. 2020Better Theory for SGD in the Nonconvex Worldcited by 156
  2. 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
  3. 2016Learning from Untrusted Datacited by 90
  4. 2018Robust Estimation via Robust Gradient Estimationcited by 76
  5. 2020SGD for Structured Nonconvex Functions: Learning Rates, Minibatching and Interpolationcited by 66

Built on by

Not cited yet.