math.OCMay 13, 2026

Stochastic global optimization of continuous functions via random walks on Grassmannians

Authors: Kartik GuptaStephen D. MillerPradeep RavikumarRamarathnam Venkatesan

Abstract

We introduce a stochastic global optimization method based on random walks on Grassmannian manifolds. To minimize a continuous objective :RdR\ell:\mathbb{R}^d\rightarrow\mathbb{R}, the method repeatedly samples random kk-dimensional linear subspaces (with kdk\ll d), solves the resulting low-dimensional restrictions of these problems to these subspaces using an arbitrary black-box optimizer, and updates the iterate (which monotonically improves upon the previous iterate). Unlike classical optimization analyses that rely on convexity, smoothness, Lipschitz bounds, or Polyak-Lojasiewicz-type conditions, our convergence guarantees depend only on the geometric distribution of restricted minima across the kk-dimensional subspaces passing through a given point in Rd\mathbb{R}^d. We identify a gap parameter -- an analogue of a spectral gap for random walks -- that controls the rate at which the iterates approach the global minimum value. Finally, we argue that the same analysis yields a blind-spot robustness property: sufficiently narrow, deep dips of the loss function (small-measure regions where \ell spikes downward) have limited influence on the algorithm's trajectory, since they are unlikely to be encountered by random subspace sampling.

Explore similar work

CardsList
  1. Gradient Descent with Stochastic Subspaces via Persistence of Memory

    Sep 16, 2026Subhroshekhar Ghosh, Clement Z. Q. Ng, Pierre-Louis Poirion +1Stochastic Gradient DescentGradient Descent

  2. Stochastic simultaneous optimistic optimization

    Apr 27, 2026Michal Valko, Alexandra Carpentier, Rémi MunosStochastic OptimizationMaximization