math.OCNov 10, 2026

Optimal Last-Iterate Bounds for Nonexpansive Stochastic Approximation

Authors: Ramanan Tamizholi, Siddharth Chandak, Rahul Singh

Organizations: Department of Computer Science and Automation, Indian Institute of Science, Bengaluru, India. · Department of Electrical Engineering, Stanford University, Stanford, California, USA. · EPITA, Laboratoire Recherche de l’EPITA, Paris, France.

Abstract

We establish last-iterate mean-square residual bounds for nonexpansive stochastic approximation (SA), or stochastic Krasnoselskii-Mann (KM) iterations. In particular, we consider fixed-point mappings that are nonexpansive with respect to the Euclidean norm, and focus on polynomially decaying stepsizes. We study three conditions on the conditional second moment of the noise, and obtain bounds that are optimal up to logarithmic factors in each case. When it scales linearly with the squared residual, the best rate is O(1/k1−ε)O(1/k^{1-ε}) for any ε>0ε>0. In this case, for all considered stepsizes, our bounds match those of the noiseless KM iteration. When it is bounded by a constant, the best rate is O(log⁡2k/k)O(\log^2 k/\sqrt{k}). When it scales affinely with the squared norm of the iterate, the best rate is O(1/k1/2−ε)O(1/k^{1/2-ε}), and the mean-square residual can diverge if the stepsizes are not square-summable. Thus, unlike for contractive SA, square-summable stepsizes are necessary for nonexpansive SA. We demonstrate how various algorithms with cocoercive maps, such as stochastic gradient descent, linear SA, and learning in cocoercive games, fit into our framework, and how the different noise conditions arise in each of them.

Explore similar work

CardsList
  1. Non-Expansive Two-Time-Scale Stochastic Approximation: A Fixed-Schedule One-Quarter Barrier and Bias-Corrected Acceleration

    Jul 15, 2026Dhruv Sarkar, Vaneet AggarwalLast-Iterate ConvergenceStochastic Approximation

  2. Concentration and Mean-Square Bounds for Contractive Stochastic Approximation: A Unified Elementary Approach

    Jul 20, 2026Siddharth ChandakStochastic Approximation

  3. Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise

    May 20, 2026Shubhada Agrawal, Siva Theja Maguluri, Martin ZubeldiaHeavy-Tailed NoiseStochastic Approximation