math.OCSep 25, 2026

Tight Stochastic Condition-Number Dependence in Nonconvex-Strongly-Concave Minimax Optimization

Authors: Qihao Zhou

Organizations: Independent Researcher

Abstract

We study whether the linear condition-number dependence in the stochastic complexity of SAPD+ is necessary for nonconvex-strongly-concave minimax optimization. For jointly LL-smooth objectives with dual strong-concavity parameter μμ, we prove a lower bound that matches the SAPD+ upper bound under the same Moreau-envelope stationarity criterion and the same primal-dual initialization gap. Specifically, when σ≥εσ\ge\varepsilon, the worst-case complexity of zero-respecting algorithms is Θ(κLGσ2ε−4)Θ(κLGσ^2\varepsilon^{-4}) in the stated accuracy regime, where κ=L/μκ=L/μ, GG bounds the initial primal-dual gap, and σ2σ^2 bounds the variance of a general unbiased first-order oracle. The lower bound is realized on a smooth problem class with a bounded dual box. Our construction routes each link of a nonconvex zero-chain through a dual gradient of magnitude proportional to ε/κ\varepsilon/\sqrtκ, while an undiscovered primal coordinate prevents stationarity. It also yields the primal-gradient lower bound Ω(LΔ(κε−2+κσ2ε−4))Ω(LΔ(\sqrtκ\varepsilon^{-2}+κσ^2\varepsilon^{-4})) after combination with the known deterministic bound, where ΔΔ bounds the initial primal function gap.

Figures & tables

Explore similar work

CardsList
  1. Lower Bounds for Stochastic First-Order Algorithms with Variance Reduction in Nonconvex--Concave Minimax Optimization

    Oct 1, 2026Jiayi Song, Zi XuMin-Max Optimization

  2. Single-Loop Stochastic Projected Damped Extragradient Methods for Nonconvex--(Strongly) Concave Minimax Optimization

    Sep 18, 2026Huiling Zhang, Minhao Zhang, Zi Xu +1Min-Max OptimizationStochastic Optimization