math.OCSep 2, 2026

Improved Gradient Descent Lower Bounds Beyond Nesterov

Authors: Yuhan Ye, Kaizhao Liu

Organizations: MIT

Abstract

We study how far gradient descent (GD) can be accelerated by predetermined stepsizes in smooth convex optimization. Going beyond the classical Ω(n−2)Ω(n^{-2}) first-order oracle lower bound of Nemirovsky and Yudin (1983), we prove an Ω(n−1.6342)Ω(n^{-1.6342}) non-anytime lower bound and an Ω(n−1.2408)Ω(n^{-1.2408}) anytime lower bound. These improve the recent Ω(n−1.932)Ω(n^{-1.932}) non-anytime lower bound of Ma and Chen (2026) and the Ω(n−4/3)Ω(n^{-4/3}) anytime lower bound of Tsai et al. (2026), respectively. Both results continue to hold when the stepsizes may be negative. Our anytime lower bound also shows that the O(n−log⁡2(1+2))O(n^{-\log_2(1+\sqrt{2})}) rate of non-anytime silver schedules (Altschuler and Parrilo, 2025; Grimmer et al., 2025) is unattainable in the anytime setting. This establishes a strict separation between the two settings.