math.OCNov 3, 2026

A simple adaptive accelerated optimistic dual averaging method for unconstrained convex optimization in pp-norm geometry

Authors: Bowen Li, Danqing Zhou, Chuan He

Organizations: Department of Mathematics, Linköping University, Sweden

Abstract

Efficient preconditioning plays an important role in large-scale first-order optimization. In this paper, we propose an adaptive accelerated optimistic dual averaging (A2\text{A}^2ODA) method for unconstrained convex optimization that adopts low-cost preconditioning based on pp-norm geometry for p∈[2,∞]p\in[2,\infty]. The method is line-search-free and employs a new stepsize selection technique based on an aggregated affine lower model. Its update structure is simple and unified across p∈[2,∞]p\in[2,\infty], with the case p>2p>2 requiring no more elaborate updates than the Euclidean case p=2p=2. Under a generalized local smoothness condition, we derive a convergence bound that separates the effects of constant and gap-dependent curvature, with the latter potentially yielding faster-decaying terms. In the special case of local smoothness, this bound recovers a nearly optimal convergence rate.

Explore similar work

CardsList
  1. A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo

    Apr 19, 2026S. Gratton, Ph. L. TointMomentum MethodsNonconvex Stochastic Optimization

  2. A Parameter-Free First-Order Algorithm for Non-Convex Optimization with  O~(ε−5/3)\tilde{\mkern1mu O}(ε^{-5/3}) Global Rate

    May 4, 2026Sichao Xiong, Sadok Jerad, Coralia CartisOptimization Convergence AnalysisGradient Descent

  3. Efficient Preconditioned Optimization Methods with Frequent Directions

    Oct 12, 2026Sifan Yang, Yuanyu Wan, Yibo Wang +1Adaptive Gradient MethodsOnline Convex Optimization