cs.LGSep 23, 2026

Sharp Oracle-Regret Tradeoffs for Projection-Free Online Convex Optimization

Authors: Vaneet Aggarwal

Organizations: Purdue University West Lafayette, Indiana, USA

Abstract

We characterize the regret attainable in online convex optimization when access to the feasible set is limited to an exact linear optimization oracle. The learner is given an inscribed ball and a diameter bound and must remain feasible on every consistent instance. For convex GG-Lipschitz losses, diameter at most DD, a total allowance of QQ oracle calls, and a strict limit of BB calls per round, the dimension-free minimax expected regret is Θ(GDmax⁡{T,T/(1+min⁡{Q,BT})1/4})Θ(GD\max\{\sqrt T,T/(1+\min\{Q,BT\})^{1/4}\}). The lower bound applies to arbitrary randomized learners. Universal feasibility first forces each action into the hull of the supplied ball and the preceding oracle replies. A fixed-body construction then couples fresh phase directions to a shared simplex, making useful replies costly repeatedly even though all losses have a common minimizer. A counted approximate-gradient method with interleaved blocks attains the matching rate. Total-budget and strict per-round guarantees follow as special cases, including the T3/4T^{3/4} rate with one call per round and the quadratic total budget needed for T\sqrt T regret. For prescribed smoothness ββ, an analytic construction yields a curvature-dependent lower bound and identifies the threshold above which the general characterization remains sharp.

Figures & tables

Explore similar work

CardsList
  1. Data-Dependent Regret and Polyak Corrections for Constrained Online Convex Optimization

    Jul 28, 2026Wentao ZhangOnline Convex OptimizationConstrained Optimization

  2. Online Convex Optimization with Sublinear Noisy Probes

    Jun 12, 2026Simone Di Gregorio, Anupam Gupta, Stefano Leonardi +1Online Convex OptimizationOnline Learning