Authors: Yu-Jie Zhang, Yu-Xiang Wang, Peng Zhao, Kevin Jamieson
Organizations: University of Washington · University of California, San Diego · State Key Laboratory for Novel Software Technology, Nanjing University School of Artificial Intelligence, Nanjing University
Cover's Universal Portfolio (Cover, 1991) matches the performance of the best constant rebalanced portfolio in hindsight. We generalize this framework to compete with an arbitrary comparator sequence u1,…,uT, leading to a dynamic regret minimization problem for the log loss where existing methods break down due to potentially unbounded gradients. The log loss is exp-concave, a curvature property that classically yields fast rates for static regret, yet we show that this advantage generally disappears in the dynamic setting. In particular, a linear-loss-type TPT dependence is unavoidable, where PT=∑t=2T∥ut−ut−1∥1 is the standard path length. This limitation stems from the coarse nature of PT, which obscures finer spatial and temporal structure of the comparator sequence. We therefore introduce two structure-aware measures---the Jensen-Shannon distance for spatial structure and the JSq-path length for temporal structure---under which faster rates are attainable when the comparator sequence has favorable structure. To achieve sharp bounds for both measures simultaneously, we develop Universal Dynamic Portfolio, a parameter-free method that combines a new Dirichlet Hedge algorithm with a fixed-share update, while retaining a near-optimal PT guarantee in the worst case. Finally, under an additional bounded-gradient assumption, we show that OPS admits the faster T1/3PT2/3 dynamic regret rate over all comparator sequences. We attain this rate with a tractable proper algorithm that applies more broadly to general online exp-concave optimization over arbitrary compact convex domains.
Table 1: Summary of dynamic regret bounds under different complexity measures. Here, Jt=(KL(ut∥uˉt)+KL(ut−1∥uˉt))/2 denotes the Jensen–Shannon (JS) distance between consecutive comparators, where uˉt=(ut−1+ut)/2 is their midpoint. The notation O(⋅) hides logarithmic factors.
State Key Laboratory for Novel Software Technology, Nanjing University · School of Artificial Intelligence, Nanjing University · School of Software Technology, Zhejiang University