cs.LGNov 2, 2026

When Is Tracking Affordable? A Movement-Budget Feasibility Threshold for Dynamic Regret

Authors: Ridham Patel

Organizations: Computer Science & Engineering, Indian Institute of Technology Gandhinagar, Gandhinagar, India

Abstract

Dynamic regret measures an online learner against a moving comparator, and standard analyses assume the learner may move freely at every round. We study what happens when it may not: the learner is given a hard budget SS on its total movement ∑t∥xt−xt−1∥\sum_t \|x_t - x_{t-1}\|. Our main result is that a movement budget creates a feasibility barrier. On a domain of diameter DD with GG-Lipschitz convex losses, for every comparator path length PT∈[D,DT]P_T \in [D, DT] we exhibit a deterministic adversary that forces Rd=Ω(GDT)R_d = Ω(GDT) on every budget-feasible algorithm whenever S≤cPTS \le c P_T for a universal constant c>0c>0. This barrier is caused by the budget rather than by a volatile environment: for fixed DD, it applies when PT=o(T)P_T = o(T), where the unconstrained minimax rate Θ(GD(D+PT)T)Θ(G\sqrt{D(D+P_T)T}) is sublinear, so the same instances are learnable with an unbounded budget and unlearnable without one. Conversely, projected online gradient descent with a budget-aware step size is budget-feasible and attains o(GDT)o(GDT) once S=ω(D+PT)S = ω(D + P_T). Thus the critical movement scale is D+PTD+P_T: linear regret is unavoidable below a sufficiently small constant multiple of PTP_T, while sublinear regret is achievable when S/(D+PT)→∞S/(D+P_T)\to\infty in the learnable regime. The construction rests on a distinction we make explicit: what makes a comparator expensive to track under a movement budget is the distance it forces the learner to travel, not its path length. Above the threshold we give a budget-dependent upper bound and identify the tight minimax rate in this region as an open problem rather than claiming a product law. Experiments support the predicted transition location and the 1/S1/S decay.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Optimally Pacing Budget Spending and Learning

    Oct 8, 2026Mark Braverman, Jingyi Liu, Jieming Mao +2Online LearningOnline Resource Allocation

  2. Dynamic Regret in Online Convex Optimization with Indicator Switching Costs

    Sep 24, 2026Naram Mhaisen, George IosifidisOnline Convex OptimizationDynamic Regret Minimization