cs.AIAug 29, 2026

Nested Convex-Body Chasing for Online Optimization with Evolving Feasible Sets

Authors: Dhruv Sarkar, Aprameyo Chakrabartty

Organizations: Massachusetts Institute of Technology, Cambridge, MA · Purdue University, West Lafayette, IN

Abstract

We study online optimization with nested shrinking feasible regions in two settings: convex optimization with nested evolving feasible sets (CONES) and adversarial constrained online convex optimization (COCO). Our algorithms separate loss control from geometric movement: constrained minimizers and cumulative-loss tests preserve regret guarantees, while a deterministic resettable nested convex-body chaser limits movement. For CONES with a GG-Lipschitz, μμ-strongly convex objective on a diameter-DD domain, we chase intersections of the current feasible set with adaptive objective sublevel sets. Using the Euclidean chasing ratio O(dlog⁡(1+d))O(\sqrt{d\log(1+d)}), we obtain nonpositive regret at every prefix and movement O(dlog⁡(1+d) GDlog⁡(eT)/μ)O(\sqrt{d\log(1+d)\,GD\log(eT)/μ}). The bound adapts to the increase in the constrained optimum value. In dimension two, with all other parameters fixed, every randomized algorithm with terminal expected regret O(Tβ)O(T^β), β<1β<1, suffers Ω(log⁡T)Ω(\sqrt{\log T}) expected movement on some deterministic nested sequence, proving optimal horizon dependence. Under linear growth away from the constrained minimizer set, Steiner-point tracking yields movement independent of TT. For general convex COCO, one-step-delayed chasing with regularized-leader resets gives regret O(GfDdlog⁡(1+d)T)O(G_fD\sqrt{d\log(1+d)T}) and cumulative constraint violation O(GgDdlog⁡(1+d)T)O(G_gD\sqrt{d\log(1+d)T}). For strongly convex losses, both are O(dlog⁡(1+d)log⁡(eT))O(d\log(1+d)\log(eT)) when other parameters are fixed. These reductions replace the O(dd/2)O(d^{d/2}) projection-path factor in prior analyses by the polynomial dimension dependence of Euclidean nested convex-body chasing.

Figures & tables

Explore similar work

May 8, 2026

Convex Optimization with Nested Evolving Feasible Sets

Convex Optimization with Nested Evolving Feasible Sets (CONES)} is considered where the objective function ff remains fixed but the feasible region evolves over time as a nested sequence S1⊇S2⊇⋯⊇STS_1 \supseteq S_2 \supseteq \cdots \supseteq S_T. The goal of an online algorithm is to simultaneously minimize the regret with respect to hindsight static optimal benchmark and the total movement cost while ensuring feasibility at all times. CONES is an optimization-oriented generalization of the well-known nested convex body chasing problem. When the loss function is convex, we propose a lazy-algorithm and show that it achieves O(T1−β),O(Tβ)O(T^{1-β}), O(T^β) simultaneous regret and movement cost for any β∈(0,1]β\in (0,1], over a time horizon of TT. When the loss function is strongly convex or αα-sharp, we propose an algorithm Frugal that simultaneously achieves zero regret and a movement cost of O(log⁡T)O(\log T). To complement this, we show that any online algorithm with o(T)o(T) regret has a movement cost of Ω(log⁡T)Ω(\log{T}) for both cases, proving optimality of Frugal.
Sep 10, 2026

Convex Optimization with Nested Evolving Feasible Sets (CONES) under Time-Varying Loss Functions

Convex Optimization with Nested Evolving Feasible Sets (CONES)} was introduced in \cite{CONESVaze} where the objective function ff remains fixed but the feasible region evolves over time as a nested sequence S1⊇S2⊇⋯⊇STS_1 \supseteq S_2 \supseteq \cdots \supseteq S_T. The goal of an online algorithm is to simultaneously minimize the regret with respect to hindsight static optimal benchmark and the total movement cost M\cA(T)M_\cA(T) while ensuring feasibility at all times. CONES is an optimization-oriented generalization of the well-known nested convex body chasing (NCBC). In this paper, we extend CONES to allow for loss functions ft′f_t's to also change over time. When all loss functions are convex, we show that the projected proximal algorithm achieves O(T1−β),O(Tβ)O(T^{1-β}), O(T^β) simultaneous regret and movement cost, respectively, for any β∈[0,1)β\in [0,1), over a time horizon of TT. We also show that any {\it weakly adaptive} online algorithm with O(Tβ)O(T^β) regret has a movement cost of Ω(T1−β2)Ω\left(T^{\frac{1-β}{2}}\right) for any β∈[0,1)β\in [0,1). When all loss functions are strongly convex, we show that the projected proximal algorithm simultaneously achieves O(1)O(1) regret and a movement cost of O(log⁡T)O(\log T). To complement this, we show that any online algorithm with sublinear {\it anytime} regret has a movement cost of Ω(log⁡T)Ω\left(\log T\right).
May 20, 2026

A Geometric Approach to Constrained Online Learning

We study constrained online convex optimization with adversarial time-varying constraints. At each round the learner acts before observing the loss and constraint, and is compared with the best fixed action satisfying all constraints in hindsight. The goal is to obtain minimax-optimal regret while controlling cumulative constraint violation (CCV). Prior algorithms achieved O(log⁡T)O(\log T) regret with O(Tlog⁡T)O(\sqrt{T\log T}) CCV for strongly convex losses, and O(T)O(\sqrt{T}) regret with O(Tlog⁡T)O(\sqrt{T}\log T) CCV for convex losses. We propose NP-OGD, an iterated nested-projection algorithm. For strongly convex losses it achieves O(log⁡T)O(\log T) regret and O(log⁡T)O(\log T) CCV; for convex losses it achieves O(T)O(\sqrt{T}) regret and O(T)O(\sqrt{T}) CCV. The analysis relies on a geometric movement bound: after lifting the nested projected-gradient trajectory to one higher dimension, the lifted path is self-contracted under a nonstandard norm, so a finite-length theorem for self-contracted curves controls the total projection movement. We also prove complementary lower bounds using layered sphere packings. For strongly convex losses, any online algorithm with polynomially sublinear regret can incur CCV at least Ω((log⁡T)(d−1)/(d+1)/log⁡log⁡T)Ω((\log T)^{(d-1)/(d+1)}/\log\log T). For convex losses, we prove CCV lower bounds Ω(T(d−1)/(2(d+3)))Ω(T^{(d-1)/(2(d+3))}) for weakly adaptive algorithms and Ω(T(d−1)/(2d))Ω(T^{(d-1)/(2d)}) for NP-OGD. Finally, for the constrained experts special case over NN experts, an active Hedge algorithm attains O(Tlog⁡N)O(\sqrt{T\log N}) regret and O(N)O(N) CCV, with a matching minimax CCV lower bound for sufficiently large horizons.