cs.LGSep 30, 2026

Geometry-Dependent Bounds for Online Non-Monotone DR-Submodular Maximization

Authors: Vaneet Aggarwal

Organizations: Purdue University

Abstract

We study adversarial online maximization of nonnegative, non-monotone DR-submodular functions over compact convex down-closed sets. A learner commits each action before observing its objective and competes with the best fixed action in hindsight. We prove a comparator-uniform first-order inequality that gives coefficient 4/94/9, improving the online 0.4010.401 benchmark, with one gradient query and one projection per round and O(T)O(\sqrt T) expected approximate regret. If ζ1∈K⊆[0,1]dζ{\bf 1} \in K\subseteq[0,1]^d, the coefficient improves to α‾(ζ)=12−(1−2ζ)+2/[2(3−2ζ)2]\underlineα(ζ)=\tfrac12-(1-2ζ)_+^2/[2(3-2ζ)^2]. The proof is a direct ordered-coordinate argument with an objective-independent rational action. Conversely, a three-group symmetry-gap construction yields an offline oracle upper bound β∗=0.470438681380894…β_*=0.470438681380894\ldots at ζ=0ζ=0, even with exact value and full-gradient responses. A parameterized extension and exact finite-instance bounds define an upper function for every ζζ. The lower and upper bounds match at 1/21/2 for ζ≥1/2ζ\ge1/2, and show that the optimal deficit from 1/21/2 is Θ((1/2−ζ)2)Θ((1/2-ζ)^2) as ζ↑1/2ζ\uparrow1/2. For coefficient-revealed polynomials we obtain 1/21/2 for quadratics and a geometry-dependent cubic coefficient starting at 8/178/17, including 0.490.49 at ζ=1/5ζ=1/5. A constant objective sequence yields an offline (4/9−ε)(4/9-\varepsilon) approximation with polynomially many first-order queries on the cube and projections, without requiring a supplied positive lower bound on the optimum. We also give nonanticipating adaptive-adversary and value-feedback guarantees, including O(T3/4)O(T^{3/4}) regret with one noisy value per round.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

Jan 30, 2025math.OC

Decentralized Projection-free Online Upper-Linearizable Optimization with Applications to DR-Submodular Optimization

We introduce a novel framework for decentralized projection-free optimization, extending projection-free methods to a broader class of upper-linearizable functions. Our approach leverages decentralized optimization techniques with the flexibility of upper-linearizable function frameworks, effectively generalizing traditional DR-submodular function optimization. We obtain the regret of O(T1−θ/2)O(T^{1-θ/2}) with communication complexity of O(Tθ)O(T^θ) and number of linear optimization oracle calls of O(T2θ)O(T^{2θ}) for decentralized upper-linearizable function optimization, for any 0≤θ≤10\le θ\le 1. This approach allows for the first results for monotone up-concave optimization with general convex constraints and non-monotone up-concave optimization with general convex constraints. Further, the above results for first order feedback are extended to zeroth order, semi-bandit, and bandit feedback.
Aug 31, 2026math.OC

Dec-BFTRL: Squre-Root Regret for Decentralized Online Upper-Linearizable Optimization under Separation Access with Application to Continuous Submodular Maximization

We study decentralized online optimization of upper-linearizable payoffs over an action set under efficient separation access, with applications to online continuous diminishing-return (DR) submodular maximization. We propose Decentralized Barrier Follow-the-Regularized-Leader (Dec-BFTRL), and evaluate each agent's played action against the average of all local objectives. Each agent maps an internal iterate to a feasible action through an approximate gauge projection, communicates only a cumulative surrogate-gradient dual state, and invokes the local HybridNewton procedure to approximately minimize its post-communication BFTRL potential. For every agent, we achieve expected network-aggregate regret of O~(T)\widetilde O(\sqrt{T}). Over TT rounds, each agent uses TT neighbor-mixing steps and O~(T)\widetilde O(T) separation-oracle calls. We give wrapper instantiations covering four up-concave or DR-submodular maximization problems.
May 8, 2026cs.LG

Curvature Beyond Positivity: Greedy Guarantees for Arbitrary Submodular Functions

Submodular functions -- functions exhibiting diminishing returns -- are central to machine learning. When the objective is monotone and non-negative, the greedy algorithm achieves a tight 63%63\% approximation. But many practical objectives incorporate costs that make them negative on some inputs, and all existing multiplicative guarantees require non-negativity. Prior work handles negativity through additive bounds for the special class of decomposable functions and non-monotonicity through partial-monotonicity parameters, but these address each difficulty in isolation and neither extends the classical structural theory. We extend \emph{curvature} -- a parameter measuring how far a function deviates from linearity -- to all submodular functions, handling both non-monotonicity and negativity through a single classical concept. A greedy algorithm with pruning achieves a curvature-controlled multiplicative ratio for \emph{any} submodular function, including those taking negative values -- the first such guarantee beyond monotonicity and non-negativity. In the non-monotone regime 1≤cg<2.21 \le c_g < 2.2, the bound strictly beats the best known uniform ratio of 0.4010.401 (for non-negative ff), and it recovers the classical (1−e−cg)/cg(1-e^{-c_g})/c_g guarantee for monotone functions. A multilinear-extension variant extends the framework to general combinatorial constraints via multilinear relaxation. Experiments on cost-penalized experimental design, coverage, feature selection, and a curvature sweep on Multi-News passage selection support the theory.