cs.LGApr 4, 2026

Online learning of smooth functions on R\mathbb{R}

Authors: Jesse Geneson, Kuldeep Singh, Alexander Wang

Abstract

We study adversarial online learning of real-valued functions on R\mathbb{R}. In each round the learner is queried at xt∈Rx_t\in\mathbb{R}, predicts y^t\hat y_t, and then observes the true value f(xt)f(x_t); performance is measured by cumulative pp-loss ∑t≥1∣y^t−f(xt)∣p\sum_{t\ge 1}|\hat y_t-f(x_t)|^p. For the class

Gq={f:R→R absolutely continuous: ∫R∣f′(x)∣q dx≤1},\mathcal{G}_q=\Bigl\{f:\mathbb{R}\to\mathbb{R}\ \text{absolutely continuous}:\ \int_{\mathbb{R}}|f'(x)|^q\,dx\le 1\Bigr\},

we show that the standard model becomes ill-posed on R\mathbb{R}: for every p≥1p\ge 1 and q>1q>1, an adversary can force infinite loss. Motivated by this obstruction, we analyze three modified learning scenarios that limit the influence of queries that are far from previously observed inputs. In Scenario 1 the adversary must choose each new query within distance 11 of some past query. In Scenario 2 the adversary may query anywhere, but the learner is penalized only on rounds whose query lies within distance 11 of a past query. In Scenario 3 the loss in round tt is multiplied by a weight g(min⁡j<t∣xt−xj∣)g(\min_{j<t}|x_t-x_j|). We obtain sharp characterizations for Scenarios 1-2 in several regimes. For Scenario 3 we identify a clean threshold phenomenon: if gg decays too slowly, then the adversary can force infinite weighted loss. In contrast, for rapidly decaying weights such as g(z)=e−czg(z)=e^{-cz} we obtain finite and sharp guarantees in the quadratic case p=q=2p=q=2. Finally, we study a natural multivariable slice generalization Gq,d\mathcal{G}_{q,d} of Gq\mathcal{G}_q on Rd\mathbb{R}^d and show a sharp dichotomy: while the one-dimensional case admits finite opt-values in certain regimes, for every d≥2d\ge 2 the slice class Gq,d\mathcal{G}_{q,d} is too permissive, and even under Scenarios 1-3 an adversary can force infinite loss.

Explore similar work

Feb 22, 2026

Online Realizable Regression and Applications for ReLU Networks

Realizable online regression can behave very differently from online classification. Even without any margin or stochastic assumptions, realizability may enforce horizon-free (finite) cumulative loss under metric-like losses, even when the analogous classification problem has an infinite mistake bound. We study realizable online regression in the adversarial model under losses that satisfy an approximate triangle inequality (approximate pseudo-metrics). Recent work of Attias et al. shows that the minimax realizable cumulative loss is characterized by the scaled Littlestone/online dimension Donl\mathbb{D}_{\mathrm{onl}}, but this quantity can be difficult to analyze. Our main technical contribution is a generic potential method that upper bounds Donl\mathbb{D}_{\mathrm{onl}} by a concrete Dudley-type entropy integral that depends only on covering numbers of the hypothesis class under the induced sup pseudo-metric. We define an entropy potential Φ(H)=∫0diam(H)log⁡N(H,ε) dεΦ(\mathcal{H})=\int_{0}^{diam(\mathcal{H})} \log N(\mathcal{H},\varepsilon)\,d\varepsilon, where N(H,ε)N(\mathcal{H},\varepsilon) is the ε\varepsilon-covering number of H\mathcal{H}, and show that for every cc-approximate pseudo-metric loss, Donl(H)≤O(c) Φ(H)\mathbb{D}_{\mathrm{onl}}(\mathcal{H})\le O(c)\,Φ(\mathcal{H}). In particular, polynomial metric entropy implies Φ(H)<∞Φ(\mathcal{H})<\infty and hence a horizon-free realizable cumulative-loss bound with transparent dependence on effective dimension. We illustrate the method on two families. We prove a sharp qq-vs.-dd dichotomy for realizable online learning (finite and efficiently achievable Θd,q(Ld)Θ_{d,q}(L^d) total loss for LL-Lipschitz regression iff q>dq>d, otherwise infinite), and for bounded-norm kk-ReLU networks separate regression (finite loss, even O~(k2)\widetilde O(k^2), and O(1)O(1) for one ReLU) from classification (impossible already for k=2,d=1k=2,d=1).
Feb 24, 2026

Characterizing Online and Private Learnability under Distributional Constraints via Generalized Smoothness

Understanding minimal assumptions that enable learning and generalization is perhaps the central question of learning theory. Several celebrated results in statistical learning theory, such as the VC theorem and Littlestone's characterization of online learnability, establish conditions on the hypothesis class that allow for learning under independent data and adversarial data, respectively. Building upon recent work bridging these extremes, we study sequential decision making under distributional adversaries that can adaptively choose data-generating distributions from a fixed family UU and ask when such problems are learnable with sample complexity that behaves like the favorable independent case. We provide a near complete characterization of families UU that admit learnability in terms of a notion known as generalized smoothness i.e. a distribution family admits VC-dimension-dependent regret bounds for every finite-VC hypothesis class if and only if it is generalized smooth. Further, we give universal algorithms that achieve low regret under any generalized smooth adversary without explicit knowledge of UU. Finally, when UU is known, we provide refined bounds in terms of a combinatorial parameter, the fragmentation number, that captures how many disjoint regions can carry nontrivial mass under UU. These results provide a nearly complete understanding of learnability under distributional adversaries. In addition, building upon the surprising connection between online learning and differential privacy, we show that the generalized smoothness also characterizes private learnability under distributional constraints.
Apr 13, 2026

Gradient-Variation Regret Bounds for Unconstrained Online Learning

We develop parameter-free algorithms for unconstrained online learning with regret guarantees that scale with the gradient variation VT(u)=∑t=2T∥∇ft(u)−∇ft−1(u)∥2V_T(u) = \sum_{t=2}^T \|\nabla f_t(u)-\nabla f_{t-1}(u)\|^2. For LL-smooth convex losses, we provide fully-adaptive algorithms achieving regret of O~(∥u∥VT(u)+L∥u∥2+G4)\widetilde{O}(\|u\|\sqrt{V_T(u)} + L\|u\|^2+G^4) without requiring prior knowledge of comparator norm ∥u∥\|u\|, Lipschitz constant GG, or smoothness LL. The update in each round can be computed efficiently via a closed-form expression. Our results extend to dynamic regret and find immediate implications for the stochastically-extended adversarial (SEA) model, which significantly improves upon the previous best-known result (Wang et al., 2025).